Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 23755
3760
Julian Zilly Baseline-IL-logs-tensorflow aido2-LFV-sim-validation
step1-simulation success yes ip-172-31-40-253-12257
2019-05-21 20:23:07+00:00 2019-05-21 20:54:28+00:00 0:31:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.200030015745961 survival_time_median 12.700000000000044 deviation-center-line_median 0.6369252438908614 in-drivable-lane_median 2.550000000000036
other stats agent_compute-ego_max 0.2565963864326477 agent_compute-ego_mean 0.2427617764626424 agent_compute-ego_median 0.25565817036966637 agent_compute-ego_min 0.19192849297121348 deviation-center-line_max 0.938870820536923 deviation-center-line_mean 0.6801285279745213 deviation-center-line_min 0.5743492450420823 deviation-heading_max 6.140685827056716 deviation-heading_mean 2.8263503265771868 deviation-heading_median 2.237860847813221 deviation-heading_min 1.533681468196535 driven_any_max 2.0270175892883313 driven_any_mean 1.486994679574725 driven_any_median 1.5974579299097054 driven_any_min 1.060282232030924 driven_lanedir_consec_max 2.012815792682221 driven_lanedir_consec_mean 1.2063319448473904 driven_lanedir_consec_min 0.6050878885879691 driven_lanedir_max 2.012815792682221 driven_lanedir_mean 1.228853882204554 driven_lanedir_median 1.200030015745961 driven_lanedir_min 0.717697575373788 in-drivable-lane_max 3.049999999999999 in-drivable-lane_mean 1.7000000000000148 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.112366647932209, "sim_physics": 0.16211535637838798, "survival_time": 14.250000000000068, "driven_lanedir": 0.717697575373788, "sim_render-ego": 0.06272407581931666, "in-drivable-lane": 3.049999999999999, "agent_compute-ego": 0.2531179110209147, "deviation-heading": 6.140685827056716, "set_robot_commands": 0.09596583048502604, "deviation-center-line": 0.5919813600784193, "driven_lanedir_consec": 0.6050878885879691, "sim_compute_sim_state": 0.03993736400938871, "sim_compute_performance-ego": 0.06914411260370623, "sim_compute_robot_state-ego": 0.07603546443738435, "sim_compute_robot_state-npc0": 0.06936810309426826, "sim_compute_robot_state-npc1": 0.07039642417640017, "sim_compute_robot_state-npc2": 0.06966890201233981, "sim_compute_robot_state-npc3": 0.06903519044842636}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.0270175892883313, "sim_physics": 0.1787663451830546, "survival_time": 14.950000000000076, "driven_lanedir": 2.012815792682221, "sim_render-ego": 0.06322642962137857, "in-drivable-lane": 0, "agent_compute-ego": 0.2565963864326477, "deviation-heading": 1.533681468196535, "set_robot_commands": 0.09736258029937744, "deviation-center-line": 0.938870820536923, "driven_lanedir_consec": 2.012815792682221, "sim_compute_sim_state": 0.03988186359405518, "sim_compute_performance-ego": 0.06922521511713664, "sim_compute_robot_state-ego": 0.07422699133555094, "sim_compute_robot_state-npc0": 0.0706602684656779, "sim_compute_robot_state-npc1": 0.07088910261789957, "sim_compute_robot_state-npc2": 0.0699059534072876, "sim_compute_robot_state-npc3": 0.06998639980951946}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.060282232030924, "sim_physics": 0.1636961930952732, "survival_time": 7.94999999999998, "driven_lanedir": 0.9911603796482747, "sim_render-ego": 0.06197033588241481, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.25650792151876967, "deviation-heading": 2.2728410202472364, "set_robot_commands": 0.09833477578073176, "deviation-center-line": 0.5743492450420823, "driven_lanedir_consec": 0.9911603796482747, "sim_compute_sim_state": 0.0398378702079725, "sim_compute_performance-ego": 0.07075770396106648, "sim_compute_robot_state-ego": 0.07699142761950223, "sim_compute_robot_state-npc0": 0.07166545196149335, "sim_compute_robot_state-npc1": 0.07144120504271309, "sim_compute_robot_state-npc2": 0.07133140953831703, "sim_compute_robot_state-npc3": 0.07153733871268027}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6378489987124556, "sim_physics": 0.1629716486442746, "survival_time": 12.700000000000044, "driven_lanedir": 1.200030015745961, "sim_render-ego": 0.06368492907426489, "in-drivable-lane": 2.8500000000000405, "agent_compute-ego": 0.25565817036966637, "deviation-heading": 2.237860847813221, "set_robot_commands": 0.09707628366515392, "deviation-center-line": 0.6585159703243202, "driven_lanedir_consec": 1.200030015745961, "sim_compute_sim_state": 0.038963246533251186, "sim_compute_performance-ego": 0.0719500141819631, "sim_compute_robot_state-ego": 0.0751999785580973, "sim_compute_robot_state-npc0": 0.07216616127434677, "sim_compute_robot_state-npc1": 0.07192177659883274, "sim_compute_robot_state-npc2": 0.07048485879822979, "sim_compute_robot_state-npc3": 0.07262813387893316}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5974579299097054, "sim_physics": 0.1174510281727496, "survival_time": 12.450000000000042, "driven_lanedir": 1.2225656475725255, "sim_render-ego": 0.04962145659818228, "in-drivable-lane": 2.550000000000036, "agent_compute-ego": 0.19192849297121348, "deviation-heading": 1.946682469572225, "set_robot_commands": 0.07458158860723656, "deviation-center-line": 0.6369252438908614, "driven_lanedir_consec": 1.2225656475725255, "sim_compute_sim_state": 0.030819883308257443, "sim_compute_performance-ego": 0.05341426914475529, "sim_compute_robot_state-ego": 0.05745653550787623, "sim_compute_robot_state-npc0": 0.05504348670622431, "sim_compute_robot_state-npc1": 0.054655737666241135, "sim_compute_robot_state-npc2": 0.053944913258993005, "sim_compute_robot_state-npc3": 0.053512668992620874}}set_robot_commands_max 0.09833477578073176 set_robot_commands_mean 0.09266421176750514 set_robot_commands_median 0.09707628366515392 set_robot_commands_min 0.07458158860723656 sim_compute_performance-ego_max 0.0719500141819631 sim_compute_performance-ego_mean 0.06689826300172555 sim_compute_performance-ego_median 0.06922521511713664 sim_compute_performance-ego_min 0.05341426914475529 sim_compute_robot_state-ego_max 0.07699142761950223 sim_compute_robot_state-ego_mean 0.0719820794916822 sim_compute_robot_state-ego_median 0.0751999785580973 sim_compute_robot_state-ego_min 0.05745653550787623 sim_compute_robot_state-npc0_max 0.07216616127434677 sim_compute_robot_state-npc0_mean 0.06778069430040212 sim_compute_robot_state-npc0_median 0.0706602684656779 sim_compute_robot_state-npc0_min 0.05504348670622431 sim_compute_robot_state-npc1_max 0.07192177659883274 sim_compute_robot_state-npc1_mean 0.06786084922041734 sim_compute_robot_state-npc1_median 0.07088910261789957 sim_compute_robot_state-npc1_min 0.054655737666241135 sim_compute_robot_state-npc2_max 0.07133140953831703 sim_compute_robot_state-npc2_mean 0.06706720740303344 sim_compute_robot_state-npc2_median 0.0699059534072876 sim_compute_robot_state-npc2_min 0.053944913258993005 sim_compute_robot_state-npc3_max 0.07262813387893316 sim_compute_robot_state-npc3_mean 0.06733994636843602 sim_compute_robot_state-npc3_median 0.06998639980951946 sim_compute_robot_state-npc3_min 0.053512668992620874 sim_compute_sim_state_max 0.03993736400938871 sim_compute_sim_state_mean 0.037888045530585 sim_compute_sim_state_median 0.0398378702079725 sim_compute_sim_state_min 0.030819883308257443 sim_physics_max 0.1787663451830546 sim_physics_mean 0.15700011429474797 sim_physics_median 0.1629716486442746 sim_physics_min 0.1174510281727496 sim_render-ego_max 0.06368492907426489 sim_render-ego_mean 0.06024544539911144 sim_render-ego_median 0.06272407581931666 sim_render-ego_min 0.04962145659818228 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 12.460000000000042 survival_time_min 7.94999999999998
No reset possible 23673
3716
jiang peng Second test -RGB- TH-jp aido2-LF-sim-validation
step1-simulation failed yes ip-172-31-40-253-12257
2019-05-21 14:44:29+00:00 2019-05-21 14:46:25+00:00 0:01:56 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "experiment_manager.py", line 297, in run_episode
r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:
error in agent |Exception while handling a message on topic "get_commands".
|
|| Traceback (most recent call last):
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
|| f(**kwargs)
|| File "solution.py", line 58, in on_received_get_commands
|| action = (action + np.random.normal(0,0.2,size=env.action_space.shape[0])).clip(env.action_space.low, env.action_space.high)
|| NameError: name 'env' is not defined
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 441, in <module>
wrap(cie)
File "experiment_manager.py", line 429, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 135, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 301, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 23619
3705
Tony Hsu  🇹🇼Baseline solution using reinforcement learning aido2-LF-sim-testing
step1-simulation success yes ip-172-31-40-253-12257
2019-05-21 03:00:44+00:00 2019-05-21 03:49:58+00:00 0:49:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6950573847640089 survival_time_median 14.950000000000076 deviation-center-line_median 0.307138938696771 in-drivable-lane_median 7.200000000000037
other stats agent_compute-ego_max 0.2372602621714274 agent_compute-ego_mean 0.2357968071831597 agent_compute-ego_median 0.23606083313624063 agent_compute-ego_min 0.23351913770039875 deviation-center-line_max 0.7441993675765441 deviation-center-line_mean 0.36818899156986545 deviation-center-line_min 0.10083546877568052 deviation-heading_max 5.990117020581061 deviation-heading_mean 5.896451626677996 deviation-heading_median 5.9380236931489225 deviation-heading_min 5.613995197946513 driven_any_max 2.1853065485311514 driven_any_mean 2.1853065485311425 driven_any_median 2.1853065485311416 driven_any_min 2.1853065485311323 driven_lanedir_consec_max 0.6964859913423234 driven_lanedir_consec_mean 0.694822873038991 driven_lanedir_consec_min 0.6925369611104519 driven_lanedir_max 0.6964859913423234 driven_lanedir_mean 0.694822873038991 driven_lanedir_median 0.6950573847640089 driven_lanedir_min 0.6925369611104519 in-drivable-lane_max 7.400000000000038 in-drivable-lane_mean 7.236666666666703 in-drivable-lane_min 7.200000000000037 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.1853065485311434, "sim_physics": 0.056219104131062826, "survival_time": 14.950000000000076, "driven_lanedir": 0.6964859913423234, "sim_render-ego": 0.03618796745936076, "in-drivable-lane": 7.400000000000038, "agent_compute-ego": 0.23680371602376304, "deviation-heading": 5.613995197946513, "set_robot_commands": 0.055389099915822346, "deviation-center-line": 0.7337965812416224, "driven_lanedir_consec": 0.6964859913423234, "sim_compute_sim_state": 0.023894519805908204, "sim_compute_performance-ego": 0.04007806062698365, "sim_compute_robot_state-ego": 0.041775345007578533}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.1853065485311514, "sim_physics": 0.05633238315582276, "survival_time": 14.950000000000076, "driven_lanedir": 0.694222936176982, "sim_render-ego": 0.036336069901784264, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23679224967956544, "deviation-heading": 5.990117020581061, "set_robot_commands": 0.0553994623819987, "deviation-center-line": 0.29799505396684733, "driven_lanedir_consec": 0.694222936176982, "sim_compute_sim_state": 0.023783466815948485, "sim_compute_performance-ego": 0.04018988291422526, "sim_compute_robot_state-ego": 0.04250307003657023}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.185306548531138, "sim_physics": 0.057132825056711835, "survival_time": 14.950000000000076, "driven_lanedir": 0.6950573847640089, "sim_render-ego": 0.03620422760645548, "in-drivable-lane": 7.300000000000038, "agent_compute-ego": 0.23586845239003496, "deviation-heading": 5.796667795845188, "set_robot_commands": 0.05573479811350505, "deviation-center-line": 0.307138938696771, "driven_lanedir_consec": 0.6950573847640089, "sim_compute_sim_state": 0.023586674531300863, "sim_compute_performance-ego": 0.039875362714131675, "sim_compute_robot_state-ego": 0.041570406754811606}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.1853065485311367, "sim_physics": 0.05415695110956828, "survival_time": 14.950000000000076, "driven_lanedir": 0.6955060473032337, "sim_render-ego": 0.03629589319229126, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23606083313624063, "deviation-heading": 5.969503120784673, "set_robot_commands": 0.05477304458618164, "deviation-center-line": 0.6234334658421105, "driven_lanedir_consec": 0.6955060473032337, "sim_compute_sim_state": 0.0236421799659729, "sim_compute_performance-ego": 0.04000140031178792, "sim_compute_robot_state-ego": 0.042206497192382814}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.1853065485311407, "sim_physics": 0.054609217643737794, "survival_time": 14.950000000000076, "driven_lanedir": 0.6933707706415575, "sim_render-ego": 0.036560664971669515, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23724227031071984, "deviation-heading": 5.951617305849203, "set_robot_commands": 0.055363043944040936, "deviation-center-line": 0.44374302000365046, "driven_lanedir_consec": 0.6933707706415575, "sim_compute_sim_state": 0.024019014835357667, "sim_compute_performance-ego": 0.039914500713348386, "sim_compute_robot_state-ego": 0.0417566458384196}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.1853065485311394, "sim_physics": 0.05440897862116496, "survival_time": 14.950000000000076, "driven_lanedir": 0.6957599080131578, "sim_render-ego": 0.036585330963134766, "in-drivable-lane": 7.300000000000038, "agent_compute-ego": 0.23688955227533975, "deviation-heading": 5.818542702573388, "set_robot_commands": 0.05585407495498657, "deviation-center-line": 0.7441993675765441, "driven_lanedir_consec": 0.6957599080131578, "sim_compute_sim_state": 0.023798503875732423, "sim_compute_performance-ego": 0.03968492031097412, "sim_compute_robot_state-ego": 0.041690038045247395}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 2.185306548531151, "sim_physics": 0.05453683296839396, "survival_time": 14.950000000000076, "driven_lanedir": 0.6947112112972071, "sim_render-ego": 0.03654679695765178, "in-drivable-lane": 7.250000000000037, "agent_compute-ego": 0.2371910301844279, "deviation-heading": 5.9347088906542345, "set_robot_commands": 0.05470743974049886, "deviation-center-line": 0.21723026496478212, "driven_lanedir_consec": 0.6947112112972071, "sim_compute_sim_state": 0.02377872546513875, "sim_compute_performance-ego": 0.04016470034917196, "sim_compute_robot_state-ego": 0.04135100444157918}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.1853065485311323, "sim_physics": 0.05217970530192057, "survival_time": 14.950000000000076, "driven_lanedir": 0.6954494436503662, "sim_render-ego": 0.03602260669072469, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.2372602621714274, "deviation-heading": 5.951584056210216, "set_robot_commands": 0.05456499179204305, "deviation-center-line": 0.26967879357000285, "driven_lanedir_consec": 0.6954494436503662, "sim_compute_sim_state": 0.02377602497736613, "sim_compute_performance-ego": 0.0396092168490092, "sim_compute_robot_state-ego": 0.041184771060943606}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.185306548531139, "sim_physics": 0.05522885560989379, "survival_time": 14.950000000000076, "driven_lanedir": 0.6951211993980144, "sim_render-ego": 0.03605405489603678, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23470171531041464, "deviation-heading": 5.9380236931489225, "set_robot_commands": 0.05435485521952311, "deviation-center-line": 0.19127509329278516, "driven_lanedir_consec": 0.6951211993980144, "sim_compute_sim_state": 0.02390628735224406, "sim_compute_performance-ego": 0.03965600887934367, "sim_compute_robot_state-ego": 0.04147425015767416}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.185306548531147, "sim_physics": 0.05486394087473551, "survival_time": 14.950000000000076, "driven_lanedir": 0.6957742227582209, "sim_render-ego": 0.03597301403681437, "in-drivable-lane": 7.250000000000037, "agent_compute-ego": 0.23639575004577637, "deviation-heading": 5.84542238624642, "set_robot_commands": 0.05446603775024414, "deviation-center-line": 0.13803594115198106, "driven_lanedir_consec": 0.6957742227582209, "sim_compute_sim_state": 0.02387503385543823, "sim_compute_performance-ego": 0.04110508441925049, "sim_compute_robot_state-ego": 0.041235493024190266}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.1853065485311443, "sim_physics": 0.05442051887512207, "survival_time": 14.950000000000076, "driven_lanedir": 0.6925369611104519, "sim_render-ego": 0.03614615281422933, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23504799286524455, "deviation-heading": 5.954990711277449, "set_robot_commands": 0.055364477634429934, "deviation-center-line": 0.30943438450656163, "driven_lanedir_consec": 0.6925369611104519, "sim_compute_sim_state": 0.023588735262552896, "sim_compute_performance-ego": 0.03963437557220459, "sim_compute_robot_state-ego": 0.0411237112681071}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.1853065485311416, "sim_physics": 0.05262575149536133, "survival_time": 14.950000000000076, "driven_lanedir": 0.6949038747368048, "sim_render-ego": 0.0359025247891744, "in-drivable-lane": 7.250000000000037, "agent_compute-ego": 0.234542076587677, "deviation-heading": 5.860593780739516, "set_robot_commands": 0.05444599469502767, "deviation-center-line": 0.10083546877568052, "driven_lanedir_consec": 0.6949038747368048, "sim_compute_sim_state": 0.0235660982131958, "sim_compute_performance-ego": 0.0397027571996053, "sim_compute_robot_state-ego": 0.040931255022684736}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.185306548531148, "sim_physics": 0.05420217752456665, "survival_time": 14.950000000000076, "driven_lanedir": 0.6952620692692497, "sim_render-ego": 0.0358279824256897, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23372559785842895, "deviation-heading": 5.922408824528451, "set_robot_commands": 0.05453328053156535, "deviation-center-line": 0.5431694946909088, "driven_lanedir_consec": 0.6952620692692497, "sim_compute_sim_state": 0.023416763146718342, "sim_compute_performance-ego": 0.03956336180369059, "sim_compute_robot_state-ego": 0.04075065930684407}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.185306548531144, "sim_physics": 0.05171666701634725, "survival_time": 14.950000000000076, "driven_lanedir": 0.6941725425290013, "sim_render-ego": 0.035717590649922686, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.2349114712079366, "deviation-heading": 5.949714932679345, "set_robot_commands": 0.05467243909835815, "deviation-center-line": 0.17004088680976326, "driven_lanedir_consec": 0.6941725425290013, "sim_compute_sim_state": 0.023308780988057453, "sim_compute_performance-ego": 0.03931858857472738, "sim_compute_robot_state-ego": 0.041351764996846514}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1853065485311363, "sim_physics": 0.05443073987960816, "survival_time": 14.950000000000076, "driven_lanedir": 0.6940085325942875, "sim_render-ego": 0.03576557000478109, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23351913770039875, "deviation-heading": 5.948883981105356, "set_robot_commands": 0.05469905932744344, "deviation-center-line": 0.4328281184579712, "driven_lanedir_consec": 0.6940085325942875, "sim_compute_sim_state": 0.02330392201741537, "sim_compute_performance-ego": 0.03938270648320516, "sim_compute_robot_state-ego": 0.040738282203674314}}set_robot_commands_max 0.05585407495498657 set_robot_commands_mean 0.05495480664571127 set_robot_commands_median 0.05470743974049886 set_robot_commands_min 0.05435485521952311 sim_compute_performance-ego_max 0.04110508441925049 sim_compute_performance-ego_mean 0.03985872851477729 sim_compute_performance-ego_median 0.0397027571996053 sim_compute_performance-ego_min 0.03931858857472738 sim_compute_robot_state-ego_max 0.04250307003657023 sim_compute_robot_state-ego_mean 0.04144287962383695 sim_compute_robot_state-ego_median 0.041351764996846514 sim_compute_robot_state-ego_min 0.040738282203674314 sim_compute_sim_state_max 0.024019014835357667 sim_compute_sim_state_mean 0.023682982073889844 sim_compute_sim_state_median 0.02377602497736613 sim_compute_sim_state_min 0.02330392201741537 sim_physics_max 0.057132825056711835 sim_physics_mean 0.05447097661760118 sim_physics_median 0.05443073987960816 sim_physics_min 0.05171666701634725 sim_render-ego_max 0.036585330963134766 sim_render-ego_mean 0.03614176315731472 sim_render-ego_median 0.03614615281422933 sim_render-ego_min 0.035717590649922686 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 23568
3687
Tony Hsu  🇹🇼Baseline solution using reinforcement learning aido2-LF-sim-testing
step1-simulation error yes ip-172-31-40-253-12257
2019-05-20 16:25:14+00:00 2019-05-20 17:02:35+00:00 0:37:21 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 23560
3686
Tony Hsu  🇹🇼Baseline solution using reinforcement learning aido2-LF-sim-validation
step1-simulation aborted yes ip-172-31-40-253-12257
2019-05-20 15:45:14+00:00 2019-05-20 16:02:03+00:00 0:16:49 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 23546
3678
Tony Hsu  🇹🇼Baseline solution using reinforcement learning aido2-LF-sim-validation
step1-simulation success yes ip-172-31-40-253-12257
2019-05-20 14:31:27+00:00 2019-05-20 14:46:40+00:00 0:15:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6935805249478659 survival_time_median 14.950000000000076 deviation-center-line_median 0.13576341190830038 in-drivable-lane_median 7.350000000000037
other stats agent_compute-ego_max 0.23882120185428196 agent_compute-ego_mean 0.2364927157825894 agent_compute-ego_median 0.236285564104716 agent_compute-ego_min 0.23455386718114216 deviation-center-line_max 0.42632647013358815 deviation-center-line_mean 0.20386004643877892 deviation-center-line_min 0.041663353925832584 deviation-heading_max 5.801699789039097 deviation-heading_mean 4.639978324969698 deviation-heading_median 5.704071130785565 deviation-heading_min 0.3584582273080204 driven_any_max 2.185306548531152 driven_any_mean 1.765311046847185 driven_any_median 2.185306548531149 driven_any_min 0.08532904011133041 driven_lanedir_consec_max 0.6948995260115542 driven_lanedir_consec_mean 0.5596637088722516 driven_lanedir_consec_min 0.023144130689651377 driven_lanedir_max 0.6948995260115542 driven_lanedir_mean 0.5596637088722516 driven_lanedir_median 0.6935805249478659 driven_lanedir_min 0.023144130689651377 in-drivable-lane_max 7.400000000000038 in-drivable-lane_mean 5.9500000000000295 in-drivable-lane_min 0.30000000000000027 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.185306548531152, "sim_physics": 0.05882202307383219, "survival_time": 14.950000000000076, "driven_lanedir": 0.6935805249478659, "sim_render-ego": 0.03745715777079264, "in-drivable-lane": 7.300000000000036, "agent_compute-ego": 0.2373280398050944, "deviation-heading": 5.801699789039097, "set_robot_commands": 0.05538517236709595, "deviation-center-line": 0.42632647013358815, "driven_lanedir_consec": 0.6935805249478659, "sim_compute_sim_state": 0.024560755093892415, "sim_compute_performance-ego": 0.040364675521850586, "sim_compute_robot_state-ego": 0.042288084824879967}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.1853065485311447, "sim_physics": 0.054071175257364906, "survival_time": 14.950000000000076, "driven_lanedir": 0.6945338083100598, "sim_render-ego": 0.036382119655609134, "in-drivable-lane": 7.350000000000037, "agent_compute-ego": 0.2354749059677124, "deviation-heading": 5.704071130785565, "set_robot_commands": 0.054803686141967775, "deviation-center-line": 0.09203990928853956, "driven_lanedir_consec": 0.6945338083100598, "sim_compute_sim_state": 0.024045357704162596, "sim_compute_performance-ego": 0.0403041156133016, "sim_compute_robot_state-ego": 0.0425903582572937}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.08532904011133041, "sim_physics": 0.0594486395517985, "survival_time": 0.9000000000000002, "driven_lanedir": 0.023144130689651377, "sim_render-ego": 0.037938846482170954, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.23882120185428196, "deviation-heading": 0.3584582273080204, "set_robot_commands": 0.055656989415486656, "deviation-center-line": 0.041663353925832584, "driven_lanedir_consec": 0.023144130689651377, "sim_compute_sim_state": 0.02489516470167372, "sim_compute_performance-ego": 0.0427117215262519, "sim_compute_robot_state-ego": 0.041938967174953885}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.185306548531149, "sim_physics": 0.056793514092763266, "survival_time": 14.950000000000076, "driven_lanedir": 0.6921605544021268, "sim_render-ego": 0.03705367008845011, "in-drivable-lane": 7.400000000000038, "agent_compute-ego": 0.236285564104716, "deviation-heading": 5.725118401226187, "set_robot_commands": 0.05560779412587484, "deviation-center-line": 0.3235070869376339, "driven_lanedir_consec": 0.6921605544021268, "sim_compute_sim_state": 0.02424562374750773, "sim_compute_performance-ego": 0.039930724302927656, "sim_compute_robot_state-ego": 0.042770138581593835}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.18530654853115, "sim_physics": 0.054882098038991294, "survival_time": 14.950000000000076, "driven_lanedir": 0.6948995260115542, "sim_render-ego": 0.03647448698679606, "in-drivable-lane": 7.400000000000038, "agent_compute-ego": 0.23455386718114216, "deviation-heading": 5.610544076489624, "set_robot_commands": 0.054658969243367515, "deviation-center-line": 0.13576341190830038, "driven_lanedir_consec": 0.6948995260115542, "sim_compute_sim_state": 0.023670446077982583, "sim_compute_performance-ego": 0.04008190949757894, "sim_compute_robot_state-ego": 0.041420278549194334}}set_robot_commands_max 0.055656989415486656 set_robot_commands_mean 0.055222522258758545 set_robot_commands_median 0.05538517236709595 set_robot_commands_min 0.054658969243367515 sim_compute_performance-ego_max 0.0427117215262519 sim_compute_performance-ego_mean 0.04067862929238214 sim_compute_performance-ego_median 0.0403041156133016 sim_compute_performance-ego_min 0.039930724302927656 sim_compute_robot_state-ego_max 0.042770138581593835 sim_compute_robot_state-ego_mean 0.04220156547758315 sim_compute_robot_state-ego_median 0.042288084824879967 sim_compute_robot_state-ego_min 0.041420278549194334 sim_compute_sim_state_max 0.02489516470167372 sim_compute_sim_state_mean 0.02428346946504381 sim_compute_sim_state_median 0.02424562374750773 sim_compute_sim_state_min 0.023670446077982583 sim_physics_max 0.0594486395517985 sim_physics_mean 0.05680349000295003 sim_physics_median 0.056793514092763266 sim_physics_min 0.054071175257364906 sim_render-ego_max 0.037938846482170954 sim_render-ego_mean 0.03706125619676378 sim_render-ego_median 0.03705367008845011 sim_render-ego_min 0.036382119655609134 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 12.14000000000006 survival_time_min 0.9000000000000002
No reset possible 23535
3675
FANG MEIYI  🇸🇬test aido2-LFV-sim-testing
step1-simulation error yes ip-172-31-40-253-12257
2019-05-20 13:11:53+00:00 2019-05-20 14:00:14+00:00 0:48:21 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 23528
3669
Tony Hsu  🇹🇼Baseline solution using reinforcement learning aido2-LF-sim-validation
step1-simulation success yes ip-172-31-40-253-12257
2019-05-20 10:33:35+00:00 2019-05-20 10:51:08+00:00 0:17:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.4569501890103642 survival_time_median 14.950000000000076 deviation-center-line_median 1.301168569795478 in-drivable-lane_median 1.8000000000000107
other stats agent_compute-ego_max 0.2348476219177246 agent_compute-ego_mean 0.23418102741241453 agent_compute-ego_median 0.23428011894226075 agent_compute-ego_min 0.23339950640996296 deviation-center-line_max 1.3125511488831354 deviation-center-line_mean 1.1985086282065969 deviation-center-line_min 0.8168503090782064 deviation-heading_max 9.114488416750689 deviation-heading_mean 8.49621536573682 deviation-heading_median 8.958328817197787 deviation-heading_min 6.498379844353641 driven_any_max 4.817677691380996 driven_any_mean 4.817677691380984 driven_any_median 4.817677691380987 driven_any_min 4.817677691380966 driven_lanedir_consec_max 1.4959818706634302 driven_lanedir_consec_mean 1.447454660198641 driven_lanedir_consec_min 1.3598522055779538 driven_lanedir_max 3.002156010752614 driven_lanedir_mean 2.841506234756632 driven_lanedir_median 2.9457788003480623 driven_lanedir_min 2.3634970567089493 in-drivable-lane_max 4.650000000000027 in-drivable-lane_mean 2.380000000000014 in-drivable-lane_min 1.7500000000000098 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.817677691380996, "sim_physics": 0.05543094555536906, "survival_time": 14.950000000000076, "driven_lanedir": 2.918088194757594, "sim_render-ego": 0.036882936159769696, "in-drivable-lane": 1.9000000000000103, "agent_compute-ego": 0.23339950640996296, "deviation-heading": 8.958328817197787, "set_robot_commands": 0.05549233754475912, "deviation-center-line": 1.2532391684123592, "driven_lanedir_consec": 1.3598522055779538, "sim_compute_sim_state": 0.02381419817606608, "sim_compute_performance-ego": 0.03996768792470296, "sim_compute_robot_state-ego": 0.04159588813781738}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.817677691380987, "sim_physics": 0.056117419401804605, "survival_time": 14.950000000000076, "driven_lanedir": 2.9457788003480623, "sim_render-ego": 0.03683682441711426, "in-drivable-lane": 1.8000000000000105, "agent_compute-ego": 0.2338240400950114, "deviation-heading": 9.114488416750689, "set_robot_commands": 0.05619430144627889, "deviation-center-line": 1.301168569795478, "driven_lanedir_consec": 1.46991933974784, "sim_compute_sim_state": 0.023593289057413737, "sim_compute_performance-ego": 0.040067615509033205, "sim_compute_robot_state-ego": 0.0418483559290568}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.817677691380966, "sim_physics": 0.054320054054260256, "survival_time": 14.950000000000076, "driven_lanedir": 2.3634970567089493, "sim_render-ego": 0.036332832972208656, "in-drivable-lane": 4.650000000000027, "agent_compute-ego": 0.23428011894226075, "deviation-heading": 6.498379844353641, "set_robot_commands": 0.05583319425582886, "deviation-center-line": 0.8168503090782064, "driven_lanedir_consec": 1.4959818706634302, "sim_compute_sim_state": 0.023834712505340576, "sim_compute_performance-ego": 0.04028303066889445, "sim_compute_robot_state-ego": 0.041512629985809325}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.817677691380982, "sim_physics": 0.05970702489217122, "survival_time": 14.950000000000076, "driven_lanedir": 3.002156010752614, "sim_render-ego": 0.03599004586537679, "in-drivable-lane": 1.7500000000000098, "agent_compute-ego": 0.23455384969711304, "deviation-heading": 8.944077312138214, "set_robot_commands": 0.0553072198232015, "deviation-center-line": 1.3087339448638062, "driven_lanedir_consec": 1.4569501890103642, "sim_compute_sim_state": 0.023678666750590008, "sim_compute_performance-ego": 0.03995649973551432, "sim_compute_robot_state-ego": 0.04137231111526489}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.817677691380995, "sim_physics": 0.05569718519846598, "survival_time": 14.950000000000076, "driven_lanedir": 2.9780111112159418, "sim_render-ego": 0.03683046499888102, "in-drivable-lane": 1.8000000000000107, "agent_compute-ego": 0.2348476219177246, "deviation-heading": 8.965802438243768, "set_robot_commands": 0.05606562932332357, "deviation-center-line": 1.3125511488831354, "driven_lanedir_consec": 1.4545696959936176, "sim_compute_sim_state": 0.02408143679300944, "sim_compute_performance-ego": 0.03993809382120768, "sim_compute_robot_state-ego": 0.041982343196868895}}set_robot_commands_max 0.05619430144627889 set_robot_commands_mean 0.055778536478678385 set_robot_commands_median 0.05583319425582886 set_robot_commands_min 0.0553072198232015 sim_compute_performance-ego_max 0.04028303066889445 sim_compute_performance-ego_mean 0.040042585531870525 sim_compute_performance-ego_median 0.03996768792470296 sim_compute_performance-ego_min 0.03993809382120768 sim_compute_robot_state-ego_max 0.041982343196868895 sim_compute_robot_state-ego_mean 0.04166230567296345 sim_compute_robot_state-ego_median 0.04159588813781738 sim_compute_robot_state-ego_min 0.04137231111526489 sim_compute_sim_state_max 0.02408143679300944 sim_compute_sim_state_mean 0.023800460656483967 sim_compute_sim_state_median 0.02381419817606608 sim_compute_sim_state_min 0.023593289057413737 sim_physics_max 0.05970702489217122 sim_physics_mean 0.05625452582041422 sim_physics_median 0.05569718519846598 sim_physics_min 0.054320054054260256 sim_render-ego_max 0.036882936159769696 sim_render-ego_mean 0.036574620882670085 sim_render-ego_median 0.03683046499888102 sim_render-ego_min 0.03599004586537679 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 23383
3623
Tony Hsu  🇹🇼Baseline solution using reinforcement learning aido2-LF-sim-validation
step1-simulation success yes ip-172-31-40-253-12257
2019-05-19 17:12:54+00:00 2019-05-19 17:29:47+00:00 0:16:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6642436660663087 survival_time_median 14.950000000000076 deviation-center-line_median 0.6127901567591342 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.34592669480925153 agent_compute-ego_mean 0.3446639890075834 agent_compute-ego_median 0.344827934106191 agent_compute-ego_min 0.34309169586668625 deviation-center-line_max 1.3019541099294043 deviation-center-line_mean 0.8511498118650721 deviation-center-line_min 0.5066981329943391 deviation-heading_max 4.055717681436225 deviation-heading_mean 2.2639447928188265 deviation-heading_median 2.4218493396621237 deviation-heading_min 1.055344347110816 driven_any_max 0.8769654767822298 driven_any_mean 0.6687654736799274 driven_any_median 0.8769654767821278 driven_any_min 0.2619654676188363 driven_lanedir_consec_max 0.8747874033840302 driven_lanedir_consec_mean 0.6098641630266942 driven_lanedir_consec_min 0.25444128804097765 driven_lanedir_max 0.8747874033840302 driven_lanedir_mean 0.6098641630266942 driven_lanedir_median 0.6642436660663087 driven_lanedir_min 0.25444128804097765 in-drivable-lane_max 2.900000000000041 in-drivable-lane_mean 0.5800000000000083 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8769654767821669, "sim_physics": 0.052807665665944414, "survival_time": 14.950000000000076, "driven_lanedir": 0.6642436660663087, "sim_render-ego": 0.03652409315109253, "in-drivable-lane": 2.900000000000041, "agent_compute-ego": 0.344238596757253, "deviation-heading": 2.6581344254089676, "set_robot_commands": 0.05516312837600708, "deviation-center-line": 0.6127901567591342, "driven_lanedir_consec": 0.6642436660663087, "sim_compute_sim_state": 0.024441742102305097, "sim_compute_performance-ego": 0.040415841738382974, "sim_compute_robot_state-ego": 0.04190034071604411}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8769654767822298, "sim_physics": 0.05659368832906087, "survival_time": 14.950000000000076, "driven_lanedir": 0.8261690326522699, "sim_render-ego": 0.03615845521291097, "in-drivable-lane": 0, "agent_compute-ego": 0.34523502349853513, "deviation-heading": 4.055717681436225, "set_robot_commands": 0.054639139970143635, "deviation-center-line": 1.281715573033011, "driven_lanedir_consec": 0.8261690326522699, "sim_compute_sim_state": 0.02449143091837565, "sim_compute_performance-ego": 0.04036012729008993, "sim_compute_robot_state-ego": 0.0423115332921346}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2619654676188363, "sim_physics": 0.053960906698348673, "survival_time": 4.699999999999991, "driven_lanedir": 0.25444128804097765, "sim_render-ego": 0.035671130139777, "in-drivable-lane": 0, "agent_compute-ego": 0.34309169586668625, "deviation-heading": 1.128678170475998, "set_robot_commands": 0.05411280723328286, "deviation-center-line": 0.5066981329943391, "driven_lanedir_consec": 0.25444128804097765, "sim_compute_sim_state": 0.02481598549700798, "sim_compute_performance-ego": 0.04031048429773209, "sim_compute_robot_state-ego": 0.04205345346572551}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4509654704342765, "sim_physics": 0.057842215155340305, "survival_time": 7.84999999999998, "driven_lanedir": 0.4296794249898848, "sim_render-ego": 0.036158458442445016, "in-drivable-lane": 0, "agent_compute-ego": 0.34592669480925153, "deviation-heading": 2.4218493396621237, "set_robot_commands": 0.05404067191348714, "deviation-center-line": 0.5525910866094718, "driven_lanedir_consec": 0.4296794249898848, "sim_compute_sim_state": 0.02435627560706655, "sim_compute_performance-ego": 0.04010236187345663, "sim_compute_robot_state-ego": 0.041986000765660766}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8769654767821278, "sim_physics": 0.056208542982737225, "survival_time": 14.950000000000076, "driven_lanedir": 0.8747874033840302, "sim_render-ego": 0.03708347558975219, "in-drivable-lane": 0, "agent_compute-ego": 0.344827934106191, "deviation-heading": 1.055344347110816, "set_robot_commands": 0.05488852103551229, "deviation-center-line": 1.3019541099294043, "driven_lanedir_consec": 0.8747874033840302, "sim_compute_sim_state": 0.02433090368906657, "sim_compute_performance-ego": 0.03979408502578735, "sim_compute_robot_state-ego": 0.04183960596720378}}set_robot_commands_max 0.05516312837600708 set_robot_commands_mean 0.05456885370568661 set_robot_commands_median 0.054639139970143635 set_robot_commands_min 0.05404067191348714 sim_compute_performance-ego_max 0.040415841738382974 sim_compute_performance-ego_mean 0.04019658004508979 sim_compute_performance-ego_median 0.04031048429773209 sim_compute_performance-ego_min 0.03979408502578735 sim_compute_robot_state-ego_max 0.0423115332921346 sim_compute_robot_state-ego_mean 0.04201818684135374 sim_compute_robot_state-ego_median 0.041986000765660766 sim_compute_robot_state-ego_min 0.04183960596720378 sim_compute_sim_state_max 0.02481598549700798 sim_compute_sim_state_mean 0.024487267562764366 sim_compute_sim_state_median 0.024441742102305097 sim_compute_sim_state_min 0.02433090368906657 sim_physics_max 0.057842215155340305 sim_physics_mean 0.0554826037662863 sim_physics_median 0.056208542982737225 sim_physics_min 0.052807665665944414 sim_render-ego_max 0.03708347558975219 sim_render-ego_mean 0.03631912250719554 sim_render-ego_median 0.036158458442445016 sim_render-ego_min 0.035671130139777 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 11.48000000000004 survival_time_min 4.699999999999991
No reset possible 23360
3610
Riza Velioglu  🇩🇪aido2-LFV-sim-validation
step1-simulation error yes ip-172-31-40-253-12257
2019-05-19 11:55:12+00:00 2019-05-19 12:01:04+00:00 0:05:52 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 23329
3597
Victor Adolfo Romero Cano  🇨🇴aido2-LFV-sim-testing
step1-simulation success yes ip-172-31-40-253-12257
2019-05-18 16:27:56+00:00 2019-05-18 16:45:13+00:00 0:17:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.47061816984274774 survival_time_median 2.4499999999999993 deviation-center-line_median 0.09047885846140293 in-drivable-lane_median 0.7999999999999974
other stats agent_compute-ego_max 0.1618283305849348 agent_compute-ego_mean 0.12486637783641698 agent_compute-ego_median 0.12490508556365967 agent_compute-ego_min 0.08946564323023747 deviation-center-line_max 0.1743913456502906 deviation-center-line_mean 0.11122054568266285 deviation-center-line_min 0.05649185041622204 deviation-heading_max 0.8583234710357402 deviation-heading_mean 0.371509805944231 deviation-heading_median 0.3477435217829391 deviation-heading_min 0.1892537419842091 driven_any_max 1.6169932854589035 driven_any_mean 0.8549136794030617 driven_any_median 0.9441796518284096 driven_any_min 0.28668385087664994 driven_lanedir_consec_max 1.2433038249708377 driven_lanedir_consec_mean 0.5622432991481365 driven_lanedir_consec_min 0.24216121529728207 driven_lanedir_max 1.2433038249708377 driven_lanedir_mean 0.5622432991481365 driven_lanedir_median 0.47061816984274774 driven_lanedir_min 0.24216121529728207 in-drivable-lane_max 1.3499999999999996 in-drivable-lane_mean 0.5899999999999992 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.16898857664178918, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06683026861261439, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1587619251675076, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.0993255023603086, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03867422651361536, "sim_compute_performance-ego": 0.07097240730568215, "sim_compute_robot_state-ego": 0.08232001022056297, "sim_compute_robot_state-npc0": 0.07097821323959916, "sim_compute_robot_state-npc1": 0.07143006059858534, "sim_compute_robot_state-npc2": 0.07100057601928711, "sim_compute_robot_state-npc3": 0.06876463801772506}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.1779242992401123, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.061504392623901366, "in-drivable-lane": 0, "agent_compute-ego": 0.15223077774047852, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.09543315887451172, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.040556106567382816, "sim_compute_performance-ego": 0.07041787147521973, "sim_compute_robot_state-ego": 0.0786213207244873, "sim_compute_robot_state-npc0": 0.07141194343566895, "sim_compute_robot_state-npc1": 0.07022178649902344, "sim_compute_robot_state-npc2": 0.0687658977508545, "sim_compute_robot_state-npc3": 0.06762411117553711}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.1755074231248153, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.06056161930686549, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.15126670975434153, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.09696475455635473, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.0395835700787996, "sim_compute_performance-ego": 0.07104597593608655, "sim_compute_robot_state-ego": 0.07442730351498253, "sim_compute_robot_state-npc0": 0.06867666934665881, "sim_compute_robot_state-npc1": 0.07315662660096821, "sim_compute_robot_state-npc2": 0.07172540614479467, "sim_compute_robot_state-npc3": 0.07204227698476691}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.18156606336183187, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.06280154819729962, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.15618388562262814, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.09820696975611432, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.04052547261684756, "sim_compute_performance-ego": 0.06904676292516009, "sim_compute_robot_state-ego": 0.0755108247829389, "sim_compute_robot_state-npc0": 0.07112889048419421, "sim_compute_robot_state-npc1": 0.06768152080004729, "sim_compute_robot_state-npc2": 0.07107075860228719, "sim_compute_robot_state-npc3": 0.07126037983954707}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.17801955768040248, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06673381158283778, "in-drivable-lane": 0, "agent_compute-ego": 0.1618283305849348, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.1015308243887765, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.04002366747174944, "sim_compute_performance-ego": 0.07286953926086426, "sim_compute_robot_state-ego": 0.07691034248897008, "sim_compute_robot_state-npc0": 0.07170403855187553, "sim_compute_robot_state-npc1": 0.07107428993497576, "sim_compute_robot_state-npc2": 0.06754174402781896, "sim_compute_robot_state-npc3": 0.07069930008479527}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.139130433400472, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.05098526566116898, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.1288352056785866, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.07570576226269757, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.03220364341029414, "sim_compute_performance-ego": 0.05626611797897904, "sim_compute_robot_state-ego": 0.06246420189186379, "sim_compute_robot_state-npc0": 0.058383826856259945, "sim_compute_robot_state-npc1": 0.05760075427867748, "sim_compute_robot_state-npc2": 0.05807882768136484, "sim_compute_robot_state-npc3": 0.05720168572885019}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.11713094181484646, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.04735173560954906, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.12586028046078152, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.07605825530158149, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.029604801425227412, "sim_compute_performance-ego": 0.05213023556603326, "sim_compute_robot_state-ego": 0.05595969712292707, "sim_compute_robot_state-npc0": 0.05501566551349781, "sim_compute_robot_state-npc1": 0.05437892454641837, "sim_compute_robot_state-npc2": 0.054017455489547166, "sim_compute_robot_state-npc3": 0.05379021609271014}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.14458205964830187, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.05636053615146213, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.11391476525200736, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.06934172842237685, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.028899611367119684, "sim_compute_performance-ego": 0.05078292952643501, "sim_compute_robot_state-ego": 0.05517738660176595, "sim_compute_robot_state-npc0": 0.05267291069030762, "sim_compute_robot_state-npc1": 0.05162434577941895, "sim_compute_robot_state-npc2": 0.05288161701626248, "sim_compute_robot_state-npc3": 0.0511983765496148}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.11973430281100066, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.046415909476902176, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.1177967994109444, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.07220072331635849, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.030188135478807533, "sim_compute_performance-ego": 0.053283038346663765, "sim_compute_robot_state-ego": 0.05615060744078263, "sim_compute_robot_state-npc0": 0.05343281186145285, "sim_compute_robot_state-npc1": 0.05300781519516655, "sim_compute_robot_state-npc2": 0.052563320035519806, "sim_compute_robot_state-npc3": 0.05251051032024881}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.14324655055999755, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.04865300178527832, "in-drivable-lane": 0, "agent_compute-ego": 0.12490508556365967, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.07406127452850342, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.031152448654174804, "sim_compute_performance-ego": 0.05672450065612793, "sim_compute_robot_state-ego": 0.057843565940856934, "sim_compute_robot_state-npc0": 0.05863194942474365, "sim_compute_robot_state-npc1": 0.054951953887939456, "sim_compute_robot_state-npc2": 0.056034913063049314, "sim_compute_robot_state-npc3": 0.05667174339294433}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.13729169368743896, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.047216367721557614, "in-drivable-lane": 0, "agent_compute-ego": 0.11992512941360474, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.07246395349502563, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.027284622192382812, "sim_compute_performance-ego": 0.05510591268539429, "sim_compute_robot_state-ego": 0.05663390159606933, "sim_compute_robot_state-npc0": 0.057556116580963136, "sim_compute_robot_state-npc1": 0.04994069337844849, "sim_compute_robot_state-npc2": 0.04885971546173096, "sim_compute_robot_state-npc3": 0.04878963232040405}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.08864547076978181, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.03588430505049856, "in-drivable-lane": 0, "agent_compute-ego": 0.08946564323023747, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.05729162065606368, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.023045025373760023, "sim_compute_performance-ego": 0.040552691409462376, "sim_compute_robot_state-ego": 0.04239591799284283, "sim_compute_robot_state-npc0": 0.04114213742707905, "sim_compute_robot_state-npc1": 0.04090109624360737, "sim_compute_robot_state-npc2": 0.039836456901148745, "sim_compute_robot_state-npc3": 0.03982100988689222}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.08549656867980956, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.036006898880004884, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.09072487354278563, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.05557034969329834, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.0232039213180542, "sim_compute_performance-ego": 0.0398978328704834, "sim_compute_robot_state-ego": 0.04185327053070068, "sim_compute_robot_state-npc0": 0.04143343448638916, "sim_compute_robot_state-npc1": 0.040410637855529785, "sim_compute_robot_state-npc2": 0.040426931381225585, "sim_compute_robot_state-npc3": 0.04028162002563476}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.10592057488181374, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.036694570021195846, "in-drivable-lane": 0, "agent_compute-ego": 0.08997488021850586, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.054913206533952194, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.02277781746604226, "sim_compute_performance-ego": 0.03986619819294323, "sim_compute_robot_state-ego": 0.04160464893687855, "sim_compute_robot_state-npc0": 0.04118304902857, "sim_compute_robot_state-npc1": 0.040000200271606445, "sim_compute_robot_state-npc2": 0.040329575538635254, "sim_compute_robot_state-npc3": 0.039748462763699616}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.10440803060726243, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.0370489383230404, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.09132137590525102, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.05634116153327786, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.02295592366432657, "sim_compute_performance-ego": 0.03927303820240254, "sim_compute_robot_state-ego": 0.042010881462875675, "sim_compute_robot_state-npc0": 0.041423821935848315, "sim_compute_robot_state-npc1": 0.04075269309841857, "sim_compute_robot_state-npc2": 0.04076684737692074, "sim_compute_robot_state-npc3": 0.04032018719887247}}set_robot_commands_max 0.1015308243887765 set_robot_commands_mean 0.07702728304528009 set_robot_commands_median 0.07406127452850342 set_robot_commands_min 0.054913206533952194 sim_compute_performance-ego_max 0.07286953926086426 sim_compute_performance-ego_mean 0.05588233682252918 sim_compute_performance-ego_median 0.05510591268539429 sim_compute_performance-ego_min 0.03927303820240254 sim_compute_robot_state-ego_max 0.08232001022056297 sim_compute_robot_state-ego_mean 0.059992258749967005 sim_compute_robot_state-ego_median 0.05663390159606933 sim_compute_robot_state-ego_min 0.04160464893687855 sim_compute_robot_state-npc0_max 0.07170403855187553 sim_compute_robot_state-npc0_mean 0.05698503192420722 sim_compute_robot_state-npc0_median 0.057556116580963136 sim_compute_robot_state-npc0_min 0.04114213742707905 sim_compute_robot_state-npc1_max 0.07315662660096821 sim_compute_robot_state-npc1_mean 0.05580889326458877 sim_compute_robot_state-npc1_median 0.05437892454641837 sim_compute_robot_state-npc1_min 0.040000200271606445 sim_compute_robot_state-npc2_max 0.07172540614479467 sim_compute_robot_state-npc2_mean 0.055593336166029815 sim_compute_robot_state-npc2_median 0.054017455489547166 sim_compute_robot_state-npc2_min 0.039836456901148745 sim_compute_robot_state-npc3_max 0.07204227698476691 sim_compute_robot_state-npc3_mean 0.05538161002548283 sim_compute_robot_state-npc3_median 0.05379021609271014 sim_compute_robot_state-npc3_min 0.039748462763699616 sim_compute_sim_state_max 0.040556106567382816 sim_compute_sim_state_mean 0.03137859957323895 sim_compute_sim_state_median 0.030188135478807533 sim_compute_sim_state_min 0.02277781746604226 sim_physics_max 0.18156606336183187 sim_physics_mean 0.13783950312731175 sim_physics_median 0.139130433400472 sim_physics_min 0.08549656867980956 sim_render-ego_max 0.06683026861261439 sim_render-ego_mean 0.0507366112669451 sim_render-ego_median 0.04865300178527832 sim_render-ego_min 0.03588430505049856 simulation-passed 1 survival_time_max 3.949999999999994 survival_time_mean 2.2366666666666655 survival_time_min 0.9500000000000004
No reset possible 23286
2894
Peter Almasi  ðŸ‡ðŸ‡ºBaseline solution using reinforcement learning aido2-LF-sim-validation
step1-simulation error yes ip-172-31-40-253-12257
2019-05-17 20:50:00+00:00 2019-05-17 21:00:43+00:00 0:10:43 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 23215
3577
Nicky Eichmann Baseline solution using reinforcement learning aido2-LF-sim-validation
step1-simulation success yes ip-172-31-40-253-12257
2019-05-17 17:35:36+00:00 2019-05-17 17:50:05+00:00 0:14:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.06255295319332932 survival_time_median 14.950000000000076 deviation-center-line_median 0.31093684032301805 in-drivable-lane_median 7.9000000000000945
other stats agent_compute-ego_max 0.10094804684321086 agent_compute-ego_mean 0.10057911030451457 agent_compute-ego_median 0.10055952072143556 agent_compute-ego_min 0.1002022631963094 deviation-center-line_max 1.1288482486575042 deviation-center-line_mean 0.46917583208746266 deviation-center-line_min 0.1532346013858943 deviation-heading_max 5.756062842065952 deviation-heading_mean 3.988972711779198 deviation-heading_median 3.5191948580378356 deviation-heading_min 2.8499982447518546 driven_any_max 0.9856040444839966 driven_any_mean 0.36658694594808566 driven_any_median 0.18587225179110448 driven_any_min 5.6912714890136e-14 driven_lanedir_consec_max 0.43404164996116495 driven_lanedir_consec_mean 0.13308854478705195 driven_lanedir_consec_min 0 driven_lanedir_max 0.46473795283828107 driven_lanedir_mean 0.1392278053624752 driven_lanedir_median 0.06255295319332932 driven_lanedir_min 0 in-drivable-lane_max 11.60000000000008 in-drivable-lane_mean 8.230000000000057 in-drivable-lane_min 5.199999999999991 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 5.962588178812573e-14, "sim_physics": 0.05457769791285197, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.03714451471964518, "in-drivable-lane": 7.9000000000000945, "agent_compute-ego": 0.10094804684321086, "deviation-heading": 3.3838262878563494, "set_robot_commands": 0.05588390827178955, "deviation-center-line": 0.543168749563224, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.02361409584681193, "sim_compute_performance-ego": 0.040052921772003175, "sim_compute_robot_state-ego": 0.042365406354268394}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9856040444839966, "sim_physics": 0.05291489362716675, "survival_time": 14.950000000000076, "driven_lanedir": 0.46473795283828107, "sim_render-ego": 0.036406403382619225, "in-drivable-lane": 9.40000000000007, "agent_compute-ego": 0.10036077340443927, "deviation-heading": 3.5191948580378356, "set_robot_commands": 0.05614888032277425, "deviation-center-line": 0.1532346013858943, "driven_lanedir_consec": 0.43404164996116495, "sim_compute_sim_state": 0.02411991039911906, "sim_compute_performance-ego": 0.0399307918548584, "sim_compute_robot_state-ego": 0.04215523560841878}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6614584334652108, "sim_physics": 0.05208930810292562, "survival_time": 14.950000000000076, "driven_lanedir": 0.06255295319332932, "sim_render-ego": 0.03600008010864258, "in-drivable-lane": 5.199999999999991, "agent_compute-ego": 0.1002022631963094, "deviation-heading": 4.435781326184003, "set_robot_commands": 0.05620878060658773, "deviation-center-line": 1.1288482486575042, "driven_lanedir_consec": 0.06255295319332932, "sim_compute_sim_state": 0.02354205052057902, "sim_compute_performance-ego": 0.04002849340438843, "sim_compute_robot_state-ego": 0.04155601501464844}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 5.6912714890136e-14, "sim_physics": 0.05579612890879313, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.036440374056498206, "in-drivable-lane": 11.60000000000008, "agent_compute-ego": 0.10082494735717772, "deviation-heading": 2.8499982447518546, "set_robot_commands": 0.05578877607981364, "deviation-center-line": 0.20969072050767243, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.023747427463531492, "sim_compute_performance-ego": 0.0398914114634196, "sim_compute_robot_state-ego": 0.042379779815673826}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.18587225179110448, "sim_physics": 0.05439898490905762, "survival_time": 14.950000000000076, "driven_lanedir": 0.1688481207807655, "sim_render-ego": 0.03634020407994589, "in-drivable-lane": 7.050000000000046, "agent_compute-ego": 0.10055952072143556, "deviation-heading": 5.756062842065952, "set_robot_commands": 0.05643343210220337, "deviation-center-line": 0.31093684032301805, "driven_lanedir_consec": 0.1688481207807655, "sim_compute_sim_state": 0.023831377824147543, "sim_compute_performance-ego": 0.03989755233128866, "sim_compute_robot_state-ego": 0.04194334904352824}}set_robot_commands_max 0.05643343210220337 set_robot_commands_mean 0.05609275547663371 set_robot_commands_median 0.05614888032277425 set_robot_commands_min 0.05578877607981364 sim_compute_performance-ego_max 0.040052921772003175 sim_compute_performance-ego_mean 0.039960234165191656 sim_compute_performance-ego_median 0.0399307918548584 sim_compute_performance-ego_min 0.0398914114634196 sim_compute_robot_state-ego_max 0.042379779815673826 sim_compute_robot_state-ego_mean 0.04207995716730754 sim_compute_robot_state-ego_median 0.04215523560841878 sim_compute_robot_state-ego_min 0.04155601501464844 sim_compute_sim_state_max 0.02411991039911906 sim_compute_sim_state_mean 0.02377097241083781 sim_compute_sim_state_median 0.023747427463531492 sim_compute_sim_state_min 0.02354205052057902 sim_physics_max 0.05579612890879313 sim_physics_mean 0.05395540269215902 sim_physics_median 0.05439898490905762 sim_physics_min 0.05208930810292562 sim_render-ego_max 0.03714451471964518 sim_render-ego_mean 0.036466315269470216 sim_render-ego_median 0.036406403382619225 sim_render-ego_min 0.03600008010864258 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 23172
3569
Bhairav Mehta challenge-aido_LF-template-pytorch aido2-LF-sim-testing
step1-simulation error yes ip-172-31-40-253-12257
2019-05-17 16:31:39+00:00 2019-05-17 16:33:27+00:00 0:01:48 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 23163
3564
Bhairav Mehta Baseline solution using reinforcement learning aido2-LFV-sim-validation
step1-simulation error yes ip-172-31-40-253-12257
2019-05-17 16:13:21+00:00 2019-05-17 16:15:01+00:00 0:01:40 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible