Evaluator 1587

ID	1587
evaluator	`ip-172-31-43-40-10496`
owner	I don't have one 😀
machine	ip-172-31-43-40
process	ip-172-31-43-40-10496
version	d-c:5.0.7;d-c-r:5.0.10;d-s:5.0.3
first heard	2019-10-17 02:44:11+00:00
last heard	2019-11-08 10:54:06+00:00
status	inactive
# evaluating
# success	31 `24347`
# timeout
# failed	3 `24355`
# error	8 `24383`
# aborted
# host-error	3 `24669`
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job ID

submission

user

user label

challenge

step

status

up to date

evaluator

date started

date completed

duration

message

25126

4390

Jeick Hincapie Barrera 🇨🇴

challenge-aido_LF-template-ros - Template solution using ROS

aido3-LF-sim-testing

step1-simulation

success

ip-172-31-43-40-10496

2019-11-07 14:24:19+00:00

2019-11-07 14:35:11+00:00

0:10:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4126113388371666
survival_time_median	2.6999999999999984
deviation-center-line_median	0.1187177598523136
in-drivable-lane_median	0.9499999999999976

other stats

agent_compute-ego_max	0.02392701699700154
agent_compute-ego_mean	0.02094319663833413
agent_compute-ego_median	0.020702686065282576
agent_compute-ego_min	0.01765284171471229
deviation-center-line_max	0.2616199012603187
deviation-center-line_mean	0.12663752615997417
deviation-center-line_min	0.07143676193760398
deviation-heading_max	1.4563581054906
deviation-heading_mean	0.5551840294909584
deviation-heading_median	0.55940705176748
deviation-heading_min	0.2596285487829773
driven_any_max	1.6839250134630204
driven_any_mean	0.7327294413370019
driven_any_median	0.7309130538792374
driven_any_min	0.2364518949491652
driven_lanedir_consec_max	0.9416535020294268
driven_lanedir_consec_mean	0.4469104002974222
driven_lanedir_consec_min	0.2221238695940002
driven_lanedir_max	0.9416535020294268
driven_lanedir_mean	0.4469104002974222
driven_lanedir_median	0.4126113388371666
driven_lanedir_min	0.2221238695940002
in-drivable-lane_max	2.1499999999999924
in-drivable-lane_mean	0.8233333333333307
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9226822529128632, "sim_physics": 0.10950900803149588, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.012158437513969314, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.02392701699700154, "deviation-heading": 0.2596285487829773, "set_robot_commands": 0.009416271263444928, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.004730110437097684, "sim_compute_performance-ego": 0.007243233667293065, "sim_compute_robot_state-ego": 0.008804411955282723}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811183, "sim_physics": 0.09228449662526449, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572033, "sim_render-ego": 0.011946630477905274, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.022052923838297527, "deviation-heading": 0.5809378480871985, "set_robot_commands": 0.008568207422892252, "deviation-center-line": 0.11667593935453972, "driven_lanedir_consec": 0.6632135184572033, "sim_compute_sim_state": 0.004366183280944824, "sim_compute_performance-ego": 0.006573939323425293, "sim_compute_robot_state-ego": 0.0082893967628479}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.10732768882404674, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.010703281922773882, "in-drivable-lane": 0, "agent_compute-ego": 0.023545037616382943, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.008830915797840466, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.005156191912564364, "sim_compute_performance-ego": 0.006501479582353072, "sim_compute_robot_state-ego": 0.009091279723427511}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.1011918733517329, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.01605065663655599, "in-drivable-lane": 0, "agent_compute-ego": 0.02302669982115428, "deviation-heading": 0.568524016017798, "set_robot_commands": 0.00915093719959259, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.005079209804534912, "sim_compute_performance-ego": 0.0072977592547734576, "sim_compute_robot_state-ego": 0.008144030968348185}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6091462024047467, "sim_physics": 0.10135189346645188, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.011481761932373049, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.021843423014101776, "deviation-heading": 0.33908617460335944, "set_robot_commands": 0.008694669474726137, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.004753584447114364, "sim_compute_performance-ego": 0.006643595902816109, "sim_compute_robot_state-ego": 0.009277457776276962}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.3217723172279551, "sim_physics": 0.1248141924540202, "survival_time": 1.2000000000000004, "driven_lanedir": 0.259671941523266, "sim_render-ego": 0.013924707969029743, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.02389570077260335, "deviation-heading": 0.55940705176748, "set_robot_commands": 0.010790934165318808, "deviation-center-line": 0.07983398841276981, "driven_lanedir_consec": 0.259671941523266, "sim_compute_sim_state": 0.005197455485661824, "sim_compute_performance-ego": 0.007401337226231893, "sim_compute_robot_state-ego": 0.009477843840916952}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9218874635466092, "sim_physics": 0.0926574040681888, "survival_time": 3.899999999999994, "driven_lanedir": 0.5450627289344152, "sim_render-ego": 0.01096042302938608, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.020702686065282576, "deviation-heading": 0.6586708623908945, "set_robot_commands": 0.008091617853213579, "deviation-center-line": 0.13114121213460145, "driven_lanedir_consec": 0.5450627289344152, "sim_compute_sim_state": 0.004548543538802709, "sim_compute_performance-ego": 0.006673947358742738, "sim_compute_robot_state-ego": 0.007990736227769118}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.8035998912048737, "sim_physics": 0.09321191481181554, "survival_time": 2.799999999999998, "driven_lanedir": 0.4126113388371666, "sim_render-ego": 0.010376508746828352, "in-drivable-lane": 0.9999999999999972, "agent_compute-ego": 0.02187374234199524, "deviation-heading": 0.6465417997696937, "set_robot_commands": 0.007347656147820609, "deviation-center-line": 0.119844131874105, "driven_lanedir_consec": 0.4126113388371666, "sim_compute_sim_state": 0.004135417086737496, "sim_compute_performance-ego": 0.005737351519720895, "sim_compute_robot_state-ego": 0.007214482341493879}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0820250408860437, "sim_physics": 0.08608759408709647, "survival_time": 4.3499999999999925, "driven_lanedir": 0.4507633352947824, "sim_render-ego": 0.012008623145092491, "in-drivable-lane": 2.1499999999999924, "agent_compute-ego": 0.01975320947581324, "deviation-heading": 0.613751936282656, "set_robot_commands": 0.007523953229531475, "deviation-center-line": 0.1187177598523136, "driven_lanedir_consec": 0.4507633352947824, "sim_compute_sim_state": 0.003973623801921976, "sim_compute_performance-ego": 0.005639517444303666, "sim_compute_robot_state-ego": 0.007302166401654824}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.6839250134630204, "sim_physics": 0.07593155123970725, "survival_time": 5.4999999999999885, "driven_lanedir": 0.9416535020294268, "sim_render-ego": 0.00925545258955522, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.01874920454892245, "deviation-heading": 1.4563581054906, "set_robot_commands": 0.0067606362429532135, "deviation-center-line": 0.2616199012603187, "driven_lanedir_consec": 0.9416535020294268, "sim_compute_sim_state": 0.003808481043035334, "sim_compute_performance-ego": 0.005240579084916548, "sim_compute_robot_state-ego": 0.006712371652776545}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.26677752846248903, "sim_physics": 0.09532442688941956, "survival_time": 1.2000000000000004, "driven_lanedir": 0.25235480657068055, "sim_render-ego": 0.009576360384623207, "in-drivable-lane": 0, "agent_compute-ego": 0.01893309752146403, "deviation-heading": 0.2735028974766809, "set_robot_commands": 0.007069547971089681, "deviation-center-line": 0.10630271043038582, "driven_lanedir_consec": 0.25235480657068055, "sim_compute_sim_state": 0.0038805007934570312, "sim_compute_performance-ego": 0.005458901325861613, "sim_compute_robot_state-ego": 0.00696532924969991}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0389325864387629, "sim_physics": 0.0900327137538365, "survival_time": 3.8499999999999943, "driven_lanedir": 0.4755729783153157, "sim_render-ego": 0.010212854905561968, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.02011965157149674, "deviation-heading": 0.5216992361385433, "set_robot_commands": 0.007779756149688325, "deviation-center-line": 0.10517150645857888, "driven_lanedir_consec": 0.4755729783153157, "sim_compute_sim_state": 0.0041816946748015164, "sim_compute_performance-ego": 0.0057152339390345985, "sim_compute_robot_state-ego": 0.007208768423501547}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.6835794874956865, "sim_physics": 0.08627768516540528, "survival_time": 2.499999999999999, "driven_lanedir": 0.6100305079584653, "sim_render-ego": 0.010601806640625, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.02009779453277588, "deviation-heading": 0.4739455376152245, "set_robot_commands": 0.00860964298248291, "deviation-center-line": 0.12143860235134882, "driven_lanedir_consec": 0.6100305079584653, "sim_compute_sim_state": 0.004141845703125, "sim_compute_performance-ego": 0.005857129096984864, "sim_compute_robot_state-ego": 0.00748471736907959}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.29517411990766207, "sim_physics": 0.06744499389941876, "survival_time": 1.3000000000000005, "driven_lanedir": 0.25251967754950355, "sim_render-ego": 0.00814513059762808, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.01765284171471229, "deviation-heading": 0.466101326638835, "set_robot_commands": 0.006746686421907865, "deviation-center-line": 0.07143676193760398, "driven_lanedir_consec": 0.25251967754950355, "sim_compute_sim_state": 0.003307003241318923, "sim_compute_performance-ego": 0.004549980163574219, "sim_compute_robot_state-ego": 0.005804914694565993}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.7309130538792374, "sim_physics": 0.06968027132528799, "survival_time": 2.6999999999999984, "driven_lanedir": 0.38087957155028906, "sim_render-ego": 0.007734325197007921, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.017974919743008085, "deviation-heading": 0.5607794956477159, "set_robot_commands": 0.00577039188808865, "deviation-center-line": 0.12406277512673572, "driven_lanedir_consec": 0.38087957155028906, "sim_compute_sim_state": 0.0031169741242020217, "sim_compute_performance-ego": 0.0042470031314426, "sim_compute_robot_state-ego": 0.005514546676918313}}
set_robot_commands_max	0.010790934165318808
set_robot_commands_mean	0.0080767882807061
set_robot_commands_median	0.008091617853213579
set_robot_commands_min	0.00577039188808865
sim_compute_performance-ego_max	0.007401337226231893
sim_compute_performance-ego_mean	0.00605206586809831
sim_compute_performance-ego_median	0.005857129096984864
sim_compute_performance-ego_min	0.0042470031314426
sim_compute_robot_state-ego_max	0.009477843840916952
sim_compute_robot_state-ego_mean	0.00768549693763733
sim_compute_robot_state-ego_median	0.00748471736907959
sim_compute_robot_state-ego_min	0.005514546676918313
sim_compute_sim_state_max	0.005197455485661824
sim_compute_sim_state_mean	0.004291787958354666
sim_compute_sim_state_median	0.0041816946748015164
sim_compute_sim_state_min	0.0031169741242020217
sim_physics_max	0.1248141924540202
sim_physics_mean	0.0928751805328792
sim_physics_median	0.0926574040681888
sim_physics_min	0.06744499389941876
sim_render-ego_max	0.01605065663655599
sim_render-ego_mean	0.01100913077926104
sim_render-ego_median	0.010703281922773882
sim_render-ego_min	0.007734325197007921
simulation-passed	1
survival_time_max	5.4999999999999885
survival_time_mean	2.7766666666666637
survival_time_min	1.1000000000000003

No reset possible

25096

4384

Soroush Saryazdi 🇨🇦

bluejay

aido3-LFVI-sim-testing

step1-simulation

failed

ip-172-31-43-40-10496

2019-11-06 18:39:25+00:00

2019-11-06 18:46:36+00:00

0:07:11

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 239, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 258 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

25092

4377

Frank (Chude) Qian 🇨🇦

Frank Raw Test 2

aido3-LF-sim-validation

step1-simulation

success

ip-172-31-43-40-10496

2019-11-05 23:24:34+00:00

2019-11-05 23:30:40+00:00

0:06:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.1709640147848583
survival_time_median	3.999999999999994
deviation-center-line_median	0.1859932462995856
in-drivable-lane_median	0.8999999999999968

other stats

agent_compute-ego_max	0.018120059427225364
agent_compute-ego_mean	0.01694328525889708
agent_compute-ego_median	0.01669488549232483
agent_compute-ego_min	0.016511534199570164
deviation-center-line_max	0.31181508046527334
deviation-center-line_mean	0.17762908509167258
deviation-center-line_min	0.08137300247960842
deviation-heading_max	1.3353596262317915
deviation-heading_mean	0.6864909622497788
deviation-heading_median	0.5613939132498948
deviation-heading_min	0.37127926441482945
driven_any_max	3.722949222689754
driven_any_mean	1.7234310870864789
driven_any_median	1.6392509733250715
driven_any_min	0.576520943255548
driven_lanedir_consec_max	1.470298739003999
driven_lanedir_consec_mean	1.019298163346765
driven_lanedir_consec_min	0.5529439304889687
driven_lanedir_max	1.470298739003999
driven_lanedir_mean	1.019298163346765
driven_lanedir_median	1.1709640147848583
driven_lanedir_min	0.5529439304889687
in-drivable-lane_max	5.149999999999985
in-drivable-lane_mean	1.5399999999999952
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0361236542659042, "sim_physics": 0.05796710950023723, "survival_time": 2.6499999999999986, "driven_lanedir": 0.6584244381104569, "sim_render-ego": 0.007390926469047114, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.018120059427225364, "deviation-heading": 0.5151555421115638, "set_robot_commands": 0.005230539249923994, "deviation-center-line": 0.09476802130462332, "driven_lanedir_consec": 0.6584244381104569, "sim_compute_sim_state": 0.0029800612971467794, "sim_compute_performance-ego": 0.004199248439860794, "sim_compute_robot_state-ego": 0.005278623329018647}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.576520943255548, "sim_physics": 0.0536148620374275, "survival_time": 1.6500000000000008, "driven_lanedir": 0.5529439304889687, "sim_render-ego": 0.0071262590812914296, "in-drivable-lane": 0, "agent_compute-ego": 0.016511534199570164, "deviation-heading": 0.37127926441482945, "set_robot_commands": 0.004884438081221147, "deviation-center-line": 0.08137300247960842, "driven_lanedir_consec": 0.5529439304889687, "sim_compute_sim_state": 0.0027203704371596828, "sim_compute_performance-ego": 0.003838105635209517, "sim_compute_robot_state-ego": 0.004967097080115116}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6423106418961173, "sim_physics": 0.05360351079775963, "survival_time": 4.049999999999994, "driven_lanedir": 1.2438596943455424, "sim_render-ego": 0.006982188165923695, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.01652364966310101, "deviation-heading": 0.5613939132498948, "set_robot_commands": 0.004940498022385585, "deviation-center-line": 0.21419607490927217, "driven_lanedir_consec": 1.2438596943455424, "sim_compute_sim_state": 0.002754876643051336, "sim_compute_performance-ego": 0.003885475205786434, "sim_compute_robot_state-ego": 0.0049809614817301435}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.722949222689754, "sim_physics": 0.052402888025556295, "survival_time": 9.099999999999994, "driven_lanedir": 1.470298739003999, "sim_render-ego": 0.006915985882937253, "in-drivable-lane": 5.149999999999985, "agent_compute-ego": 0.016866297512264043, "deviation-heading": 1.3353596262317915, "set_robot_commands": 0.0048957866626781425, "deviation-center-line": 0.31181508046527334, "driven_lanedir_consec": 1.470298739003999, "sim_compute_sim_state": 0.0027727163754976713, "sim_compute_performance-ego": 0.003880870211255419, "sim_compute_robot_state-ego": 0.004961831229073661}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6392509733250715, "sim_physics": 0.055606046319007875, "survival_time": 3.999999999999994, "driven_lanedir": 1.1709640147848583, "sim_render-ego": 0.006998905539512634, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.01669488549232483, "deviation-heading": 0.6492664652408144, "set_robot_commands": 0.004926899075508117, "deviation-center-line": 0.1859932462995856, "driven_lanedir_consec": 1.1709640147848583, "sim_compute_sim_state": 0.0028466850519180296, "sim_compute_performance-ego": 0.0038558483123779298, "sim_compute_robot_state-ego": 0.005007368326187134}}
set_robot_commands_max	0.005230539249923994
set_robot_commands_mean	0.004975632218343397
set_robot_commands_median	0.004926899075508117
set_robot_commands_min	0.004884438081221147
sim_compute_performance-ego_max	0.004199248439860794
sim_compute_performance-ego_mean	0.003931909560898019
sim_compute_performance-ego_median	0.003880870211255419
sim_compute_performance-ego_min	0.003838105635209517
sim_compute_robot_state-ego_max	0.005278623329018647
sim_compute_robot_state-ego_mean	0.00503917628922494
sim_compute_robot_state-ego_median	0.0049809614817301435
sim_compute_robot_state-ego_min	0.004961831229073661
sim_compute_sim_state_max	0.0029800612971467794
sim_compute_sim_state_mean	0.0028149419609547
sim_compute_sim_state_median	0.0027727163754976713
sim_compute_sim_state_min	0.0027203704371596828
sim_physics_max	0.05796710950023723
sim_physics_mean	0.0546388833359977
sim_physics_median	0.0536148620374275
sim_physics_min	0.052402888025556295
sim_render-ego_max	0.007390926469047114
sim_render-ego_mean	0.007082853027742425
sim_render-ego_median	0.006998905539512634
sim_render-ego_min	0.006915985882937253
simulation-passed	1
survival_time_max	9.099999999999994
survival_time_mean	4.2899999999999965
survival_time_min	1.6500000000000008

No reset possible

25076

4370

Jeick Hincapie Barrera 🇨🇴

challenge-aido_LF-template-tensorflow

aido3-LFVI-sim-testing

step1-simulation

success

ip-172-31-43-40-10496

2019-11-05 15:17:03+00:00

2019-11-05 15:29:45+00:00

0:12:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2351291624283538
survival_time_median	1.2500000000000004
deviation-center-line_median	0.0879475103344196
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.03373983383178711
agent_compute-ego_mean	0.021746997829035584
agent_compute-ego_median	0.017221747375116114
agent_compute-ego_min	0.016254242261250815
deviation-center-line_max	0.2600470512104084
deviation-center-line_mean	0.1137016045856334
deviation-center-line_min	0.04889546176338989
deviation-heading_max	1.424306929784743
deviation-heading_mean	0.6940816092424266
deviation-heading_median	0.5642499092588014
deviation-heading_min	0.34331776438900213
driven_any_max	0.7714636699675816
driven_any_mean	0.32125572052589674
driven_any_median	0.2839892271369937
driven_any_min	0.09373876838868528
driven_lanedir_consec_max	0.6608175977716635
driven_lanedir_consec_mean	0.25458045041146143
driven_lanedir_consec_min	0.049641023390875505
driven_lanedir_max	0.6608175977716635
driven_lanedir_mean	0.25458045041146143
driven_lanedir_median	0.2351291624283538
driven_lanedir_min	0.049641023390875505
in-drivable-lane_max	0.3500000000000003
in-drivable-lane_mean	0.046666666666666634
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.3288831720608748, "sim_physics": 0.2153901863098145, "survival_time": 1.2500000000000004, "driven_lanedir": 0.2870134955053114, "sim_render-ego": 0.012495765686035156, "in-drivable-lane": 0, "agent_compute-ego": 0.03373983383178711, "deviation-heading": 0.49667870034008094, "set_robot_commands": 0.011072874069213867, "deviation-center-line": 0.0879475103344196, "driven_lanedir_consec": 0.2870134955053114, "sim_compute_sim_state": 0.005107812881469727, "sim_compute_performance-ego": 0.007905511856079102, "sim_compute_robot_state-ego": 0.009889173507690427, "sim_compute_robot_state-npc0": 0.009300498962402344, "sim_compute_robot_state-npc1": 0.008974180221557618, "sim_compute_robot_state-npc2": 0.008468494415283204, "sim_compute_robot_state-npc3": 0.00910017967224121}, "udem1-1-0": {"driven_any": 0.3613401452203777, "sim_physics": 0.20857625116001477, "survival_time": 2.2, "driven_lanedir": 0.3162109666834678, "sim_render-ego": 0.012699696150693026, "in-drivable-lane": 0, "agent_compute-ego": 0.029046903957020153, "deviation-heading": 0.964404358645066, "set_robot_commands": 0.009590056809512052, "deviation-center-line": 0.16352152345973237, "driven_lanedir_consec": 0.3162109666834678, "sim_compute_sim_state": 0.004948215051130815, "sim_compute_performance-ego": 0.006621360778808594, "sim_compute_robot_state-ego": 0.009004170244390314, "sim_compute_robot_state-npc0": 0.00854337215423584, "sim_compute_robot_state-npc1": 0.008282179182226007, "sim_compute_robot_state-npc2": 0.008111769502813166, "sim_compute_robot_state-npc3": 0.008019951256838713}, "udem1-2-0": {"driven_any": 0.13890188032791753, "sim_physics": 0.3603522216572481, "survival_time": 0.8500000000000002, "driven_lanedir": 0.1030898492050385, "sim_render-ego": 0.01411132251515108, "in-drivable-lane": 0, "agent_compute-ego": 0.032443817924050725, "deviation-heading": 0.3633765408864972, "set_robot_commands": 0.010622501373291016, "deviation-center-line": 0.07653668691247884, "driven_lanedir_consec": 0.1030898492050385, "sim_compute_sim_state": 0.005372131572050207, "sim_compute_performance-ego": 0.007279760697308709, "sim_compute_robot_state-ego": 0.00934785955092486, "sim_compute_robot_state-npc0": 0.009664521497838635, "sim_compute_robot_state-npc1": 0.010200458414414347, "sim_compute_robot_state-npc2": 0.00985872044282801, "sim_compute_robot_state-npc3": 0.009053777245914234}, "udem1-3-0": {"driven_any": 0.17891676858199695, "sim_physics": 0.2020081480344137, "survival_time": 1.2000000000000004, "driven_lanedir": 0.14736157944939565, "sim_render-ego": 0.01148545742034912, "in-drivable-lane": 0, "agent_compute-ego": 0.026404698689778645, "deviation-heading": 0.5563263534461684, "set_robot_commands": 0.009165048599243164, "deviation-center-line": 0.11694342186272282, "driven_lanedir_consec": 0.14736157944939565, "sim_compute_sim_state": 0.004397332668304443, "sim_compute_performance-ego": 0.0062699417273203535, "sim_compute_robot_state-ego": 0.008560111125310263, "sim_compute_robot_state-npc0": 0.007301837205886841, "sim_compute_robot_state-npc1": 0.007244179646174113, "sim_compute_robot_state-npc2": 0.006694187720616658, "sim_compute_robot_state-npc3": 0.007325321435928345}, "udem1-4-0": {"driven_any": 0.2559605517993028, "sim_physics": 0.21167906761169433, "survival_time": 1.2500000000000004, "driven_lanedir": 0.2351291624283538, "sim_render-ego": 0.01270941734313965, "in-drivable-lane": 0, "agent_compute-ego": 0.029532108306884765, "deviation-heading": 0.4759572447942724, "set_robot_commands": 0.010174884796142578, "deviation-center-line": 0.08040651721303527, "driven_lanedir_consec": 0.2351291624283538, "sim_compute_sim_state": 0.004899673461914063, "sim_compute_performance-ego": 0.006995372772216797, "sim_compute_robot_state-ego": 0.008880395889282227, "sim_compute_robot_state-npc0": 0.008997278213500976, "sim_compute_robot_state-npc1": 0.008477554321289063, "sim_compute_robot_state-npc2": 0.008913135528564453, "sim_compute_robot_state-npc3": 0.008843870162963867}, "udem1-5-0": {"driven_any": 0.2990485284798407, "sim_physics": 0.14889884717536694, "survival_time": 1.6500000000000008, "driven_lanedir": 0.23509559136751212, "sim_render-ego": 0.0110848094477798, "in-drivable-lane": 0, "agent_compute-ego": 0.02323388330864184, "deviation-heading": 0.6721738917387489, "set_robot_commands": 0.006990692832253196, "deviation-center-line": 0.08891752074052757, "driven_lanedir_consec": 0.23509559136751212, "sim_compute_sim_state": 0.0041292941931522255, "sim_compute_performance-ego": 0.005821726538918235, "sim_compute_robot_state-ego": 0.007242043813069661, "sim_compute_robot_state-npc0": 0.006851745374274977, "sim_compute_robot_state-npc1": 0.0064037785385594225, "sim_compute_robot_state-npc2": 0.0071050542773622456, "sim_compute_robot_state-npc3": 0.007209965676972361}, "udem1-6-0": {"driven_any": 0.7293074847318531, "sim_physics": 0.1260596318031425, "survival_time": 3.349999999999996, "driven_lanedir": 0.6608175977716635, "sim_render-ego": 0.00712318918598232, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.01666925558403357, "deviation-heading": 1.0152628465613616, "set_robot_commands": 0.004829004629334407, "deviation-center-line": 0.2511378807183909, "driven_lanedir_consec": 0.6608175977716635, "sim_compute_sim_state": 0.002787750158736955, "sim_compute_performance-ego": 0.003826013251916686, "sim_compute_robot_state-ego": 0.005011579883632375, "sim_compute_robot_state-npc0": 0.004728658875422691, "sim_compute_robot_state-npc1": 0.004518875435217103, "sim_compute_robot_state-npc2": 0.004498246890395435, "sim_compute_robot_state-npc3": 0.004487927280255218}, "udem1-7-0": {"driven_any": 0.09373876838868528, "sim_physics": 0.12421627605662626, "survival_time": 0.8500000000000002, "driven_lanedir": 0.049641023390875505, "sim_render-ego": 0.00720981990589815, "in-drivable-lane": 0, "agent_compute-ego": 0.017444245955523324, "deviation-heading": 0.4399417385034358, "set_robot_commands": 0.004717868917128619, "deviation-center-line": 0.0617370003389157, "driven_lanedir_consec": 0.049641023390875505, "sim_compute_sim_state": 0.002808234270881204, "sim_compute_performance-ego": 0.0038776678197524127, "sim_compute_robot_state-ego": 0.005039719974293429, "sim_compute_robot_state-npc0": 0.004702329635620117, "sim_compute_robot_state-npc1": 0.004458062789019416, "sim_compute_robot_state-npc2": 0.004430055618286133, "sim_compute_robot_state-npc3": 0.004423730513628791}, "udem1-8-0": {"driven_any": 0.20159009100773137, "sim_physics": 0.09934094548225404, "survival_time": 1.2000000000000004, "driven_lanedir": 0.14157954394348682, "sim_render-ego": 0.007178972164789836, "in-drivable-lane": 0, "agent_compute-ego": 0.016370445489883423, "deviation-heading": 0.5642499092588014, "set_robot_commands": 0.004706432422002156, "deviation-center-line": 0.04889546176338989, "driven_lanedir_consec": 0.14157954394348682, "sim_compute_sim_state": 0.0026832123597462973, "sim_compute_performance-ego": 0.00386086106300354, "sim_compute_robot_state-ego": 0.0049544572830200195, "sim_compute_robot_state-npc0": 0.004634151856104533, "sim_compute_robot_state-npc1": 0.0044610997041066485, "sim_compute_robot_state-npc2": 0.004439214865366618, "sim_compute_robot_state-npc3": 0.004418551921844482}, "udem1-9-0": {"driven_any": 0.3500350001316201, "sim_physics": 0.12465019342375964, "survival_time": 2.0500000000000007, "driven_lanedir": 0.2542705060226724, "sim_render-ego": 0.007222198858493712, "in-drivable-lane": 0.1499999999999997, "agent_compute-ego": 0.017221747375116114, "deviation-heading": 0.8115579156580551, "set_robot_commands": 0.00491388251141804, "deviation-center-line": 0.0721056017983624, "driven_lanedir_consec": 0.2542705060226724, "sim_compute_sim_state": 0.002749966412055783, "sim_compute_performance-ego": 0.003875587044692621, "sim_compute_robot_state-ego": 0.005116770907146175, "sim_compute_robot_state-npc0": 0.004814967876527368, "sim_compute_robot_state-npc1": 0.004530668258666992, "sim_compute_robot_state-npc2": 0.004508291802755217, "sim_compute_robot_state-npc3": 0.004496934937267769}, "udem1-10-0": {"driven_any": 0.2536959781238244, "sim_physics": 0.1028769314289093, "survival_time": 1.2000000000000004, "driven_lanedir": 0.198017658568713, "sim_render-ego": 0.0071702202161153155, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.017172187566757202, "deviation-heading": 0.5671894038614235, "set_robot_commands": 0.004779398441314697, "deviation-center-line": 0.06052080258398703, "driven_lanedir_consec": 0.198017658568713, "sim_compute_sim_state": 0.002761791149775187, "sim_compute_performance-ego": 0.003850400447845459, "sim_compute_robot_state-ego": 0.00505294402440389, "sim_compute_robot_state-npc0": 0.004699577887852986, "sim_compute_robot_state-npc1": 0.004493802785873413, "sim_compute_robot_state-npc2": 0.004475206136703491, "sim_compute_robot_state-npc3": 0.004470169544219971}, "udem1-11-0": {"driven_any": 0.2839892271369937, "sim_physics": 0.1016763934382686, "survival_time": 1.3500000000000003, "driven_lanedir": 0.26776121330883473, "sim_render-ego": 0.007232356954503943, "in-drivable-lane": 0, "agent_compute-ego": 0.016634702682495117, "deviation-heading": 0.34331776438900213, "set_robot_commands": 0.004976087146335178, "deviation-center-line": 0.1272665674683349, "driven_lanedir_consec": 0.26776121330883473, "sim_compute_sim_state": 0.002776834699842665, "sim_compute_performance-ego": 0.003887326629073531, "sim_compute_robot_state-ego": 0.0050864484575059675, "sim_compute_robot_state-npc0": 0.004843941441288701, "sim_compute_robot_state-npc1": 0.00457710689968533, "sim_compute_robot_state-npc2": 0.004554854498969184, "sim_compute_robot_state-npc3": 0.004530774222479926}, "udem1-12-0": {"driven_any": 0.4060029209301603, "sim_physics": 0.11897942526587124, "survival_time": 2.8999999999999977, "driven_lanedir": 0.257505222923343, "sim_render-ego": 0.007170792283682987, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.017004604997306036, "deviation-heading": 1.304272379705539, "set_robot_commands": 0.0048563480377197266, "deviation-center-line": 0.1259063745096762, "driven_lanedir_consec": 0.257505222923343, "sim_compute_sim_state": 0.002731006720970417, "sim_compute_performance-ego": 0.003863268885119208, "sim_compute_robot_state-ego": 0.005021469346408187, "sim_compute_robot_state-npc0": 0.004691066413090147, "sim_compute_robot_state-npc1": 0.004570817125254664, "sim_compute_robot_state-npc2": 0.00452055602238096, "sim_compute_robot_state-npc3": 0.0045034474339978444}, "udem1-13-0": {"driven_any": 0.1659616209996899, "sim_physics": 0.10872708559036257, "survival_time": 1.0000000000000002, "driven_lanedir": 0.1320259482560968, "sim_render-ego": 0.007219457626342773, "in-drivable-lane": 0, "agent_compute-ego": 0.017032289505004884, "deviation-heading": 0.4122081610632033, "set_robot_commands": 0.00484926700592041, "deviation-center-line": 0.08363414787011961, "driven_lanedir_consec": 0.1320259482560968, "sim_compute_sim_state": 0.002744579315185547, "sim_compute_performance-ego": 0.003848719596862793, "sim_compute_robot_state-ego": 0.005080592632293701, "sim_compute_robot_state-npc0": 0.004775238037109375, "sim_compute_robot_state-npc1": 0.004516339302062989, "sim_compute_robot_state-npc2": 0.004502344131469727, "sim_compute_robot_state-npc3": 0.004491376876831055}, "udem1-14-0": {"driven_any": 0.7714636699675816, "sim_physics": 0.10709089040756226, "survival_time": 2.9999999999999973, "driven_lanedir": 0.5331873973471561, "sim_render-ego": 0.006997541586558024, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.016254242261250815, "deviation-heading": 1.424306929784743, "set_robot_commands": 0.004871543248494466, "deviation-center-line": 0.2600470512104084, "driven_lanedir_consec": 0.5331873973471561, "sim_compute_sim_state": 0.0027442097663879393, "sim_compute_performance-ego": 0.0038318276405334474, "sim_compute_robot_state-ego": 0.004989345868428548, "sim_compute_robot_state-npc0": 0.0046738425890604654, "sim_compute_robot_state-npc1": 0.004529027144114176, "sim_compute_robot_state-npc2": 0.004506071408589681, "sim_compute_robot_state-npc3": 0.004492894808451334}}
set_robot_commands_max	0.011072874069213867
set_robot_commands_mean	0.006741059389288238
set_robot_commands_median	0.00491388251141804
set_robot_commands_min	0.004706432422002156
sim_compute_performance-ego_max	0.007905511856079102
sim_compute_performance-ego_mean	0.005041023116630098
sim_compute_performance-ego_median	0.0038776678197524127
sim_compute_performance-ego_min	0.003826013251916686
sim_compute_robot_state-ego_max	0.009889173507690427
sim_compute_robot_state-ego_mean	0.006551805500520002
sim_compute_robot_state-ego_median	0.0050864484575059675
sim_compute_robot_state-ego_min	0.0049544572830200195
sim_compute_robot_state-npc0_max	0.009664521497838635
sim_compute_robot_state-npc0_mean	0.006214868534681067
sim_compute_robot_state-npc0_median	0.004814967876527368
sim_compute_robot_state-npc0_min	0.004634151856104533
sim_compute_robot_state-npc1_max	0.010200458414414347
sim_compute_robot_state-npc1_mean	0.0060158753178814195
sim_compute_robot_state-npc1_median	0.004570817125254664
sim_compute_robot_state-npc1_min	0.004458062789019416
sim_compute_robot_state-npc2_max	0.00985872044282801
sim_compute_robot_state-npc2_mean	0.005972413550825614
sim_compute_robot_state-npc2_median	0.00452055602238096
sim_compute_robot_state-npc2_min	0.004430055618286133
sim_compute_robot_state-npc3_max	0.00910017967224121
sim_compute_robot_state-npc3_mean	0.005991258199322341
sim_compute_robot_state-npc3_median	0.0045034474339978444
sim_compute_robot_state-npc3_min	0.004418551921844482
sim_compute_sim_state_max	0.005372131572050207
sim_compute_sim_state_mean	0.003576136312106898
sim_compute_sim_state_median	0.002787750158736955
sim_compute_sim_state_min	0.0026832123597462973
sim_physics_max	0.3603522216572481
sim_physics_mean	0.1573681663230206
sim_physics_median	0.12465019342375964
sim_physics_min	0.09934094548225404
sim_render-ego_max	0.01411132251515108
sim_render-ego_mean	0.009274067823034329
sim_render-ego_median	0.007222198858493712
sim_render-ego_min	0.006997541586558024
simulation-passed	1
survival_time_max	3.349999999999996
survival_time_mean	1.6866666666666663
survival_time_min	0.8500000000000002

No reset possible

25023

4360

Soroush Saryazdi 🇨🇦

bluejay

aido3-LFV-sim-testing

step1-simulation

error

ip-172-31-43-40-10496

2019-11-04 15:17:46+00:00

2019-11-04 15:20:49+00:00

0:03:03

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

25005

4148

Andrea Censi 🇨🇭

rotation

aido3-LFVI-sim-testing

step1-simulation

success

ip-172-31-43-40-10496

2019-11-04 10:00:35+00:00

2019-11-04 10:40:47+00:00

0:40:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-0.0004136125639613297
survival_time_median	14.950000000000076
deviation-center-line_median	0.35182477029879017
in-drivable-lane_median	7.550000000000045

other stats

agent_compute-ego_max	0.015171776612599693
agent_compute-ego_mean	0.014098824236128068
agent_compute-ego_median	0.014041260083516438
agent_compute-ego_min	0.013510099252065024
deviation-center-line_max	0.6113246250082045
deviation-center-line_mean	0.3495812824376534
deviation-center-line_min	0.020737627062439232
deviation-heading_max	5.986461294692885
deviation-heading_mean	5.676693152386386
deviation-heading_median	5.657649106857696
deviation-heading_min	5.446954481754142
driven_any_max	0.026478672834052443
driven_any_mean	0.02338944237901256
driven_any_median	0.02328526772831486
driven_any_min	0.01977949840933149
driven_lanedir_consec_max	0.0021756896242595136
driven_lanedir_consec_mean	-0.0008966697258119568
driven_lanedir_consec_min	-0.004956006324957851
driven_lanedir_max	0.0021756896242595136
driven_lanedir_mean	-0.0008966697258119568
driven_lanedir_median	-0.0004136125639613297
driven_lanedir_min	-0.004956006324957851
in-drivable-lane_max	7.650000000000043
in-drivable-lane_mean	7.566666666666709
in-drivable-lane_min	7.500000000000041
per-episodes	details {"udem1-0-0": {"driven_any": 0.026478672834052443, "sim_physics": 0.1069577177365621, "survival_time": 14.950000000000076, "driven_lanedir": 0.002162616049345756, "sim_render-ego": 0.0068774207433064775, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.01396544377009074, "deviation-heading": 5.657649106857696, "set_robot_commands": 0.004802975654602051, "deviation-center-line": 0.561012181201902, "driven_lanedir_consec": 0.002162616049345756, "sim_compute_sim_state": 0.0027259707450866697, "sim_compute_performance-ego": 0.0038625272115071618, "sim_compute_robot_state-ego": 0.004995241165161133, "sim_compute_robot_state-npc0": 0.004624791145324707, "sim_compute_robot_state-npc1": 0.004453763167063396, "sim_compute_robot_state-npc2": 0.004477263291676839, "sim_compute_robot_state-npc3": 0.004410046736399333}, "udem1-1-0": {"driven_any": 0.02593019554120905, "sim_physics": 0.11052664518356324, "survival_time": 14.950000000000076, "driven_lanedir": -0.0036402347654349576, "sim_render-ego": 0.007101909319559733, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.014370173613230388, "deviation-heading": 5.79531637039674, "set_robot_commands": 0.0047716832160949706, "deviation-center-line": 0.6113246250082045, "driven_lanedir_consec": -0.0036402347654349576, "sim_compute_sim_state": 0.002750121752421061, "sim_compute_performance-ego": 0.003854765097300212, "sim_compute_robot_state-ego": 0.005037075678507487, "sim_compute_robot_state-npc0": 0.004694834550221761, "sim_compute_robot_state-npc1": 0.004450290203094482, "sim_compute_robot_state-npc2": 0.004434626102447509, "sim_compute_robot_state-npc3": 0.004415720303853353}, "udem1-2-0": {"driven_any": 0.023804404672430148, "sim_physics": 0.10778475920359294, "survival_time": 14.950000000000076, "driven_lanedir": 0.0017436411031614971, "sim_render-ego": 0.006939899921417236, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.013884042104085286, "deviation-heading": 5.603088381719548, "set_robot_commands": 0.00474625825881958, "deviation-center-line": 0.4891046565937845, "driven_lanedir_consec": 0.0017436411031614971, "sim_compute_sim_state": 0.0027630178133646647, "sim_compute_performance-ego": 0.0038463179270426433, "sim_compute_robot_state-ego": 0.005062938531239828, "sim_compute_robot_state-npc0": 0.004733097553253174, "sim_compute_robot_state-npc1": 0.0044364492098490395, "sim_compute_robot_state-npc2": 0.004418012301127116, "sim_compute_robot_state-npc3": 0.004412700335184733}, "udem1-3-0": {"driven_any": 0.022165452661382787, "sim_physics": 0.10720745325088502, "survival_time": 14.950000000000076, "driven_lanedir": -0.003014298202352883, "sim_render-ego": 0.0069701663653055825, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.014388036727905274, "deviation-heading": 5.53666299685486, "set_robot_commands": 0.004773417313893636, "deviation-center-line": 0.4305510477122152, "driven_lanedir_consec": -0.003014298202352883, "sim_compute_sim_state": 0.002741900285085042, "sim_compute_performance-ego": 0.003826309045155843, "sim_compute_robot_state-ego": 0.0050402688980102535, "sim_compute_robot_state-npc0": 0.004676405588785807, "sim_compute_robot_state-npc1": 0.004432677427927653, "sim_compute_robot_state-npc2": 0.004418620268503825, "sim_compute_robot_state-npc3": 0.004419887065887451}, "udem1-4-0": {"driven_any": 0.02594247225218716, "sim_physics": 0.1043375849723816, "survival_time": 14.950000000000076, "driven_lanedir": 0.00030504467687686443, "sim_render-ego": 0.0069333036740620935, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.014012810389200846, "deviation-heading": 5.830135897709591, "set_robot_commands": 0.004704937934875488, "deviation-center-line": 0.020737627062439232, "driven_lanedir_consec": 0.00030504467687686443, "sim_compute_sim_state": 0.002704494794209798, "sim_compute_performance-ego": 0.003818124930063883, "sim_compute_robot_state-ego": 0.004974245230356852, "sim_compute_robot_state-npc0": 0.004582964579264323, "sim_compute_robot_state-npc1": 0.004444895585378011, "sim_compute_robot_state-npc2": 0.00439777692159017, "sim_compute_robot_state-npc3": 0.0044945605595906575}, "udem1-5-0": {"driven_any": 0.02624988077521032, "sim_physics": 0.1022605307896932, "survival_time": 14.950000000000076, "driven_lanedir": -0.0004136125639613297, "sim_render-ego": 0.006900662581125895, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.013720892270406088, "deviation-heading": 5.51855304458557, "set_robot_commands": 0.004747797648111979, "deviation-center-line": 0.35182477029879017, "driven_lanedir_consec": -0.0004136125639613297, "sim_compute_sim_state": 0.002730566660563151, "sim_compute_performance-ego": 0.003822937806447347, "sim_compute_robot_state-ego": 0.004975637594858805, "sim_compute_robot_state-npc0": 0.004643276532491048, "sim_compute_robot_state-npc1": 0.00444300095240275, "sim_compute_robot_state-npc2": 0.004423524538675944, "sim_compute_robot_state-npc3": 0.0043927796681722}, "udem1-6-0": {"driven_any": 0.02328526772831486, "sim_physics": 0.1076671306292216, "survival_time": 14.950000000000076, "driven_lanedir": -0.003257572789892471, "sim_render-ego": 0.0070100156466166175, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.01409423033396403, "deviation-heading": 5.658569132462586, "set_robot_commands": 0.004783906141916911, "deviation-center-line": 0.2794326257891305, "driven_lanedir_consec": -0.003257572789892471, "sim_compute_sim_state": 0.0027800559997558593, "sim_compute_performance-ego": 0.003827852408091227, "sim_compute_robot_state-ego": 0.0050533866882324216, "sim_compute_robot_state-npc0": 0.004770984649658203, "sim_compute_robot_state-npc1": 0.004434030850728353, "sim_compute_robot_state-npc2": 0.004408104419708252, "sim_compute_robot_state-npc3": 0.004395740032196045}, "udem1-7-0": {"driven_any": 0.02356164475516759, "sim_physics": 0.10955382029215496, "survival_time": 14.950000000000076, "driven_lanedir": 0.0021756896242595136, "sim_render-ego": 0.007100424766540527, "in-drivable-lane": 7.500000000000044, "agent_compute-ego": 0.01433470884958903, "deviation-heading": 5.60591831846957, "set_robot_commands": 0.004724090894063314, "deviation-center-line": 0.3815946083581704, "driven_lanedir_consec": 0.0021756896242595136, "sim_compute_sim_state": 0.0027257061004638673, "sim_compute_performance-ego": 0.003824000358581543, "sim_compute_robot_state-ego": 0.005015656948089599, "sim_compute_robot_state-npc0": 0.004685895442962646, "sim_compute_robot_state-npc1": 0.0044153094291687015, "sim_compute_robot_state-npc2": 0.004396611054738362, "sim_compute_robot_state-npc3": 0.004393113454182943}, "udem1-8-0": {"driven_any": 0.024191972983624275, "sim_physics": 0.10359237670898436, "survival_time": 14.950000000000076, "driven_lanedir": 0.001143832524418631, "sim_render-ego": 0.006896561781565349, "in-drivable-lane": 7.600000000000045, "agent_compute-ego": 0.01367986758550008, "deviation-heading": 5.446954481754142, "set_robot_commands": 0.004740654627482096, "deviation-center-line": 0.14791938306875854, "driven_lanedir_consec": 0.001143832524418631, "sim_compute_sim_state": 0.002686126232147217, "sim_compute_performance-ego": 0.003801446755727132, "sim_compute_robot_state-ego": 0.004942642052968343, "sim_compute_robot_state-npc0": 0.004610465367635091, "sim_compute_robot_state-npc1": 0.004403484662373861, "sim_compute_robot_state-npc2": 0.004388821919759115, "sim_compute_robot_state-npc3": 0.004386196931203207}, "udem1-9-0": {"driven_any": 0.02125816620691301, "sim_physics": 0.106418932278951, "survival_time": 14.950000000000076, "driven_lanedir": 0.00014826963600889087, "sim_render-ego": 0.008309827645619711, "in-drivable-lane": 7.500000000000041, "agent_compute-ego": 0.014097248713175456, "deviation-heading": 5.986461294692885, "set_robot_commands": 0.004793330828348796, "deviation-center-line": 0.2869305401813856, "driven_lanedir_consec": 0.00014826963600889087, "sim_compute_sim_state": 0.0026919786135355633, "sim_compute_performance-ego": 0.0038125777244567872, "sim_compute_robot_state-ego": 0.004964469273885091, "sim_compute_robot_state-npc0": 0.004608554840087891, "sim_compute_robot_state-npc1": 0.00439306100209554, "sim_compute_robot_state-npc2": 0.004383605321248372, "sim_compute_robot_state-npc3": 0.00438150962193807}, "udem1-10-0": {"driven_any": 0.02143429212020503, "sim_physics": 0.10638672749201455, "survival_time": 14.950000000000076, "driven_lanedir": 0.0006099987785463945, "sim_render-ego": 0.006853556632995606, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.014183820883433024, "deviation-heading": 5.880064631978755, "set_robot_commands": 0.00466260035832723, "deviation-center-line": 0.152307861948804, "driven_lanedir_consec": 0.0006099987785463945, "sim_compute_sim_state": 0.0026894569396972655, "sim_compute_performance-ego": 0.003748437563578288, "sim_compute_robot_state-ego": 0.004898951848347982, "sim_compute_robot_state-npc0": 0.004551633993784587, "sim_compute_robot_state-npc1": 0.004462408224741618, "sim_compute_robot_state-npc2": 0.004358476003011068, "sim_compute_robot_state-npc3": 0.004326167106628418}, "udem1-11-0": {"driven_any": 0.01977949840933149, "sim_physics": 0.10266207377115884, "survival_time": 14.950000000000076, "driven_lanedir": -0.0014757166080734407, "sim_render-ego": 0.006927024523417155, "in-drivable-lane": 7.550000000000041, "agent_compute-ego": 0.014027952353159586, "deviation-heading": 5.808176953181407, "set_robot_commands": 0.0046620965003967285, "deviation-center-line": 0.427504968775779, "driven_lanedir_consec": -0.0014757166080734407, "sim_compute_sim_state": 0.0026924546559651693, "sim_compute_performance-ego": 0.003747074604034424, "sim_compute_robot_state-ego": 0.00490394115447998, "sim_compute_robot_state-npc0": 0.004551381270090739, "sim_compute_robot_state-npc1": 0.004364748001098633, "sim_compute_robot_state-npc2": 0.0043449918429056805, "sim_compute_robot_state-npc3": 0.004315730730692546}, "udem1-12-0": {"driven_any": 0.020981564902329344, "sim_physics": 0.10948883930842082, "survival_time": 14.950000000000076, "driven_lanedir": -0.0013971352797959025, "sim_render-ego": 0.006855753262837728, "in-drivable-lane": 7.500000000000044, "agent_compute-ego": 0.015171776612599693, "deviation-heading": 5.599572893646449, "set_robot_commands": 0.004686991373697917, "deviation-center-line": 0.4665408442231104, "driven_lanedir_consec": -0.0013971352797959025, "sim_compute_sim_state": 0.0026730926831563316, "sim_compute_performance-ego": 0.00376249631245931, "sim_compute_robot_state-ego": 0.004898311297098796, "sim_compute_robot_state-npc0": 0.004575345516204834, "sim_compute_robot_state-npc1": 0.004359478155771891, "sim_compute_robot_state-npc2": 0.004342073599497477, "sim_compute_robot_state-npc3": 0.004340931574503581}, "udem1-13-0": {"driven_any": 0.022551048035820323, "sim_physics": 0.10559472481409708, "survival_time": 14.950000000000076, "driven_lanedir": -0.004956006324957851, "sim_render-ego": 0.006860701243082682, "in-drivable-lane": 7.550000000000043, "agent_compute-ego": 0.014041260083516438, "deviation-heading": 5.731757883059763, "set_robot_commands": 0.004627468585968017, "deviation-center-line": 0.3321612144471533, "driven_lanedir_consec": -0.004956006324957851, "sim_compute_sim_state": 0.0026492945353190104, "sim_compute_performance-ego": 0.003746933142344157, "sim_compute_robot_state-ego": 0.004860472679138183, "sim_compute_robot_state-npc0": 0.004501574834187825, "sim_compute_robot_state-npc1": 0.0043344052632649736, "sim_compute_robot_state-npc2": 0.004320666790008545, "sim_compute_robot_state-npc3": 0.0043309386571248375}, "udem1-14-0": {"driven_any": 0.023227101807010583, "sim_physics": 0.10458499590555828, "survival_time": 14.950000000000076, "driven_lanedir": -0.003584561745328063, "sim_render-ego": 0.006797099908192952, "in-drivable-lane": 7.550000000000045, "agent_compute-ego": 0.013510099252065024, "deviation-heading": 5.491515898426224, "set_robot_commands": 0.0046184531847635905, "deviation-center-line": 0.30477228189517347, "driven_lanedir_consec": -0.003584561745328063, "sim_compute_sim_state": 0.002674847443898519, "sim_compute_performance-ego": 0.0037370769182840983, "sim_compute_robot_state-ego": 0.00488762617111206, "sim_compute_robot_state-npc0": 0.004562342166900634, "sim_compute_robot_state-npc1": 0.004338978926340739, "sim_compute_robot_state-npc2": 0.0043283867835998534, "sim_compute_robot_state-npc3": 0.004317880471547445}}
set_robot_commands_max	0.004802975654602051
set_robot_commands_mean	0.004723110834757487
set_robot_commands_median	0.004740654627482096
set_robot_commands_min	0.0046184531847635905
sim_compute_performance-ego_max	0.0038625272115071618
sim_compute_performance-ego_mean	0.003802591853671604
sim_compute_performance-ego_median	0.003818124930063883
sim_compute_performance-ego_min	0.0037370769182840983
sim_compute_robot_state-ego_max	0.005062938531239828
sim_compute_robot_state-ego_mean	0.004967391014099121
sim_compute_robot_state-ego_median	0.004974245230356852
sim_compute_robot_state-ego_min	0.004860472679138183
sim_compute_robot_state-npc0_max	0.004770984649658203
sim_compute_robot_state-npc0_mean	0.004624903202056885
sim_compute_robot_state-npc0_median	0.004610465367635091
sim_compute_robot_state-npc0_min	0.004501574834187825
sim_compute_robot_state-npc1_max	0.004462408224741618
sim_compute_robot_state-npc1_mean	0.0044111320707533085
sim_compute_robot_state-npc1_median	0.004432677427927653
sim_compute_robot_state-npc1_min	0.0043344052632649736
sim_compute_robot_state-npc2_max	0.004477263291676839
sim_compute_robot_state-npc2_mean	0.004389437410566543
sim_compute_robot_state-npc2_median	0.004396611054738362
sim_compute_robot_state-npc2_min	0.004320666790008545
sim_compute_robot_state-npc3_max	0.0044945605595906575
sim_compute_robot_state-npc3_mean	0.004382260216606989
sim_compute_robot_state-npc3_median	0.0043927796681722
sim_compute_robot_state-npc3_min	0.004315730730692546
sim_compute_sim_state_max	0.0027800559997558593
sim_compute_sim_state_mean	0.0027119390169779455
sim_compute_sim_state_median	0.002704494794209798
sim_compute_sim_state_min	0.0026492945353190104
sim_physics_max	0.11052664518356324
sim_physics_mean	0.10633495415581597
sim_physics_median	0.106418932278951
sim_physics_min	0.1022605307896932
sim_render-ego_max	0.008309827645619711
sim_render-ego_mean	0.007022288534376356
sim_render-ego_median	0.006927024523417155
sim_render-ego_min	0.006797099908192952
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

24990

4146

Andrea Censi 🇨🇭

rotation

aido3-LFV-sim-testing

step1-simulation

success

ip-172-31-43-40-10496

2019-11-04 09:01:13+00:00

2019-11-04 09:58:32+00:00

0:57:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-0.0004210035399991874
survival_time_median	14.950000000000076
deviation-center-line_median	0.35182572071982005
in-drivable-lane_median	7.550000000000045

other stats

agent_compute-ego_max	0.0240780242284139
agent_compute-ego_mean	0.021647315078311493
agent_compute-ego_median	0.022363239129384357
agent_compute-ego_min	0.016190265814463298
deviation-center-line_max	0.6113242374220981
deviation-center-line_mean	0.3495811985198474
deviation-center-line_min	0.020737127615471695
deviation-heading_max	5.986461294692883
deviation-heading_mean	5.6766931523863855
deviation-heading_median	5.657649106857694
deviation-heading_min	5.446954481754146
driven_any_max	0.026478672834058543
driven_any_mean	0.02338944237901383
driven_any_median	0.02328526772832417
driven_any_min	0.01977949840932533
driven_lanedir_consec_max	0.002175689624529298
driven_lanedir_consec_mean	-0.000897428691689206
driven_lanedir_consec_min	-0.004956006324957851
driven_lanedir_max	0.002175689624529298
driven_lanedir_mean	-0.000897428691689206
driven_lanedir_median	-0.0004210035399991874
driven_lanedir_min	-0.004956006324957851
in-drivable-lane_max	7.650000000000043
in-drivable-lane_mean	7.566666666666709
in-drivable-lane_min	7.500000000000041
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.026478672834058543, "sim_physics": 0.16708538929621378, "survival_time": 14.950000000000076, "driven_lanedir": 0.0021599934447711355, "sim_render-ego": 0.012259060541788738, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.023274081548055013, "deviation-heading": 5.657649106857694, "set_robot_commands": 0.009318506717681883, "deviation-center-line": 0.5610133203215761, "driven_lanedir_consec": 0.0021599934447711355, "sim_compute_sim_state": 0.004814488093058268, "sim_compute_performance-ego": 0.007202463150024414, "sim_compute_robot_state-ego": 0.009035101731618244, "sim_compute_robot_state-npc0": 0.008368636767069499, "sim_compute_robot_state-npc1": 0.00803520123163859, "sim_compute_robot_state-npc2": 0.00791237195332845, "sim_compute_robot_state-npc3": 0.00797752062479655}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.025930195541210208, "sim_physics": 0.15724120696385702, "survival_time": 14.950000000000076, "driven_lanedir": -0.003645956811333395, "sim_render-ego": 0.0120576540629069, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.02231685479482015, "deviation-heading": 5.795316370396739, "set_robot_commands": 0.008802608648935954, "deviation-center-line": 0.6113242374220981, "driven_lanedir_consec": -0.003645956811333395, "sim_compute_sim_state": 0.004509960810343425, "sim_compute_performance-ego": 0.006987579663594564, "sim_compute_robot_state-ego": 0.008913115660349528, "sim_compute_robot_state-npc0": 0.008542680740356445, "sim_compute_robot_state-npc1": 0.008020754655202229, "sim_compute_robot_state-npc2": 0.007821800708770752, "sim_compute_robot_state-npc3": 0.007641584078470866}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.023804404672443435, "sim_physics": 0.15846790313720704, "survival_time": 14.950000000000076, "driven_lanedir": 0.0017527010091673567, "sim_render-ego": 0.011677221457163493, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.02219657818476359, "deviation-heading": 5.603088381719547, "set_robot_commands": 0.008827428023020426, "deviation-center-line": 0.4891048530415207, "driven_lanedir_consec": 0.0017527010091673567, "sim_compute_sim_state": 0.004778231779734294, "sim_compute_performance-ego": 0.006948219935099284, "sim_compute_robot_state-ego": 0.00877132018407186, "sim_compute_robot_state-npc0": 0.008337642351786296, "sim_compute_robot_state-npc1": 0.008112181822458903, "sim_compute_robot_state-npc2": 0.00817075252532959, "sim_compute_robot_state-npc3": 0.008172406355539957}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.022165452661382513, "sim_physics": 0.16247098366419474, "survival_time": 14.950000000000076, "driven_lanedir": -0.003010841132988329, "sim_render-ego": 0.011838201681772869, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.02220884641011556, "deviation-heading": 5.536662996854859, "set_robot_commands": 0.008501814206441244, "deviation-center-line": 0.4305506258687733, "driven_lanedir_consec": -0.003010841132988329, "sim_compute_sim_state": 0.004826916853586833, "sim_compute_performance-ego": 0.007058448791503906, "sim_compute_robot_state-ego": 0.008783878485361735, "sim_compute_robot_state-npc0": 0.008193816343943278, "sim_compute_robot_state-npc1": 0.008054654598236084, "sim_compute_robot_state-npc2": 0.007890280882517496, "sim_compute_robot_state-npc3": 0.008092233339945475}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.02594247225218261, "sim_physics": 0.16434317588806152, "survival_time": 14.950000000000076, "driven_lanedir": 0.00031446221011421915, "sim_render-ego": 0.012373121579488118, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.022731239000956215, "deviation-heading": 5.830135897709593, "set_robot_commands": 0.008716653982798259, "deviation-center-line": 0.020737127615471695, "driven_lanedir_consec": 0.00031446221011421915, "sim_compute_sim_state": 0.004709467887878418, "sim_compute_performance-ego": 0.007199091116587321, "sim_compute_robot_state-ego": 0.009181038538614909, "sim_compute_robot_state-npc0": 0.008574090003967284, "sim_compute_robot_state-npc1": 0.007953713734944662, "sim_compute_robot_state-npc2": 0.007990179856618245, "sim_compute_robot_state-npc3": 0.00768888791402181}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.02624988077521305, "sim_physics": 0.16015101512273153, "survival_time": 14.950000000000076, "driven_lanedir": -0.0004210035399991874, "sim_render-ego": 0.011524691581726074, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.022648571332295735, "deviation-heading": 5.5185530445855715, "set_robot_commands": 0.008947393894195556, "deviation-center-line": 0.35182572071982005, "driven_lanedir_consec": -0.0004210035399991874, "sim_compute_sim_state": 0.004914047718048095, "sim_compute_performance-ego": 0.0069049358367919925, "sim_compute_robot_state-ego": 0.008768707116444906, "sim_compute_robot_state-npc0": 0.00827567974726359, "sim_compute_robot_state-npc1": 0.008130687872568767, "sim_compute_robot_state-npc2": 0.007992945512135823, "sim_compute_robot_state-npc3": 0.007823135058085124}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.02328526772832417, "sim_physics": 0.17441570520401, "survival_time": 14.950000000000076, "driven_lanedir": -0.003251075883798471, "sim_render-ego": 0.012161306540171304, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.02393626610438029, "deviation-heading": 5.658569132462587, "set_robot_commands": 0.009691571394602458, "deviation-center-line": 0.279436074750809, "driven_lanedir_consec": -0.003251075883798471, "sim_compute_sim_state": 0.0050711989402771, "sim_compute_performance-ego": 0.0071367867787679035, "sim_compute_robot_state-ego": 0.00904330015182495, "sim_compute_robot_state-npc0": 0.00872817834218343, "sim_compute_robot_state-npc1": 0.008535011609395345, "sim_compute_robot_state-npc2": 0.008554179668426514, "sim_compute_robot_state-npc3": 0.008358519077301025}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.023561644755161693, "sim_physics": 0.16369389454523722, "survival_time": 14.950000000000076, "driven_lanedir": 0.002175689624529298, "sim_render-ego": 0.011842474142710368, "in-drivable-lane": 7.500000000000044, "agent_compute-ego": 0.022363239129384357, "deviation-heading": 5.605918318469571, "set_robot_commands": 0.009124667644500732, "deviation-center-line": 0.3815932559652111, "driven_lanedir_consec": 0.002175689624529298, "sim_compute_sim_state": 0.004700105190277099, "sim_compute_performance-ego": 0.007190862496693929, "sim_compute_robot_state-ego": 0.009071589310963949, "sim_compute_robot_state-npc0": 0.008299403190612793, "sim_compute_robot_state-npc1": 0.008062318166097005, "sim_compute_robot_state-npc2": 0.00804759979248047, "sim_compute_robot_state-npc3": 0.007937675317128499}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.024191972983614415, "sim_physics": 0.15974631230036418, "survival_time": 14.950000000000076, "driven_lanedir": 0.001130242665409842, "sim_render-ego": 0.01174791892369588, "in-drivable-lane": 7.600000000000045, "agent_compute-ego": 0.0221221121152242, "deviation-heading": 5.446954481754146, "set_robot_commands": 0.00906811555226644, "deviation-center-line": 0.147917463467496, "driven_lanedir_consec": 0.001130242665409842, "sim_compute_sim_state": 0.004814003308614095, "sim_compute_performance-ego": 0.006790344715118408, "sim_compute_robot_state-ego": 0.008843039671579997, "sim_compute_robot_state-npc0": 0.008236033121744792, "sim_compute_robot_state-npc1": 0.007978090445200602, "sim_compute_robot_state-npc2": 0.007960082689921062, "sim_compute_robot_state-npc3": 0.008054029941558839}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.02125816620692276, "sim_physics": 0.1729631805419922, "survival_time": 14.950000000000076, "driven_lanedir": 0.00014695833410893755, "sim_render-ego": 0.011897782484690348, "in-drivable-lane": 7.500000000000041, "agent_compute-ego": 0.02297122081120809, "deviation-heading": 5.986461294692883, "set_robot_commands": 0.0091472323735555, "deviation-center-line": 0.28693076998913597, "driven_lanedir_consec": 0.00014695833410893755, "sim_compute_sim_state": 0.00481196641921997, "sim_compute_performance-ego": 0.007069339752197265, "sim_compute_robot_state-ego": 0.009083099365234376, "sim_compute_robot_state-npc0": 0.008393808205922445, "sim_compute_robot_state-npc1": 0.008162338733673096, "sim_compute_robot_state-npc2": 0.007954928874969482, "sim_compute_robot_state-npc3": 0.007967376708984375}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.021434292120207553, "sim_physics": 0.17873183488845826, "survival_time": 14.950000000000076, "driven_lanedir": 0.0006110716623699552, "sim_render-ego": 0.012027609348297118, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.0240780242284139, "deviation-heading": 5.8800646319787555, "set_robot_commands": 0.009720195929209393, "deviation-center-line": 0.15230669122649582, "driven_lanedir_consec": 0.0006110716623699552, "sim_compute_sim_state": 0.004922747611999512, "sim_compute_performance-ego": 0.007248894373575846, "sim_compute_robot_state-ego": 0.00934377908706665, "sim_compute_robot_state-npc0": 0.008997330665588379, "sim_compute_robot_state-npc1": 0.008302752176920574, "sim_compute_robot_state-npc2": 0.008281113306681315, "sim_compute_robot_state-npc3": 0.00835201342900594}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.01977949840932533, "sim_physics": 0.17007817188898722, "survival_time": 14.950000000000076, "driven_lanedir": -0.001467610376958639, "sim_render-ego": 0.01193160851796468, "in-drivable-lane": 7.550000000000041, "agent_compute-ego": 0.02343412160873413, "deviation-heading": 5.808176953181408, "set_robot_commands": 0.009921050866444906, "deviation-center-line": 0.4275036254592562, "driven_lanedir_consec": -0.001467610376958639, "sim_compute_sim_state": 0.004876342614491781, "sim_compute_performance-ego": 0.007168935934702555, "sim_compute_robot_state-ego": 0.009249618848164876, "sim_compute_robot_state-npc0": 0.008779449462890625, "sim_compute_robot_state-npc1": 0.008361015319824219, "sim_compute_robot_state-npc2": 0.008284308910369874, "sim_compute_robot_state-npc3": 0.008138139247894288}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.020981564902325674, "sim_physics": 0.11365880091985069, "survival_time": 14.950000000000076, "driven_lanedir": -0.0014064336043808634, "sim_render-ego": 0.008291893800099691, "in-drivable-lane": 7.500000000000044, "agent_compute-ego": 0.01684999148050944, "deviation-heading": 5.599572893646449, "set_robot_commands": 0.006509250005086263, "deviation-center-line": 0.4665414695810384, "driven_lanedir_consec": -0.0014064336043808634, "sim_compute_sim_state": 0.0032217280069986977, "sim_compute_performance-ego": 0.0046521790822347, "sim_compute_robot_state-ego": 0.0060310840606689455, "sim_compute_robot_state-npc0": 0.005773288408915202, "sim_compute_robot_state-npc1": 0.005464430650075277, "sim_compute_robot_state-npc2": 0.005476968288421631, "sim_compute_robot_state-npc3": 0.0054950753847757975}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.02255104803582274, "sim_physics": 0.12051364024480184, "survival_time": 14.950000000000076, "driven_lanedir": -0.004956006324957851, "sim_render-ego": 0.008230313460032146, "in-drivable-lane": 7.550000000000043, "agent_compute-ego": 0.016190265814463298, "deviation-heading": 5.731757883059763, "set_robot_commands": 0.006328867276509603, "deviation-center-line": 0.3321614108948844, "driven_lanedir_consec": -0.004956006324957851, "sim_compute_sim_state": 0.003240818977355957, "sim_compute_performance-ego": 0.004632370471954346, "sim_compute_robot_state-ego": 0.006054274241129557, "sim_compute_robot_state-npc0": 0.005710736910502116, "sim_compute_robot_state-npc1": 0.005449872811635335, "sim_compute_robot_state-npc2": 0.0054579432805379234, "sim_compute_robot_state-npc3": 0.005472915172576904}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.0232271018070128, "sim_physics": 0.11740183512369792, "survival_time": 14.950000000000076, "driven_lanedir": -0.003593621651392098, "sim_render-ego": 0.008702541987101237, "in-drivable-lane": 7.550000000000045, "agent_compute-ego": 0.01738831361134847, "deviation-heading": 5.491515898426221, "set_robot_commands": 0.006957668463389079, "deviation-center-line": 0.3047713314741245, "driven_lanedir_consec": -0.003593621651392098, "sim_compute_sim_state": 0.0034000404675801595, "sim_compute_performance-ego": 0.004978508949279785, "sim_compute_robot_state-ego": 0.006435046195983887, "sim_compute_robot_state-npc0": 0.006047631899515788, "sim_compute_robot_state-npc1": 0.0058236241340637205, "sim_compute_robot_state-npc2": 0.005797330538431803, "sim_compute_robot_state-npc3": 0.005864643255869548}}
set_robot_commands_max	0.009921050866444906
set_robot_commands_mean	0.00863886833190918
set_robot_commands_median	0.008947393894195556
set_robot_commands_min	0.006328867276509603
sim_compute_performance-ego_max	0.007248894373575846
sim_compute_performance-ego_mean	0.006611264069875082
sim_compute_performance-ego_median	0.007058448791503906
sim_compute_performance-ego_min	0.004632370471954346
sim_compute_robot_state-ego_max	0.00934377908706665
sim_compute_robot_state-ego_mean	0.008440532843271892
sim_compute_robot_state-ego_median	0.008913115660349528
sim_compute_robot_state-ego_min	0.0060310840606689455
sim_compute_robot_state-npc0_max	0.008997330665588379
sim_compute_robot_state-npc0_mean	0.007950560410817462
sim_compute_robot_state-npc0_median	0.008337642351786296
sim_compute_robot_state-npc0_min	0.005710736910502116
sim_compute_robot_state-npc1_max	0.008535011609395345
sim_compute_robot_state-npc1_mean	0.007629776530795628
sim_compute_robot_state-npc1_median	0.008054654598236084
sim_compute_robot_state-npc1_min	0.005449872811635335
sim_compute_robot_state-npc2_max	0.008554179668426514
sim_compute_robot_state-npc2_mean	0.00757285245259603
sim_compute_robot_state-npc2_median	0.007960082689921062
sim_compute_robot_state-npc2_min	0.0054579432805379234
sim_compute_robot_state-npc3_max	0.008358519077301025
sim_compute_robot_state-npc3_mean	0.007535743660396999
sim_compute_robot_state-npc3_median	0.007967376708984375
sim_compute_robot_state-npc3_min	0.005472915172576904
sim_compute_sim_state_max	0.0050711989402771
sim_compute_sim_state_mean	0.004507470978630914
sim_compute_sim_state_median	0.00481196641921997
sim_compute_sim_state_min	0.0032217280069986977
sim_physics_max	0.17873183488845826
sim_physics_mean	0.156064203315311
sim_physics_median	0.16247098366419474
sim_physics_min	0.11365880091985069
sim_render-ego_max	0.012373121579488118
sim_render-ego_mean	0.011237560007307268
sim_render-ego_median	0.011842474142710368
sim_render-ego_min	0.008230313460032146
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

24908

4242

Manfred Diaz

Baseline-IL-logs-tensorflow

aido3-LFV-sim-testing

step1-simulation

error

ip-172-31-43-40-10496

2019-11-04 08:18:34+00:00

2019-11-04 09:01:06+00:00

0:42:32

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24901

4248

Manfred Diaz

challenge-aido_LF-template-tensorflow

aido3-LF-sim-validation

step1-simulation

success

ip-172-31-43-40-10496

2019-11-04 08:12:22+00:00

2019-11-04 08:18:06+00:00

0:05:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2588156179148666
survival_time_median	1.950000000000001
deviation-center-line_median	0.12073674798595237
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.035485063989957176
agent_compute-ego_mean	0.02693500786255567
agent_compute-ego_median	0.02716714143753052
agent_compute-ego_min	0.0184170527335925
deviation-center-line_max	0.17834727212359194
deviation-center-line_mean	0.11183419502542688
deviation-center-line_min	0.06660126921413623
deviation-heading_max	1.4172430670686489
deviation-heading_mean	0.7538211182786654
deviation-heading_median	0.5669786639072552
deviation-heading_min	0.4743773691354692
driven_any_max	0.7499002564015992
driven_any_mean	0.473746313763557
driven_any_median	0.5114395518318788
driven_any_min	0.22848249161314743
driven_lanedir_consec_max	0.7228067691985882
driven_lanedir_consec_mean	0.35969505736459395
driven_lanedir_consec_min	0.15347444488204864
driven_lanedir_max	0.7228067691985882
driven_lanedir_mean	0.37600973248070935
driven_lanedir_median	0.3000790272685281
driven_lanedir_min	0.15347444488204864
in-drivable-lane_max	0.7999999999999996
in-drivable-lane_mean	0.15999999999999992
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.22848249161314743, "sim_physics": 0.12062562704086303, "survival_time": 1.0000000000000002, "driven_lanedir": 0.15347444488204864, "sim_render-ego": 0.01224595308303833, "in-drivable-lane": 0, "agent_compute-ego": 0.03091508150100708, "deviation-heading": 0.5386884415859471, "set_robot_commands": 0.009390974044799804, "deviation-center-line": 0.06660126921413623, "driven_lanedir_consec": 0.15347444488204864, "sim_compute_sim_state": 0.0058760523796081545, "sim_compute_performance-ego": 0.00701444149017334, "sim_compute_robot_state-ego": 0.010431134700775146}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5114395518318788, "sim_physics": 0.06324388430668758, "survival_time": 1.950000000000001, "driven_lanedir": 0.44487280313951505, "sim_render-ego": 0.00821358118301783, "in-drivable-lane": 0, "agent_compute-ego": 0.0184170527335925, "deviation-heading": 0.7718180496960069, "set_robot_commands": 0.005622172966981545, "deviation-center-line": 0.12073674798595237, "driven_lanedir_consec": 0.44487280313951505, "sim_compute_sim_state": 0.003260019497993665, "sim_compute_performance-ego": 0.0045131230965638775, "sim_compute_robot_state-ego": 0.005852308028783553}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7499002564015992, "sim_physics": 0.17623795568943024, "survival_time": 2.3999999999999995, "driven_lanedir": 0.7228067691985882, "sim_render-ego": 0.015887464086214702, "in-drivable-lane": 0, "agent_compute-ego": 0.035485063989957176, "deviation-heading": 0.4743773691354692, "set_robot_commands": 0.013158713777860006, "deviation-center-line": 0.12529128314733576, "driven_lanedir_consec": 0.7228067691985882, "sim_compute_sim_state": 0.007416884104410808, "sim_compute_performance-ego": 0.00869123637676239, "sim_compute_robot_state-ego": 0.012385313709576923}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.31382985220719545, "sim_physics": 0.0836489383990948, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2588156179148666, "sim_render-ego": 0.00939775430239164, "in-drivable-lane": 0, "agent_compute-ego": 0.022690699650691107, "deviation-heading": 0.5669786639072552, "set_robot_commands": 0.00747381723844088, "deviation-center-line": 0.06819440265611812, "driven_lanedir_consec": 0.2588156179148666, "sim_compute_sim_state": 0.003840171373807467, "sim_compute_performance-ego": 0.005259972352247972, "sim_compute_robot_state-ego": 0.0066368396465594955}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5650794167639642, "sim_physics": 0.1012598196665446, "survival_time": 2.9999999999999973, "driven_lanedir": 0.3000790272685281, "sim_render-ego": 0.012669865290323894, "in-drivable-lane": 0.7999999999999996, "agent_compute-ego": 0.02716714143753052, "deviation-heading": 1.4172430670686489, "set_robot_commands": 0.009108448028564453, "deviation-center-line": 0.17834727212359194, "driven_lanedir_consec": 0.2185056516879511, "sim_compute_sim_state": 0.005083560943603516, "sim_compute_performance-ego": 0.007670466105143229, "sim_compute_robot_state-ego": 0.009117289384206136}}
set_robot_commands_max	0.013158713777860006
set_robot_commands_mean	0.008950825211329339
set_robot_commands_median	0.009108448028564453
set_robot_commands_min	0.005622172966981545
sim_compute_performance-ego_max	0.00869123637676239
sim_compute_performance-ego_mean	0.0066298478841781625
sim_compute_performance-ego_median	0.00701444149017334
sim_compute_performance-ego_min	0.0045131230965638775
sim_compute_robot_state-ego_max	0.012385313709576923
sim_compute_robot_state-ego_mean	0.008884577093980254
sim_compute_robot_state-ego_median	0.009117289384206136
sim_compute_robot_state-ego_min	0.005852308028783553
sim_compute_sim_state_max	0.007416884104410808
sim_compute_sim_state_mean	0.0050953376598847225
sim_compute_sim_state_median	0.005083560943603516
sim_compute_sim_state_min	0.003260019497993665
sim_physics_max	0.17623795568943024
sim_physics_mean	0.10900324502052404
sim_physics_median	0.1012598196665446
sim_physics_min	0.06324388430668758
sim_render-ego_max	0.015887464086214702
sim_render-ego_mean	0.011682923588997278
sim_render-ego_median	0.01224595308303833
sim_render-ego_min	0.00821358118301783
simulation-passed	1
survival_time_max	2.9999999999999973
survival_time_mean	1.9299999999999995
survival_time_min	1.0000000000000002

No reset possible

24889

4257

Anastasiya Nikolskaya 🇷🇺

beta

aido3-LF-sim-validation

step1-simulation

success

ip-172-31-43-40-10496

2019-11-04 08:00:50+00:00

2019-11-04 08:12:03+00:00

0:11:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.2000625805113874
survival_time_median	11.100000000000025
deviation-center-line_median	0.45118510675660567
in-drivable-lane_median	1.8500000000000263

other stats

agent_compute-ego_max	0.09025864971821385
agent_compute-ego_mean	0.08065985060791032
agent_compute-ego_median	0.08409303480440432
agent_compute-ego_min	0.06542009072338077
deviation-center-line_max	0.6822477541856111
deviation-center-line_mean	0.4517987749568686
deviation-center-line_min	0.2553909263425883
deviation-heading_max	3.3457439677626497
deviation-heading_mean	1.547931363996589
deviation-heading_median	0.885898125468073
deviation-heading_min	0.6092870615286452
driven_any_max	1.7150586734592337
driven_any_mean	1.3156290886705064
driven_any_median	1.603648639927221
driven_any_min	0.4732068400459073
driven_lanedir_consec_max	1.658980341547842
driven_lanedir_consec_mean	1.0273250217550338
driven_lanedir_consec_min	0.4664175966631885
driven_lanedir_max	1.658980341547842
driven_lanedir_mean	1.0289068013760976
driven_lanedir_median	1.2000625805113874
driven_lanedir_min	0.4664175966631885
in-drivable-lane_max	2.6500000000000377
in-drivable-lane_mean	1.410000000000011
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0977757526212435, "sim_physics": 0.0760476366221476, "survival_time": 6.949999999999983, "driven_lanedir": 0.6104474907091433, "sim_render-ego": 0.009105936228800165, "in-drivable-lane": 2.549999999999991, "agent_compute-ego": 0.06542009072338077, "deviation-heading": 0.8524439715146899, "set_robot_commands": 0.006777410026934507, "deviation-center-line": 0.2553909263425883, "driven_lanedir_consec": 0.6101904419977657, "sim_compute_sim_state": 0.003681791772087701, "sim_compute_performance-ego": 0.005464948338570355, "sim_compute_robot_state-ego": 0.0066087486074982785}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.6884555372989267, "sim_physics": 0.09128783464431764, "survival_time": 14.950000000000076, "driven_lanedir": 1.658980341547842, "sim_render-ego": 0.01065926472345988, "in-drivable-lane": 0, "agent_compute-ego": 0.07678348620732625, "deviation-heading": 2.046283693708887, "set_robot_commands": 0.008482554753621419, "deviation-center-line": 0.6822477541856111, "driven_lanedir_consec": 1.658980341547842, "sim_compute_sim_state": 0.0047128637631734215, "sim_compute_performance-ego": 0.006204094886779785, "sim_compute_robot_state-ego": 0.00793198029200236}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.4732068400459073, "sim_physics": 0.11409786079503312, "survival_time": 3.949999999999994, "driven_lanedir": 0.4664175966631885, "sim_render-ego": 0.01186037968985642, "in-drivable-lane": 0, "agent_compute-ego": 0.08674399158622645, "deviation-heading": 0.6092870615286452, "set_robot_commands": 0.009445579746101477, "deviation-center-line": 0.45118510675660567, "driven_lanedir_consec": 0.4664175966631885, "sim_compute_sim_state": 0.004900168768967254, "sim_compute_performance-ego": 0.0069265637216688715, "sim_compute_robot_state-ego": 0.008591030217424224}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.7150586734592337, "sim_physics": 0.10403313653629156, "survival_time": 14.150000000000066, "driven_lanedir": 1.208625997448927, "sim_render-ego": 0.01180956304705185, "in-drivable-lane": 2.6500000000000377, "agent_compute-ego": 0.09025864971821385, "deviation-heading": 3.3457439677626497, "set_robot_commands": 0.009774912372494756, "deviation-center-line": 0.5016017551357039, "driven_lanedir_consec": 1.2009741480549851, "sim_compute_sim_state": 0.0050907994327612565, "sim_compute_performance-ego": 0.0071879284120701225, "sim_compute_robot_state-ego": 0.009174108505249023}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.603648639927221, "sim_physics": 0.10699471374889752, "survival_time": 11.100000000000025, "driven_lanedir": 1.2000625805113874, "sim_render-ego": 0.011727325551144712, "in-drivable-lane": 1.8500000000000263, "agent_compute-ego": 0.08409303480440432, "deviation-heading": 0.885898125468073, "set_robot_commands": 0.008932400394130397, "deviation-center-line": 0.3685683323638342, "driven_lanedir_consec": 1.2000625805113874, "sim_compute_sim_state": 0.00477349328565168, "sim_compute_performance-ego": 0.006701640180639319, "sim_compute_robot_state-ego": 0.008749722360490679}}
set_robot_commands_max	0.009774912372494756
set_robot_commands_mean	0.00868257145865651
set_robot_commands_median	0.008932400394130397
set_robot_commands_min	0.006777410026934507
sim_compute_performance-ego_max	0.0071879284120701225
sim_compute_performance-ego_mean	0.0064970351079456905
sim_compute_performance-ego_median	0.006701640180639319
sim_compute_performance-ego_min	0.005464948338570355
sim_compute_robot_state-ego_max	0.009174108505249023
sim_compute_robot_state-ego_mean	0.008211117996532912
sim_compute_robot_state-ego_median	0.008591030217424224
sim_compute_robot_state-ego_min	0.0066087486074982785
sim_compute_sim_state_max	0.0050907994327612565
sim_compute_sim_state_mean	0.004631823404528263
sim_compute_sim_state_median	0.00477349328565168
sim_compute_sim_state_min	0.003681791772087701
sim_physics_max	0.11409786079503312
sim_physics_mean	0.09849223646933748
sim_physics_median	0.10403313653629156
sim_physics_min	0.0760476366221476
sim_render-ego_max	0.01186037968985642
sim_render-ego_mean	0.011032493848062604
sim_render-ego_median	0.011727325551144712
sim_render-ego_min	0.009105936228800165
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.22000000000003
survival_time_min	3.949999999999994

No reset possible

24884

4262

Gianmarco Bernasconi

challenge-aido_LF-baseline-duckietown

aido3-LF-sim-validation

step1-simulation

error

ip-172-31-43-40-10496

2019-11-04 07:58:53+00:00

2019-11-04 08:00:20+00:00

0:01:27

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24878

4272

Riza Velioglu 🇩🇪

Uni Bielefeld

aido3-LFV-sim-testing

step1-simulation

error

ip-172-31-43-40-10496

2019-11-04 07:56:59+00:00

2019-11-04 07:58:40+00:00

0:01:41

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24862

4293

Liam Paull 🇨🇦

challenge-aido_LF-template-random

aido3-LF-sim-testing

step1-simulation

success

ip-172-31-43-40-10496

2019-11-04 07:45:25+00:00

2019-11-04 07:56:39+00:00

0:11:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.10099507669212504
in-drivable-lane_median	0.4499999999999984

other stats

agent_compute-ego_max	0.025459009058335248
agent_compute-ego_mean	0.022750911258556328
agent_compute-ego_median	0.022385913056212587
agent_compute-ego_min	0.021007849245655293
deviation-center-line_max	0.28386357003337986
deviation-center-line_mean	0.12786165368054708
deviation-center-line_min	0.07112529346797256
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3391682685652288
deviation-heading_median	0.3292838510353387
deviation-heading_min	0.19401296908406307
driven_any_max	2.1706243860917107
driven_any_mean	0.975949037827615
driven_any_median	1.0117660515775695
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	1.919400421063861
driven_lanedir_consec_mean	0.6896171461819268
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	1.919400421063861
driven_lanedir_mean	0.6896171461819268
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.5899999999999982
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.08823709576218217, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.01090423266092936, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.02439076812179, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.008182658089531792, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.004336882520605017, "sim_compute_performance-ego": 0.0066197095093903716, "sim_compute_robot_state-ego": 0.013308759088869448}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.1042475092644785, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.012001341464472752, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.021084116954429476, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.009647808822931028, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.004857671027090035, "sim_compute_performance-ego": 0.007340239543540805, "sim_compute_robot_state-ego": 0.00888672529482374}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.19570356256821575, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.015612419913796818, "in-drivable-lane": 0, "agent_compute-ego": 0.025459009058335248, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.01299576198353487, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.006641387939453125, "sim_compute_performance-ego": 0.008666683645809399, "sim_compute_robot_state-ego": 0.010704475290635052}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.11446792602539065, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.01251248359680176, "in-drivable-lane": 0, "agent_compute-ego": 0.02320871353149414, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.010020017623901367, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.005611991882324219, "sim_compute_performance-ego": 0.007633237838745117, "sim_compute_robot_state-ego": 0.009114961624145507}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6182144577009443, "sim_physics": 0.11615955376926856, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.012034229085415224, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.02333818508099906, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.009221520604966562, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.004836281643638128, "sim_compute_performance-ego": 0.007313535183290892, "sim_compute_robot_state-ego": 0.00937957703312741}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.003851495683299, "sim_physics": 0.11252908317410217, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735949, "sim_render-ego": 0.0118592271999437, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.021007849245655293, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.009047907225939691, "deviation-center-line": 0.08968283443958694, "driven_lanedir_consec": 0.7531703123735949, "sim_compute_sim_state": 0.004672867911202567, "sim_compute_performance-ego": 0.006813200152650171, "sim_compute_robot_state-ego": 0.0086246023372728}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504386, "sim_physics": 0.1405517884663173, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.013658685343606132, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.024970459086554393, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.01065159695489066, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.0062558821269444054, "sim_compute_performance-ego": 0.007996354784284319, "sim_compute_robot_state-ego": 0.011121779680252075}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.11041472071693056, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.02386627878461565, "in-drivable-lane": 0, "agent_compute-ego": 0.02219095684233166, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.010000648952665784, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.005215133939470563, "sim_compute_performance-ego": 0.007208347320556641, "sim_compute_robot_state-ego": 0.00930349032084147}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510794, "sim_physics": 0.1190134105035814, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.011884022567231776, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.022340451256703524, "deviation-heading": 0.3292838510353387, "set_robot_commands": 0.00917958000958976, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.004807205523474742, "sim_compute_performance-ego": 0.007562572673215705, "sim_compute_robot_state-ego": 0.00911855697631836}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.043548155325732, "sim_physics": 0.10237730199640448, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.015180670131336558, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.021363189003684304, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.00891156630082564, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.004936270280317827, "sim_compute_performance-ego": 0.0064634973352605644, "sim_compute_robot_state-ego": 0.0085403095592152}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193285, "sim_physics": 0.12361783485908012, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848785, "sim_render-ego": 0.01467294507212453, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.022385913056212587, "deviation-heading": 0.35668107106767694, "set_robot_commands": 0.009588483092072725, "deviation-center-line": 0.2251391443608223, "driven_lanedir_consec": 1.1042463557848785, "sim_compute_sim_state": 0.004683225185840161, "sim_compute_performance-ego": 0.006809296546044287, "sim_compute_robot_state-ego": 0.008747664364901457}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.15573449645723617, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.014704917158399307, "in-drivable-lane": 0, "agent_compute-ego": 0.02422917740685599, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.010145212922777447, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.005739714418138776, "sim_compute_performance-ego": 0.007667294570377895, "sim_compute_robot_state-ego": 0.010488195078713554}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775695, "sim_physics": 0.08794210003871544, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.01154810307072658, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.021172383252312157, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.008692147685032264, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.00490726676641726, "sim_compute_performance-ego": 0.006747577704635321, "sim_compute_robot_state-ego": 0.007549697277592677}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.10371816599810564, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.012453891612865309, "in-drivable-lane": 0, "agent_compute-ego": 0.022844597145363136, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.008847236633300781, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.0043675899505615234, "sim_compute_performance-ego": 0.006809208128187392, "sim_compute_robot_state-ego": 0.008577594050654658}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.09814520209443336, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063861, "sim_render-ego": 0.011235926665511788, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.021277899835623948, "deviation-heading": 0.5178939525116448, "set_robot_commands": 0.008470294522304161, "deviation-center-line": 0.28386357003337986, "driven_lanedir_consec": 1.919400421063861, "sim_compute_sim_state": 0.0044420279708563114, "sim_compute_performance-ego": 0.006987181364321241, "sim_compute_robot_state-ego": 0.008652867055406757}}
set_robot_commands_max	0.01299576198353487
set_robot_commands_mean	0.00957349609495097
set_robot_commands_median	0.009221520604966562
set_robot_commands_min	0.008182658089531792
sim_compute_performance-ego_max	0.008666683645809399
sim_compute_performance-ego_mean	0.007242529086687341
sim_compute_performance-ego_median	0.007208347320556641
sim_compute_performance-ego_min	0.0064634973352605644
sim_compute_robot_state-ego_max	0.013308759088869448
sim_compute_robot_state-ego_mean	0.00947461700218468
sim_compute_robot_state-ego_median	0.009114961624145507
sim_compute_robot_state-ego_min	0.007549697277592677
sim_compute_sim_state_max	0.006641387939453125
sim_compute_sim_state_mean	0.005087426605755644
sim_compute_sim_state_median	0.004857671027090035
sim_compute_sim_state_min	0.004336882520605017
sim_physics_max	0.19570356256821575
sim_physics_mean	0.11819065011296284
sim_physics_median	0.11252908317410217
sim_physics_min	0.08794210003871544
sim_render-ego_max	0.02386627878461565
sim_render-ego_mean	0.01360862495518515
sim_render-ego_median	0.012453891612865309
sim_render-ego_min	0.01090423266092936
simulation-passed	1
survival_time_max	5.09999999999999
survival_time_mean	2.503333333333331
survival_time_min	0.8500000000000002

No reset possible

24856

4299

Liam Paull 🇨🇦

challenge-aido_LF-template-random

aido3-LFVI-sim-validation

step1-simulation

success

ip-172-31-43-40-10496

2019-11-04 07:39:02+00:00

2019-11-04 07:45:10+00:00

0:06:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.493517638549009
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09791133281082
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.023666313716343472
agent_compute-ego_mean	0.022139796628233295
agent_compute-ego_median	0.022337559357430172
agent_compute-ego_min	0.02058319818405878
deviation-center-line_max	0.2348196785686717
deviation-center-line_mean	0.1354748199226606
deviation-center-line_min	0.06216029860587694
deviation-heading_max	0.8115272458314912
deviation-heading_mean	0.49959867397150814
deviation-heading_median	0.46504862964833654
deviation-heading_min	0.30044835691402494
driven_any_max	2.1864003300000703
driven_any_mean	1.1068208197848537
driven_any_median	0.9410513078477728
driven_any_min	0.34749292376309954
driven_lanedir_consec_max	1.8262319453635671
driven_lanedir_consec_mean	0.8047440134491037
driven_lanedir_consec_min	0.3325249708009643
driven_lanedir_max	1.8262319453635671
driven_lanedir_mean	0.8048281473204828
driven_lanedir_median	0.493517638549009
driven_lanedir_min	0.3325249708009643
in-drivable-lane_max	1.3499999999999952
in-drivable-lane_mean	0.5599999999999984
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.1823360225822352, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.011560352542732336, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.022416307956357545, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.008961719802663297, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.004423219946366322, "sim_compute_performance-ego": 0.006711214403562908, "sim_compute_robot_state-ego": 0.0083930552760257, "sim_compute_robot_state-npc0": 0.007884451105624815, "sim_compute_robot_state-npc1": 0.007369107837918438, "sim_compute_robot_state-npc2": 0.007507897630522523, "sim_compute_robot_state-npc3": 0.007374437549446202}, "udem1-1-0": {"driven_any": 0.47798123795353264, "sim_physics": 0.182495151247297, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.013147413730621338, "in-drivable-lane": 0, "agent_compute-ego": 0.023666313716343472, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.00876828602382115, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.004602934632982526, "sim_compute_performance-ego": 0.006791165896824428, "sim_compute_robot_state-ego": 0.008984931877681188, "sim_compute_robot_state-npc0": 0.009306745869772776, "sim_compute_robot_state-npc1": 0.00827209438596453, "sim_compute_robot_state-npc2": 0.008564318929399763, "sim_compute_robot_state-npc3": 0.007807910442352295}, "udem1-2-0": {"driven_any": 2.1864003300000703, "sim_physics": 0.1827833768233512, "survival_time": 5.14999999999999, "driven_lanedir": 1.8262319453635671, "sim_render-ego": 0.01184478778283573, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.022337559357430172, "deviation-heading": 0.8115272458314912, "set_robot_commands": 0.009179330566554391, "deviation-center-line": 0.19273160416094068, "driven_lanedir_consec": 1.8262319453635671, "sim_compute_sim_state": 0.004701054211959098, "sim_compute_performance-ego": 0.006931103548957306, "sim_compute_robot_state-ego": 0.008407018717052867, "sim_compute_robot_state-npc0": 0.00846087585375147, "sim_compute_robot_state-npc1": 0.008236359624029363, "sim_compute_robot_state-npc2": 0.008028375292287289, "sim_compute_robot_state-npc3": 0.007872711107568833}, "udem1-3-0": {"driven_any": 0.9410513078477728, "sim_physics": 0.19702411194642383, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.011584003766377768, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.02169560392697652, "deviation-heading": 0.35154027506548413, "set_robot_commands": 0.008404518167177836, "deviation-center-line": 0.08975118546699376, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.004261930783589681, "sim_compute_performance-ego": 0.00683760146299998, "sim_compute_robot_state-ego": 0.008124416073163351, "sim_compute_robot_state-npc0": 0.008280619978904724, "sim_compute_robot_state-npc1": 0.007723396023114522, "sim_compute_robot_state-npc2": 0.00763586163520813, "sim_compute_robot_state-npc3": 0.0071725199619929}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.1532724584851946, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.01123025303795224, "in-drivable-lane": 0, "agent_compute-ego": 0.02058319818405878, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.008566197894868396, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.0041429996490478516, "sim_compute_performance-ego": 0.005785885311308361, "sim_compute_robot_state-ego": 0.007015693755376907, "sim_compute_robot_state-npc0": 0.007697275706699916, "sim_compute_robot_state-npc1": 0.007216283253261021, "sim_compute_robot_state-npc2": 0.007258676347278413, "sim_compute_robot_state-npc3": 0.006702377682640439}}
set_robot_commands_max	0.009179330566554391
set_robot_commands_mean	0.008776010491017014
set_robot_commands_median	0.00876828602382115
set_robot_commands_min	0.008404518167177836
sim_compute_performance-ego_max	0.006931103548957306
sim_compute_performance-ego_mean	0.006611394124730596
sim_compute_performance-ego_median	0.006791165896824428
sim_compute_performance-ego_min	0.005785885311308361
sim_compute_robot_state-ego_max	0.008984931877681188
sim_compute_robot_state-ego_mean	0.008185023139860003
sim_compute_robot_state-ego_median	0.0083930552760257
sim_compute_robot_state-ego_min	0.007015693755376907
sim_compute_robot_state-npc0_max	0.009306745869772776
sim_compute_robot_state-npc0_mean	0.00832599370295074
sim_compute_robot_state-npc0_median	0.008280619978904724
sim_compute_robot_state-npc0_min	0.007697275706699916
sim_compute_robot_state-npc1_max	0.00827209438596453
sim_compute_robot_state-npc1_mean	0.0077634482248575745
sim_compute_robot_state-npc1_median	0.007723396023114522
sim_compute_robot_state-npc1_min	0.007216283253261021
sim_compute_robot_state-npc2_max	0.008564318929399763
sim_compute_robot_state-npc2_mean	0.0077990259669392225
sim_compute_robot_state-npc2_median	0.00763586163520813
sim_compute_robot_state-npc2_min	0.007258676347278413
sim_compute_robot_state-npc3_max	0.007872711107568833
sim_compute_robot_state-npc3_mean	0.007385991348800133
sim_compute_robot_state-npc3_median	0.007374437549446202
sim_compute_robot_state-npc3_min	0.006702377682640439
sim_compute_sim_state_max	0.004701054211959098
sim_compute_sim_state_mean	0.004426427844789096
sim_compute_sim_state_median	0.004423219946366322
sim_compute_sim_state_min	0.0041429996490478516
sim_physics_max	0.19702411194642383
sim_physics_mean	0.17958222421690037
sim_physics_median	0.182495151247297
sim_physics_min	0.1532724584851946
sim_render-ego_max	0.013147413730621338
sim_render-ego_mean	0.011873362172103882
sim_render-ego_median	0.011584003766377768
sim_render-ego_min	0.01123025303795224
simulation-passed	1
survival_time_max	5.14999999999999
survival_time_mean	2.789999999999997
survival_time_min	1.0500000000000005

No reset possible

24832

4338

Soroush Saryazdi 🇨🇦

challenge-aido_LF-baseline-duckietown

aido3-LF-sim-testing

step1-simulation

success

ip-172-31-43-40-10496

2019-11-04 07:00:21+00:00

2019-11-04 07:38:03+00:00

0:37:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9678493002711228
survival_time_median	10.550000000000017
deviation-center-line_median	0.5876729912607856
in-drivable-lane_median	0.1999999999999993

other stats

agent_compute-ego_max	0.06165692478559594
agent_compute-ego_mean	0.05283823877240641
agent_compute-ego_median	0.05425735342091528
agent_compute-ego_min	0.030157419840494793
deviation-center-line_max	1.206435769318063
deviation-center-line_mean	0.6129325927132157
deviation-center-line_min	0.14668030989569728
deviation-heading_max	6.964553242987051
deviation-heading_mean	2.5833944277007546
deviation-heading_median	2.563556804835879
deviation-heading_min	0.5954805669268937
driven_any_max	2.349122828591598
driven_any_mean	1.5250481863493983
driven_any_median	1.6416753791408347
driven_any_min	0.44455709420393497
driven_lanedir_consec_max	2.3051522085687135
driven_lanedir_consec_mean	1.1359128082268206
driven_lanedir_consec_min	0.4199192816400523
driven_lanedir_max	2.3051522085687135
driven_lanedir_mean	1.2486244645479592
driven_lanedir_median	1.038705692493051
driven_lanedir_min	0.4199192816400523
in-drivable-lane_max	3.749999999999993
in-drivable-lane_mean	0.98666666666667
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5414005934519953, "sim_physics": 0.11474267641703288, "survival_time": 3.7499999999999942, "driven_lanedir": 0.4717595642465424, "sim_render-ego": 0.012591244379679362, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.030157419840494793, "deviation-heading": 1.0644516571271736, "set_robot_commands": 0.011165558497111002, "deviation-center-line": 0.2198275526070572, "driven_lanedir_consec": 0.4717595642465424, "sim_compute_sim_state": 0.005810708999633789, "sim_compute_performance-ego": 0.008071123758951823, "sim_compute_robot_state-ego": 0.009249537785847984}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3490795062900296, "sim_physics": 0.12816690921783447, "survival_time": 14.950000000000076, "driven_lanedir": 2.15006547421413, "sim_render-ego": 0.013848530451456703, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.05169787883758545, "deviation-heading": 3.044783756604869, "set_robot_commands": 0.011370387077331545, "deviation-center-line": 0.8974010824193382, "driven_lanedir_consec": 2.15006547421413, "sim_compute_sim_state": 0.005813005765279134, "sim_compute_performance-ego": 0.00816459814707438, "sim_compute_robot_state-ego": 0.010719817479451495}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3487036932801995, "sim_physics": 0.12192771434783936, "survival_time": 14.950000000000076, "driven_lanedir": 1.6978095157096922, "sim_render-ego": 0.013582889238993328, "in-drivable-lane": 1.9000000000000128, "agent_compute-ego": 0.05504581610361735, "deviation-heading": 6.168532481367868, "set_robot_commands": 0.0110443647702535, "deviation-center-line": 1.058285634249329, "driven_lanedir_consec": 0.8574498561313519, "sim_compute_sim_state": 0.005688777764638265, "sim_compute_performance-ego": 0.008199305534362792, "sim_compute_robot_state-ego": 0.009930598735809324}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1115337977408548, "sim_physics": 0.1240617505435286, "survival_time": 7.249999999999982, "driven_lanedir": 1.038705692493051, "sim_render-ego": 0.01363682253607388, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.05425735342091528, "deviation-heading": 1.693090585397521, "set_robot_commands": 0.010865893857232457, "deviation-center-line": 0.29508376652849966, "driven_lanedir_consec": 1.038705692493051, "sim_compute_sim_state": 0.0053704278222445785, "sim_compute_performance-ego": 0.007813429010325465, "sim_compute_robot_state-ego": 0.010108559707115435}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.348397526116429, "sim_physics": 0.1271804181734721, "survival_time": 14.950000000000076, "driven_lanedir": 1.4214174591772286, "sim_render-ego": 0.013442290623982748, "in-drivable-lane": 3.000000000000014, "agent_compute-ego": 0.05484844923019409, "deviation-heading": 6.964553242987051, "set_robot_commands": 0.010878881613413494, "deviation-center-line": 1.08679645652083, "driven_lanedir_consec": 0.8814486897605391, "sim_compute_sim_state": 0.005397411187489828, "sim_compute_performance-ego": 0.008065289656321207, "sim_compute_robot_state-ego": 0.010383965174357097}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.6659058112786085, "sim_physics": 0.11198221857302657, "survival_time": 10.700000000000015, "driven_lanedir": 1.1748117926814774, "sim_render-ego": 0.013079408173249148, "in-drivable-lane": 2.2500000000000107, "agent_compute-ego": 0.051770251488017144, "deviation-heading": 2.7966390478081538, "set_robot_commands": 0.010031061751820216, "deviation-center-line": 0.6878055734824308, "driven_lanedir_consec": 1.098914336172315, "sim_compute_sim_state": 0.00528952785741503, "sim_compute_performance-ego": 0.007652297198215378, "sim_compute_robot_state-ego": 0.009494417181638914}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.4847287479704644, "sim_physics": 0.12780568137097714, "survival_time": 3.349999999999996, "driven_lanedir": 0.4447782718102222, "sim_render-ego": 0.014584537762314526, "in-drivable-lane": 0, "agent_compute-ego": 0.056863560605404984, "deviation-heading": 0.7622228084291147, "set_robot_commands": 0.010605296092246896, "deviation-center-line": 0.14668030989569728, "driven_lanedir_consec": 0.4447782718102222, "sim_compute_sim_state": 0.0056294754369935, "sim_compute_performance-ego": 0.008304421581439118, "sim_compute_robot_state-ego": 0.010006506051590194}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.320351237645201, "sim_physics": 0.14341741835164745, "survival_time": 8.549999999999986, "driven_lanedir": 0.9678493002711228, "sim_render-ego": 0.013770590051572922, "in-drivable-lane": 1.1500000000000004, "agent_compute-ego": 0.05964336757771453, "deviation-heading": 2.8649819041923887, "set_robot_commands": 0.010628380970648155, "deviation-center-line": 0.5316823978708026, "driven_lanedir_consec": 0.9678493002711228, "sim_compute_sim_state": 0.005487592596756785, "sim_compute_performance-ego": 0.008205233958729526, "sim_compute_robot_state-ego": 0.010688900250440453}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.349122828591598, "sim_physics": 0.12388256311416626, "survival_time": 14.950000000000076, "driven_lanedir": 2.3051522085687135, "sim_render-ego": 0.0131218687693278, "in-drivable-lane": 0, "agent_compute-ego": 0.05163531939188639, "deviation-heading": 2.449311676493328, "set_robot_commands": 0.010550264517466228, "deviation-center-line": 0.6298875818700024, "driven_lanedir_consec": 2.3051522085687135, "sim_compute_sim_state": 0.005442810853322347, "sim_compute_performance-ego": 0.007960741519927978, "sim_compute_robot_state-ego": 0.009942675431569415}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.44455709420393497, "sim_physics": 0.10929319935460244, "survival_time": 3.099999999999997, "driven_lanedir": 0.4199192816400523, "sim_render-ego": 0.013612362646287488, "in-drivable-lane": 0, "agent_compute-ego": 0.05468184717239872, "deviation-heading": 0.5954805669268937, "set_robot_commands": 0.009441414187031408, "deviation-center-line": 0.233237148210792, "driven_lanedir_consec": 0.4199192816400523, "sim_compute_sim_state": 0.005081903549932664, "sim_compute_performance-ego": 0.007529570210364557, "sim_compute_robot_state-ego": 0.008940204497306578}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.0633138269280895, "sim_physics": 0.1006343947897712, "survival_time": 6.949999999999983, "driven_lanedir": 1.007336116415567, "sim_render-ego": 0.011617403236224497, "in-drivable-lane": 0, "agent_compute-ego": 0.04878250471979594, "deviation-heading": 1.4742937755685903, "set_robot_commands": 0.009668348504484989, "deviation-center-line": 0.5876729912607856, "driven_lanedir_consec": 1.007336116415567, "sim_compute_sim_state": 0.004745999686151957, "sim_compute_performance-ego": 0.006746943906056796, "sim_compute_robot_state-ego": 0.008584574829760215}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.5088346908442202, "sim_physics": 0.1144057273864746, "survival_time": 3.4999999999999956, "driven_lanedir": 0.4508064706842462, "sim_render-ego": 0.0121546813419887, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.055715084075927734, "deviation-heading": 0.6877257153717072, "set_robot_commands": 0.010154223442077635, "deviation-center-line": 0.2414540703039759, "driven_lanedir_consec": 0.4508064706842462, "sim_compute_sim_state": 0.005149258886064802, "sim_compute_performance-ego": 0.007906903539385115, "sim_compute_robot_state-ego": 0.009485551289149694}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.6416753791408347, "sim_physics": 0.12226746997562064, "survival_time": 10.550000000000017, "driven_lanedir": 0.9094887650922646, "sim_render-ego": 0.014308875205957496, "in-drivable-lane": 3.749999999999993, "agent_compute-ego": 0.06165692478559594, "deviation-heading": 2.6129431767427302, "set_robot_commands": 0.010612201916663002, "deviation-center-line": 0.3662812998449105, "driven_lanedir_consec": 0.7910853800084973, "sim_compute_sim_state": 0.005749937482354766, "sim_compute_performance-ego": 0.0084538584071878, "sim_compute_robot_state-ego": 0.010286592194254363}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.34910609688729, "sim_physics": 0.12364477396011352, "survival_time": 14.950000000000076, "driven_lanedir": 2.293229002024358, "sim_render-ego": 0.01355124553044637, "in-drivable-lane": 0, "agent_compute-ego": 0.051758445898691816, "deviation-heading": 2.563556804835879, "set_robot_commands": 0.010846011638641358, "deviation-center-line": 1.0054572563157207, "driven_lanedir_consec": 2.293229002024358, "sim_compute_sim_state": 0.005454891522725423, "sim_compute_performance-ego": 0.00804336150487264, "sim_compute_robot_state-ego": 0.010037654240926107}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.349011964871223, "sim_physics": 0.12143835385640464, "survival_time": 14.950000000000076, "driven_lanedir": 1.9762380531907215, "sim_render-ego": 0.0129843274752299, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.05405935843785604, "deviation-heading": 3.0083492156580536, "set_robot_commands": 0.010257260004679362, "deviation-center-line": 1.206435769318063, "driven_lanedir_consec": 1.8601924789616004, "sim_compute_sim_state": 0.005124875704447428, "sim_compute_performance-ego": 0.007902819315592448, "sim_compute_robot_state-ego": 0.009865082105000814}}
set_robot_commands_max	0.011370387077331545
set_robot_commands_mean	0.010541303256073416
set_robot_commands_median	0.010612201916663002
set_robot_commands_min	0.009441414187031408
sim_compute_performance-ego_max	0.0084538584071878
sim_compute_performance-ego_mean	0.007934659816587135
sim_compute_performance-ego_median	0.00804336150487264
sim_compute_performance-ego_min	0.006746943906056796
sim_compute_robot_state-ego_max	0.010719817479451495
sim_compute_robot_state-ego_mean	0.009848309130281207
sim_compute_robot_state-ego_median	0.009942675431569415
sim_compute_robot_state-ego_min	0.008584574829760215
sim_compute_sim_state_max	0.005813005765279134
sim_compute_sim_state_mean	0.005415773674363353
sim_compute_sim_state_median	0.005442810853322347
sim_compute_sim_state_min	0.004745999686151957
sim_physics_max	0.14341741835164745
sim_physics_mean	0.12099008462883412
sim_physics_median	0.12226746997562064
sim_physics_min	0.1006343947897712
sim_render-ego_max	0.014584537762314526
sim_render-ego_mean	0.013325805161518992
sim_render-ego_median	0.01355124553044637
sim_render-ego_min	0.011617403236224497
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	9.826666666666696
survival_time_min	3.099999999999997

No reset possible

24816

4315

Tanli Chou 🇹🇼

challenge-aido_LF-template-random

aido3-LF-sim-validation

step1-simulation

error

ip-172-31-43-40-10496

2019-11-04 06:54:14+00:00

2019-11-04 07:00:13+00:00

0:05:59

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24809

4339

Soroush Saryazdi 🇨🇦

challenge-aido_LF-baseline-duckietown

aido3-LF-sim-validation

step1-simulation

success

ip-172-31-43-40-10496

2019-11-02 17:34:47+00:00

2019-11-02 17:50:59+00:00

0:16:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.1717830465018138
survival_time_median	8.549999999999986
deviation-center-line_median	0.3854176381487993
in-drivable-lane_median	1.3499999999999952

other stats

agent_compute-ego_max	0.05824853988464721
agent_compute-ego_mean	0.05127367993075049
agent_compute-ego_median	0.055037415822347
agent_compute-ego_min	0.03418431819324762
deviation-center-line_max	1.004852983614262
deviation-center-line_mean	0.5568652201916586
deviation-center-line_min	0.1879064064957225
deviation-heading_max	6.225690513126786
deviation-heading_mean	3.2792054574495353
deviation-heading_median	2.061723970623892
deviation-heading_min	0.8732320190101072
driven_any_max	2.3486210397874214
driven_any_mean	1.5533862829310785
driven_any_median	1.320469286930758
driven_any_min	0.509210866787038
driven_lanedir_consec_max	1.420546114226993
driven_lanedir_consec_mean	1.000772873166135
driven_lanedir_consec_min	0.3983388626937745
driven_lanedir_max	1.7229710522581692
driven_lanedir_mean	1.1152763454358685
driven_lanedir_median	1.1717830465018138
driven_lanedir_min	0.3983388626937745
in-drivable-lane_max	3.84999999999999
in-drivable-lane_mean	1.6700000000000046
in-drivable-lane_min	0.30000000000000426
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.509210866787038, "sim_physics": 0.13716964654519526, "survival_time": 3.5499999999999954, "driven_lanedir": 0.3983388626937745, "sim_render-ego": 0.01538490913283657, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.03418431819324762, "deviation-heading": 0.8732320190101072, "set_robot_commands": 0.011791655715082732, "deviation-center-line": 0.1879064064957225, "driven_lanedir_consec": 0.3983388626937745, "sim_compute_sim_state": 0.006356578477671448, "sim_compute_performance-ego": 0.009065345979072678, "sim_compute_robot_state-ego": 0.010946357753914846}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.320469286930758, "sim_physics": 0.12323916864673994, "survival_time": 8.549999999999986, "driven_lanedir": 0.6131711428750393, "sim_render-ego": 0.015430065623500891, "in-drivable-lane": 3.84999999999999, "agent_compute-ego": 0.0529828197077701, "deviation-heading": 1.7550977700478965, "set_robot_commands": 0.010483244009185256, "deviation-center-line": 0.25481622722860464, "driven_lanedir_consec": 0.6131711428750393, "sim_compute_sim_state": 0.005426268828542609, "sim_compute_performance-ego": 0.007881659513328507, "sim_compute_robot_state-ego": 0.010807489093981291}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3486210397874214, "sim_physics": 0.11175135215123494, "survival_time": 14.950000000000076, "driven_lanedir": 1.670117622850546, "sim_render-ego": 0.01381547212600708, "in-drivable-lane": 2.5000000000000355, "agent_compute-ego": 0.055037415822347, "deviation-heading": 5.480283014438994, "set_robot_commands": 0.00997657299041748, "deviation-center-line": 0.9513328454709046, "driven_lanedir_consec": 1.420546114226993, "sim_compute_sim_state": 0.0055384079615275065, "sim_compute_performance-ego": 0.00796767791112264, "sim_compute_robot_state-ego": 0.010386533737182615}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3004070027261614, "sim_physics": 0.10752619980952031, "survival_time": 14.650000000000071, "driven_lanedir": 1.7229710522581692, "sim_render-ego": 0.013866940456038855, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.055915306045740534, "deviation-heading": 6.225690513126786, "set_robot_commands": 0.009725047459781372, "deviation-center-line": 1.004852983614262, "driven_lanedir_consec": 1.4000251995330544, "sim_compute_sim_state": 0.005649068656634959, "sim_compute_performance-ego": 0.00777872918815743, "sim_compute_robot_state-ego": 0.010219766825132403}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2882232184240132, "sim_physics": 0.11930485114365996, "survival_time": 8.349999999999984, "driven_lanedir": 1.1717830465018138, "sim_render-ego": 0.014332886941418675, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.05824853988464721, "deviation-heading": 2.061723970623892, "set_robot_commands": 0.010056164450274256, "deviation-center-line": 0.3854176381487993, "driven_lanedir_consec": 1.1717830465018138, "sim_compute_sim_state": 0.0056829752322442514, "sim_compute_performance-ego": 0.00816111507529984, "sim_compute_robot_state-ego": 0.010565196682593066}}
set_robot_commands_max	0.011791655715082732
set_robot_commands_mean	0.01040653692494822
set_robot_commands_median	0.010056164450274256
set_robot_commands_min	0.009725047459781372
sim_compute_performance-ego_max	0.009065345979072678
sim_compute_performance-ego_mean	0.008170905533396219
sim_compute_performance-ego_median	0.00796767791112264
sim_compute_performance-ego_min	0.00777872918815743
sim_compute_robot_state-ego_max	0.010946357753914846
sim_compute_robot_state-ego_mean	0.010585068818560844
sim_compute_robot_state-ego_median	0.010565196682593066
sim_compute_robot_state-ego_min	0.010219766825132403
sim_compute_sim_state_max	0.006356578477671448
sim_compute_sim_state_mean	0.005730659831324154
sim_compute_sim_state_median	0.005649068656634959
sim_compute_sim_state_min	0.005426268828542609
sim_physics_max	0.13716964654519526
sim_physics_mean	0.11979824365927008
sim_physics_median	0.11930485114365996
sim_physics_min	0.10752619980952031
sim_render-ego_max	0.015430065623500891
sim_render-ego_mean	0.014566054855960414
sim_render-ego_median	0.014332886941418675
sim_render-ego_min	0.01381547212600708
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.010000000000025
survival_time_min	3.5499999999999954

No reset possible

24787

4333

Soroush Saryazdi 🇨🇦

challenge-aido_LF-template-random

aido3-LFV-sim-validation

step1-simulation

success

ip-172-31-43-40-10496

2019-11-02 16:24:23+00:00

2019-11-02 16:32:48+00:00

0:08:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.6999999999999984
deviation-center-line_median	0.11519544839797546
in-drivable-lane_median	0.5999999999999979

other stats

agent_compute-ego_max	0.024592024308663828
agent_compute-ego_mean	0.02326169940927113
agent_compute-ego_median	0.02345444679260254
agent_compute-ego_min	0.022336057254246304
deviation-center-line_max	0.17439134565029044
deviation-center-line_mean	0.1265175655253199
deviation-center-line_min	0.09047885846140293
deviation-heading_max	0.5020407942599271
deviation-heading_mean	0.3641979127291371
deviation-heading_median	0.34764983431811225
deviation-heading_min	0.19401296908406307
driven_any_max	1.6169932854589055
driven_any_mean	1.0272530755098268
driven_any_median	1.0243289631429704
driven_any_min	0.4119037580118985
driven_lanedir_consec_max	1.2433038249708372
driven_lanedir_consec_mean	0.7800316850006626
driven_lanedir_consec_min	0.3792793194470208
driven_lanedir_max	1.2433038249708372
driven_lanedir_mean	0.7800316850006626
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.3792793194470208
in-drivable-lane_max	0.9999999999999976
in-drivable-lane_mean	0.4899999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.17584369800708913, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.013782761715076587, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.024592024308663828, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.009561931645428692, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.0056188371446397566, "sim_compute_performance-ego": 0.007512260366369177, "sim_compute_robot_state-ego": 0.010105720272770636, "sim_compute_robot_state-npc0": 0.009392279165762442, "sim_compute_robot_state-npc1": 0.009205381075541178, "sim_compute_robot_state-npc2": 0.008635931544833712, "sim_compute_robot_state-npc3": 0.008499587023699726}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118985, "sim_physics": 0.16890729904174806, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.012617540359497073, "in-drivable-lane": 0, "agent_compute-ego": 0.02345444679260254, "deviation-heading": 0.47860435001913376, "set_robot_commands": 0.00924060821533203, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.005595588684082031, "sim_compute_performance-ego": 0.006790151596069336, "sim_compute_robot_state-ego": 0.008924264907836914, "sim_compute_robot_state-npc0": 0.009049072265625, "sim_compute_robot_state-npc1": 0.008775758743286132, "sim_compute_robot_state-npc2": 0.008651342391967774, "sim_compute_robot_state-npc3": 0.008733587265014648}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.1815438333310579, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708372, "sim_render-ego": 0.011823365562840513, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.023554679594541852, "deviation-heading": 0.5020407942599271, "set_robot_commands": 0.008660489007046348, "deviation-center-line": 0.17439134565029044, "driven_lanedir_consec": 1.2433038249708372, "sim_compute_sim_state": 0.005195169072402151, "sim_compute_performance-ego": 0.006891319626256039, "sim_compute_robot_state-ego": 0.008818362888536956, "sim_compute_robot_state-npc0": 0.008142446216784026, "sim_compute_robot_state-npc1": 0.007698137509195428, "sim_compute_robot_state-npc2": 0.007819793726268568, "sim_compute_robot_state-npc3": 0.008226206428126284}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589055, "sim_physics": 0.1836699413347848, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.01235945013504994, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.022371289096301115, "deviation-heading": 0.34764983431811225, "set_robot_commands": 0.008519984498808655, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.004673686208604257, "sim_compute_performance-ego": 0.006756616544119919, "sim_compute_robot_state-ego": 0.009088259709032275, "sim_compute_robot_state-npc0": 0.008353160906441604, "sim_compute_robot_state-npc1": 0.00774940961523901, "sim_compute_robot_state-npc2": 0.007787674288206463, "sim_compute_robot_state-npc3": 0.007743575904942766}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846434, "sim_physics": 0.13995615073612758, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.012493789196014404, "in-drivable-lane": 0, "agent_compute-ego": 0.022336057254246304, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.008294522762298584, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.004779636859893799, "sim_compute_performance-ego": 0.006633247647966657, "sim_compute_robot_state-ego": 0.008574690137590681, "sim_compute_robot_state-npc0": 0.008459840502057756, "sim_compute_robot_state-npc1": 0.007928831236703055, "sim_compute_robot_state-npc2": 0.007672122546604702, "sim_compute_robot_state-npc3": 0.007744244166782924}}
set_robot_commands_max	0.009561931645428692
set_robot_commands_mean	0.008855507225782861
set_robot_commands_median	0.008660489007046348
set_robot_commands_min	0.008294522762298584
sim_compute_performance-ego_max	0.007512260366369177
sim_compute_performance-ego_mean	0.006916719156156226
sim_compute_performance-ego_median	0.006790151596069336
sim_compute_performance-ego_min	0.006633247647966657
sim_compute_robot_state-ego_max	0.010105720272770636
sim_compute_robot_state-ego_mean	0.009102259583153494
sim_compute_robot_state-ego_median	0.008924264907836914
sim_compute_robot_state-ego_min	0.008574690137590681
sim_compute_robot_state-npc0_max	0.009392279165762442
sim_compute_robot_state-npc0_mean	0.008679359811334164
sim_compute_robot_state-npc0_median	0.008459840502057756
sim_compute_robot_state-npc0_min	0.008142446216784026
sim_compute_robot_state-npc1_max	0.009205381075541178
sim_compute_robot_state-npc1_mean	0.008271503635992963
sim_compute_robot_state-npc1_median	0.007928831236703055
sim_compute_robot_state-npc1_min	0.007698137509195428
sim_compute_robot_state-npc2_max	0.008651342391967774
sim_compute_robot_state-npc2_mean	0.008113372899576244
sim_compute_robot_state-npc2_median	0.007819793726268568
sim_compute_robot_state-npc2_min	0.007672122546604702
sim_compute_robot_state-npc3_max	0.008733587265014648
sim_compute_robot_state-npc3_mean	0.008189440157713269
sim_compute_robot_state-npc3_median	0.008226206428126284
sim_compute_robot_state-npc3_min	0.007743575904942766
sim_compute_sim_state_max	0.0056188371446397566
sim_compute_sim_state_mean	0.005172583593924399
sim_compute_sim_state_median	0.005195169072402151
sim_compute_sim_state_min	0.004673686208604257
sim_physics_max	0.1836699413347848
sim_physics_mean	0.16998418449016148
sim_physics_median	0.17584369800708913
sim_physics_min	0.13995615073612758
sim_render-ego_max	0.013782761715076587
sim_render-ego_mean	0.012615381393695705
sim_render-ego_median	0.012493789196014404
sim_render-ego_min	0.011823365562840513
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.6199999999999974
survival_time_min	1.2500000000000004

No reset possible

24775

4314

Tanli Chou 🇹🇼

challenge-aido_LF-template-random

aido3-LF-sim-testing

step1-simulation

success

ip-172-31-43-40-10496

2019-11-02 06:49:53+00:00

2019-11-02 06:58:53+00:00

0:09:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.10099507669212504
in-drivable-lane_median	0.4499999999999984

other stats

agent_compute-ego_max	0.02125966072082519
agent_compute-ego_mean	0.015736569350075842
agent_compute-ego_median	0.013547905853816442
agent_compute-ego_min	0.01319442075841567
deviation-center-line_max	0.28386357003337986
deviation-center-line_mean	0.12786165368054708
deviation-center-line_min	0.07112529346797256
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3391682685652288
deviation-heading_median	0.3292838510353387
deviation-heading_min	0.19401296908406307
driven_any_max	2.1706243860917107
driven_any_mean	0.975949037827615
driven_any_median	1.0117660515775695
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	1.919400421063861
driven_lanedir_consec_mean	0.6896171461819268
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	1.919400421063861
driven_lanedir_mean	0.6896171461819268
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.5899999999999982
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.07256400143658673, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.009440174809208625, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.01874756371533429, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.00696510738796658, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.0041618479622734916, "sim_compute_performance-ego": 0.005391597747802734, "sim_compute_robot_state-ego": 0.006782006334375452}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.061364454381606155, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.010044009077782724, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.01801308931088915, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.00681909392861759, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.003909265293794519, "sim_compute_performance-ego": 0.005227046854355756, "sim_compute_robot_state-ego": 0.006918846392164044}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.0873414067661061, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.010666230145622702, "in-drivable-lane": 0, "agent_compute-ego": 0.020647581885842717, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.007233998354743509, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.0042881264406092025, "sim_compute_performance-ego": 0.005560608471141142, "sim_compute_robot_state-ego": 0.007618932163014132}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.0941390609741211, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.010980291366577149, "in-drivable-lane": 0, "agent_compute-ego": 0.02125966072082519, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.007492532730102539, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.00414093017578125, "sim_compute_performance-ego": 0.005953302383422851, "sim_compute_robot_state-ego": 0.0077759456634521485}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6182144577009443, "sim_physics": 0.0699901399733145, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.00963217699075047, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.019851630247091943, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.006878095337107212, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.0040517728539961806, "sim_compute_performance-ego": 0.005254262610326839, "sim_compute_robot_state-ego": 0.0066680153713950625}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.003851495683299, "sim_physics": 0.06182967400064274, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735949, "sim_render-ego": 0.008522004497294523, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.01669619521316217, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.005666985803720903, "deviation-center-line": 0.08968283443958694, "driven_lanedir_consec": 0.7531703123735949, "sim_compute_sim_state": 0.003577456182363082, "sim_compute_performance-ego": 0.004552393543476961, "sim_compute_robot_state-ego": 0.006007754072851064}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504386, "sim_physics": 0.04613066145351955, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.006973296403884888, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.013547905853816442, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.0044403076171875, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.0028226758752550396, "sim_compute_performance-ego": 0.003696173429489136, "sim_compute_robot_state-ego": 0.004933672291891915}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.04933779580252511, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.007116249629429409, "in-drivable-lane": 0, "agent_compute-ego": 0.013309626352219354, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.004448277609688895, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.0027844905853271484, "sim_compute_performance-ego": 0.0037326812744140625, "sim_compute_robot_state-ego": 0.004900796072823661}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510794, "sim_physics": 0.048235028477038366, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.007002862833314023, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.01347897820553537, "deviation-heading": 0.3292838510353387, "set_robot_commands": 0.004463616064039327, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.00287085468486204, "sim_compute_performance-ego": 0.0037114135289596298, "sim_compute_robot_state-ego": 0.004958948846590721}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.043548155325732, "sim_physics": 0.051278482783924446, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.007031158967451615, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.013454224846579812, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.0043503457849675955, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.002863203395496715, "sim_compute_performance-ego": 0.003677220778031783, "sim_compute_robot_state-ego": 0.004915592887184837}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193285, "sim_physics": 0.047556254770848655, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848785, "sim_render-ego": 0.0070815550816523565, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.013536372742095551, "deviation-heading": 0.35668107106767694, "set_robot_commands": 0.00448987391087916, "deviation-center-line": 0.2251391443608223, "driven_lanedir_consec": 1.1042463557848785, "sim_compute_sim_state": 0.002782128073952415, "sim_compute_performance-ego": 0.003731173354309875, "sim_compute_robot_state-ego": 0.004918278037727653}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.049393287726811, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.007156567914145333, "in-drivable-lane": 0, "agent_compute-ego": 0.013591391699654716, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.004428863525390625, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.0027680907930646625, "sim_compute_performance-ego": 0.0037254435675484793, "sim_compute_robot_state-ego": 0.004893805299486432}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775695, "sim_physics": 0.0482325740889007, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.007089778488757564, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.01319442075841567, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.004485752068313898, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.0029026573779536227, "sim_compute_performance-ego": 0.003752259647144991, "sim_compute_robot_state-ego": 0.004966324450922948}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.04749784646210847, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.007035626305474175, "in-drivable-lane": 0, "agent_compute-ego": 0.01321746684886791, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.004423247443305122, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.002736550790292245, "sim_compute_performance-ego": 0.00370345292267976, "sim_compute_robot_state-ego": 0.004906901606807002}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.04664739674212886, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063861, "sim_render-ego": 0.006905223809036554, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.01350243185080734, "deviation-heading": 0.5178939525116448, "set_robot_commands": 0.00442051887512207, "deviation-center-line": 0.28386357003337986, "driven_lanedir_consec": 1.919400421063861, "sim_compute_sim_state": 0.002760573929431392, "sim_compute_performance-ego": 0.003718443945342419, "sim_compute_robot_state-ego": 0.004893651195600921}}
set_robot_commands_max	0.007492532730102539
set_robot_commands_mean	0.005400441096076835
set_robot_commands_median	0.004485752068313898
set_robot_commands_min	0.0043503457849675955
sim_compute_performance-ego_max	0.005953302383422851
sim_compute_performance-ego_mean	0.004359164937229762
sim_compute_performance-ego_median	0.0037326812744140625
sim_compute_performance-ego_min	0.003677220778031783
sim_compute_robot_state-ego_max	0.0077759456634521485
sim_compute_robot_state-ego_mean	0.005737298045752532
sim_compute_robot_state-ego_median	0.004958948846590721
sim_compute_robot_state-ego_min	0.004893651195600921
sim_compute_sim_state_max	0.0042881264406092025
sim_compute_sim_state_mean	0.003294708294296867
sim_compute_sim_state_median	0.00287085468486204
sim_compute_sim_state_min	0.002736550790292245
sim_physics_max	0.0941390609741211
sim_physics_mean	0.05876920438934549
sim_physics_median	0.049393287726811
sim_physics_min	0.04613066145351955
sim_render-ego_max	0.010980291366577149
sim_render-ego_mean	0.008178480421358807
sim_render-ego_median	0.007116249629429409
sim_render-ego_min	0.006905223809036554
simulation-passed	1
survival_time_max	5.09999999999999
survival_time_mean	2.503333333333331
survival_time_min	0.8500000000000002

No reset possible

24747

4305

Frank (Chude) Qian 🇨🇦

Frank test submission

aido3-LFV-sim-validation

step1-simulation

success

ip-172-31-43-40-10496

2019-10-31 14:05:44+00:00

2019-10-31 14:12:02+00:00

0:06:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6856800730956207
survival_time_median	2.000000000000001
deviation-center-line_median	0.08877415228107144
in-drivable-lane_median	0.4500000000000002

other stats

agent_compute-ego_max	0.02999800443649292
agent_compute-ego_mean	0.027202041727123837
agent_compute-ego_median	0.026068936694752087
agent_compute-ego_min	0.02489957809448242
deviation-center-line_max	0.11803708647411268
deviation-center-line_mean	0.09185657022323757
deviation-center-line_min	0.06073337098493198
deviation-heading_max	0.3681646786246837
deviation-heading_mean	0.3023908956024058
deviation-heading_median	0.28606528190679475
deviation-heading_min	0.2638670899443274
driven_any_max	1.59965468873004
driven_any_mean	1.0121135123884497
driven_any_median	0.9996632207705848
driven_any_min	0.4010834948810249
driven_lanedir_consec_max	1.2187176370157662
driven_lanedir_consec_mean	0.7889876883841616
driven_lanedir_consec_min	0.3872027169265986
driven_lanedir_max	1.2187176370157662
driven_lanedir_mean	0.7889876883841616
driven_lanedir_median	0.6856800730956207
driven_lanedir_min	0.3872027169265986
in-drivable-lane_max	0.5999999999999979
in-drivable-lane_mean	0.3299999999999992
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9996632207705848, "sim_physics": 0.15908350348472594, "survival_time": 2.000000000000001, "driven_lanedir": 0.6856800730956207, "sim_render-ego": 0.013002127408981323, "in-drivable-lane": 0.4500000000000002, "agent_compute-ego": 0.029279494285583497, "deviation-heading": 0.3145505780820485, "set_robot_commands": 0.009295105934143066, "deviation-center-line": 0.08877415228107144, "driven_lanedir_consec": 0.6856800730956207, "sim_compute_sim_state": 0.0052427172660827635, "sim_compute_performance-ego": 0.007416945695877075, "sim_compute_robot_state-ego": 0.0096432626247406, "sim_compute_robot_state-npc0": 0.00852581262588501, "sim_compute_robot_state-npc1": 0.008358317613601684, "sim_compute_robot_state-npc2": 0.008281999826431274, "sim_compute_robot_state-npc3": 0.008650416135787964}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4605114688305785, "sim_physics": 0.16696274280548096, "survival_time": 1.1000000000000003, "driven_lanedir": 0.43495812661747424, "sim_render-ego": 0.01165172186764804, "in-drivable-lane": 0, "agent_compute-ego": 0.026068936694752087, "deviation-heading": 0.3681646786246837, "set_robot_commands": 0.008603074333884499, "deviation-center-line": 0.0772648215662309, "driven_lanedir_consec": 0.43495812661747424, "sim_compute_sim_state": 0.0046366669914939184, "sim_compute_performance-ego": 0.006923859769647772, "sim_compute_robot_state-ego": 0.008754806085066362, "sim_compute_robot_state-npc0": 0.007932045243003151, "sim_compute_robot_state-npc1": 0.007926073941317472, "sim_compute_robot_state-npc2": 0.0077547593550248576, "sim_compute_robot_state-npc3": 0.008103002201427113}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.599654688730019, "sim_physics": 0.1578932205835978, "survival_time": 2.9999999999999973, "driven_lanedir": 1.2183798882653485, "sim_render-ego": 0.011851692199707033, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.02576419512430827, "deviation-heading": 0.28606528190679475, "set_robot_commands": 0.007894174257914225, "deviation-center-line": 0.11803708647411268, "driven_lanedir_consec": 1.2183798882653485, "sim_compute_sim_state": 0.004466839631398519, "sim_compute_performance-ego": 0.0065887451171875, "sim_compute_robot_state-ego": 0.008447766304016113, "sim_compute_robot_state-npc0": 0.007986203829447428, "sim_compute_robot_state-npc1": 0.007481503486633301, "sim_compute_robot_state-npc2": 0.007908737659454346, "sim_compute_robot_state-npc3": 0.007367773850758871}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.59965468873004, "sim_physics": 0.1828563372294108, "survival_time": 2.9999999999999973, "driven_lanedir": 1.2187176370157662, "sim_render-ego": 0.012500627835591634, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.02999800443649292, "deviation-heading": 0.2793068494541745, "set_robot_commands": 0.00874406894048055, "deviation-center-line": 0.11447341980984076, "driven_lanedir_consec": 1.2187176370157662, "sim_compute_sim_state": 0.005918244520823161, "sim_compute_performance-ego": 0.006889700889587402, "sim_compute_robot_state-ego": 0.009408398469289144, "sim_compute_robot_state-npc0": 0.009389968713124593, "sim_compute_robot_state-npc1": 0.008869667847951254, "sim_compute_robot_state-npc2": 0.008730773131052654, "sim_compute_robot_state-npc3": 0.008709136644999187}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4010834948810249, "sim_physics": 0.14709538221359253, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3872027169265986, "sim_render-ego": 0.010712265968322754, "in-drivable-lane": 0, "agent_compute-ego": 0.02489957809448242, "deviation-heading": 0.2638670899443274, "set_robot_commands": 0.0078727126121521, "deviation-center-line": 0.06073337098493198, "driven_lanedir_consec": 0.3872027169265986, "sim_compute_sim_state": 0.004489600658416748, "sim_compute_performance-ego": 0.005967986583709717, "sim_compute_robot_state-ego": 0.007885980606079101, "sim_compute_robot_state-npc0": 0.007749974727630615, "sim_compute_robot_state-npc1": 0.007510745525360107, "sim_compute_robot_state-npc2": 0.00784815549850464, "sim_compute_robot_state-npc3": 0.007648360729217529}}
set_robot_commands_max	0.009295105934143066
set_robot_commands_mean	0.008481827215714888
set_robot_commands_median	0.008603074333884499
set_robot_commands_min	0.0078727126121521
sim_compute_performance-ego_max	0.007416945695877075
sim_compute_performance-ego_mean	0.006757447611201893
sim_compute_performance-ego_median	0.006889700889587402
sim_compute_performance-ego_min	0.005967986583709717
sim_compute_robot_state-ego_max	0.0096432626247406
sim_compute_robot_state-ego_mean	0.008828042817838264
sim_compute_robot_state-ego_median	0.008754806085066362
sim_compute_robot_state-ego_min	0.007885980606079101
sim_compute_robot_state-npc0_max	0.009389968713124593
sim_compute_robot_state-npc0_mean	0.00831680102781816
sim_compute_robot_state-npc0_median	0.007986203829447428
sim_compute_robot_state-npc0_min	0.007749974727630615
sim_compute_robot_state-npc1_max	0.008869667847951254
sim_compute_robot_state-npc1_mean	0.008029261682972763
sim_compute_robot_state-npc1_median	0.007926073941317472
sim_compute_robot_state-npc1_min	0.007481503486633301
sim_compute_robot_state-npc2_max	0.008730773131052654
sim_compute_robot_state-npc2_mean	0.008104885094093553
sim_compute_robot_state-npc2_median	0.007908737659454346
sim_compute_robot_state-npc2_min	0.0077547593550248576
sim_compute_robot_state-npc3_max	0.008709136644999187
sim_compute_robot_state-npc3_mean	0.008095737912438132
sim_compute_robot_state-npc3_median	0.008103002201427113
sim_compute_robot_state-npc3_min	0.007367773850758871
sim_compute_sim_state_max	0.005918244520823161
sim_compute_sim_state_mean	0.004950813813643022
sim_compute_sim_state_median	0.0046366669914939184
sim_compute_sim_state_min	0.004466839631398519
sim_physics_max	0.1828563372294108
sim_physics_mean	0.16277823726336163
sim_physics_median	0.15908350348472594
sim_physics_min	0.14709538221359253
sim_render-ego_max	0.013002127408981323
sim_render-ego_mean	0.011943687056050156
sim_render-ego_median	0.011851692199707033
sim_render-ego_min	0.010712265968322754
simulation-passed	1
survival_time_max	2.9999999999999973
survival_time_mean	2.019999999999999
survival_time_min	1.0000000000000002

No reset possible

24735

2368

Liam Paull 🇨🇦

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10496

2019-10-31 14:04:51+00:00

2019-10-31 14:05:29+00:00

0:00:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11492320835174852
error_L2	0.020788510058734097

No reset possible

24720

2539

Nikhil Khedekar 🇮🇳

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10496

2019-10-31 14:04:11+00:00

2019-10-31 14:04:43+00:00

0:00:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11286637062748724
error_L2	0.019828944866062136

No reset possible

24719

3264

Liu Sam 🇹🇼

challenge-aido_LF-template-random

aido2-PRED

step1-simulation

host-error

yes

ip-172-31-43-40-10496

2019-10-31 14:03:51+00:00

2019-10-31 14:03:58+00:00

0:00:07

Error while running [...]


stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24704

3066

Lei Chen

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10496

2019-10-31 14:03:05+00:00

2019-10-31 14:03:21+00:00

0:00:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.12158264225882978
error_L2	0.022629453186454224

No reset possible

24694

3167

Pokai Chang

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10496

2019-10-31 14:02:32+00:00

2019-10-31 14:02:49+00:00

0:00:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11710229844148032
error_L2	0.021060412429944785

No reset possible

24682

3179

ZongRu Li

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10496

2019-10-31 14:02:03+00:00

2019-10-31 14:02:23+00:00

0:00:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11241852130347647
error_L2	0.01853846130710015

No reset possible

24672

3257

Liu Sam 🇹🇼

PredictorLast

aido2-PRED

step1-simulation

host-error

yes

ip-172-31-43-40-10496

2019-10-31 14:01:36+00:00

2019-10-31 14:01:40+00:00

0:00:04

Error while running [...]


stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24669

3265

Liu Sam 🇹🇼

challenge-aido_LF-template-random

aido2-PRED

step1-simulation

host-error

yes

ip-172-31-43-40-10496

2019-10-31 14:01:19+00:00

2019-10-31 14:01:23+00:00

0:00:04

Error while running [...]


stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24655

3251

Kuan-Lin Chen 🇹🇼

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10496

2019-10-31 14:00:09+00:00

2019-10-31 14:00:59+00:00

0:00:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10190339990551868
error_L2	0.016546868307541013

No reset possible

24644

3280

Hsiao-Sheng Chen 🇹🇼

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10496

2019-10-31 13:59:27+00:00

2019-10-31 13:59:45+00:00

0:00:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.119724788801452
error_L2	0.022816499982876635

No reset possible

24633

3484

Riza Velioglu 🇩🇪

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10496

2019-10-31 13:58:48+00:00

2019-10-31 13:59:09+00:00

0:00:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11050163663159623
error_L2	0.020574797527005112

No reset possible

24619

3350

Isabelle Guyon 🇺🇸

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10496

2019-10-31 13:58:05+00:00

2019-10-31 13:58:21+00:00

0:00:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10987456153213944
error_L2	0.018773838285867636

No reset possible

24613

3835

Kun Ni 🇨🇦

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10496

2019-10-31 13:57:18+00:00

2019-10-31 13:57:37+00:00

0:00:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11575901748035591
error_L2	0.02057959518217503

No reset possible

24603

4045

Riza Velioglu 🇩🇪

PredictorMean

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10496

2019-10-31 13:56:24+00:00

2019-10-31 13:56:49+00:00

0:00:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.28197451607108354
error_L2	0.0943140928834076

No reset possible

24596

4057

Zoltán L?rincz

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10496

2019-10-31 13:55:48+00:00

2019-10-31 13:56:09+00:00

0:00:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.1159336592635972
error_L2	0.02102360924081197

No reset possible

24590

4080

Johannes Lienhart 🇨🇭

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10496

2019-10-31 13:54:57+00:00

2019-10-31 13:55:27+00:00

0:00:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11394989453635672
error_L2	0.019355840259079223

No reset possible

24570

4099

Fidel Esquivel Estay 🇨🇭

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10496

2019-10-31 13:52:47+00:00

2019-10-31 13:54:30+00:00

0:01:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11917106265581288
error_L2	0.022001583337953302

No reset possible

24544

4277

Diego Charrez 🇵🇪

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10496

2019-10-31 13:50:38+00:00

2019-10-31 13:51:38+00:00

0:01:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11458283692771348
error_L2	0.020525413343349043

No reset possible

24521

4285

Liam Paull 🇨🇦

challenge-aido_LF-template-random

aido3-LFV-sim-validation

step1-simulation

success

ip-172-31-43-40-10496

2019-10-31 12:29:50+00:00

2019-10-31 12:36:49+00:00

0:06:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.6999999999999984
deviation-center-line_median	0.11519544839797546
in-drivable-lane_median	0.5999999999999979

other stats

agent_compute-ego_max	0.019684478088661476
agent_compute-ego_mean	0.016901760177247156
agent_compute-ego_median	0.01675365447998047
agent_compute-ego_min	0.015157254118668403
deviation-center-line_max	0.17439134565029044
deviation-center-line_mean	0.1265175655253199
deviation-center-line_min	0.09047885846140293
deviation-heading_max	0.5020407942599271
deviation-heading_mean	0.3641979127291371
deviation-heading_median	0.34764983431811225
deviation-heading_min	0.19401296908406307
driven_any_max	1.6169932854589055
driven_any_mean	1.0272530755098268
driven_any_median	1.0243289631429704
driven_any_min	0.4119037580118985
driven_lanedir_consec_max	1.2433038249708372
driven_lanedir_consec_mean	0.7800316850006626
driven_lanedir_consec_min	0.3792793194470208
driven_lanedir_max	1.2433038249708372
driven_lanedir_mean	0.7800316850006626
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.3792793194470208
in-drivable-lane_max	0.9999999999999976
in-drivable-lane_mean	0.4899999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.11448012016437673, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.009887474554556387, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.019684478088661476, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.006778054767184787, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.003994517856174045, "sim_compute_performance-ego": 0.005782078813623499, "sim_compute_robot_state-ego": 0.007125545431066443, "sim_compute_robot_state-npc0": 0.006989342195016367, "sim_compute_robot_state-npc1": 0.006297795860855667, "sim_compute_robot_state-npc2": 0.006422652138604058, "sim_compute_robot_state-npc3": 0.0069090039641768845}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118985, "sim_physics": 0.09903727531433106, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.010305509567260744, "in-drivable-lane": 0, "agent_compute-ego": 0.01675365447998047, "deviation-heading": 0.47860435001913376, "set_robot_commands": 0.008008718490600586, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.0034917354583740234, "sim_compute_performance-ego": 0.0057366561889648435, "sim_compute_robot_state-ego": 0.007422714233398437, "sim_compute_robot_state-npc0": 0.006687078475952148, "sim_compute_robot_state-npc1": 0.006429271697998047, "sim_compute_robot_state-npc2": 0.00647623062133789, "sim_compute_robot_state-npc3": 0.006517858505249024}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.09892662575370388, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708372, "sim_render-ego": 0.008182757779171592, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.015157254118668403, "deviation-heading": 0.5020407942599271, "set_robot_commands": 0.005826874783164577, "deviation-center-line": 0.17439134565029044, "driven_lanedir_consec": 1.2433038249708372, "sim_compute_sim_state": 0.003213069940868177, "sim_compute_performance-ego": 0.00430587090943989, "sim_compute_robot_state-ego": 0.005720718910819606, "sim_compute_robot_state-npc0": 0.005414821599659167, "sim_compute_robot_state-npc1": 0.005172716943841232, "sim_compute_robot_state-npc2": 0.005219945782109311, "sim_compute_robot_state-npc3": 0.005188198466049998}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589055, "sim_physics": 0.1273221124576617, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.008979709842537023, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.01712735393379308, "deviation-heading": 0.34764983431811225, "set_robot_commands": 0.006093716319603256, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.0036428970626637904, "sim_compute_performance-ego": 0.004757555225227452, "sim_compute_robot_state-ego": 0.006335044208961197, "sim_compute_robot_state-npc0": 0.006015318858472607, "sim_compute_robot_state-npc1": 0.005641490598268147, "sim_compute_robot_state-npc2": 0.005629515346092514, "sim_compute_robot_state-npc3": 0.005639157717740989}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846434, "sim_physics": 0.10519898789269584, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.008209424359457833, "in-drivable-lane": 0, "agent_compute-ego": 0.015786060265132358, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.005737696375165667, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.003397277423313686, "sim_compute_performance-ego": 0.004363783768245152, "sim_compute_robot_state-ego": 0.005854913166591099, "sim_compute_robot_state-npc0": 0.005550290857042585, "sim_compute_robot_state-npc1": 0.005184505667005267, "sim_compute_robot_state-npc2": 0.005254805088043213, "sim_compute_robot_state-npc3": 0.005248018673488072}}
set_robot_commands_max	0.008008718490600586
set_robot_commands_mean	0.006489012147143774
set_robot_commands_median	0.006093716319603256
set_robot_commands_min	0.005737696375165667
sim_compute_performance-ego_max	0.005782078813623499
sim_compute_performance-ego_mean	0.004989188981100167
sim_compute_performance-ego_median	0.004757555225227452
sim_compute_performance-ego_min	0.00430587090943989
sim_compute_robot_state-ego_max	0.007422714233398437
sim_compute_robot_state-ego_mean	0.006491787190167357
sim_compute_robot_state-ego_median	0.006335044208961197
sim_compute_robot_state-ego_min	0.005720718910819606
sim_compute_robot_state-npc0_max	0.006989342195016367
sim_compute_robot_state-npc0_mean	0.006131370397228575
sim_compute_robot_state-npc0_median	0.006015318858472607
sim_compute_robot_state-npc0_min	0.005414821599659167
sim_compute_robot_state-npc1_max	0.006429271697998047
sim_compute_robot_state-npc1_mean	0.005745156153593672
sim_compute_robot_state-npc1_median	0.005641490598268147
sim_compute_robot_state-npc1_min	0.005172716943841232
sim_compute_robot_state-npc2_max	0.00647623062133789
sim_compute_robot_state-npc2_mean	0.005800629795237397
sim_compute_robot_state-npc2_median	0.005629515346092514
sim_compute_robot_state-npc2_min	0.005219945782109311
sim_compute_robot_state-npc3_max	0.0069090039641768845
sim_compute_robot_state-npc3_mean	0.005900447465340994
sim_compute_robot_state-npc3_median	0.005639157717740989
sim_compute_robot_state-npc3_min	0.005188198466049998
sim_compute_sim_state_max	0.003994517856174045
sim_compute_sim_state_mean	0.003547899548278744
sim_compute_sim_state_median	0.0034917354583740234
sim_compute_sim_state_min	0.003213069940868177
sim_physics_max	0.1273221124576617
sim_physics_mean	0.10899302431655385
sim_physics_median	0.10519898789269584
sim_physics_min	0.09892662575370388
sim_render-ego_max	0.010305509567260744
sim_render-ego_mean	0.009112975220596717
sim_render-ego_median	0.008979709842537023
sim_render-ego_min	0.008182757779171592
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.6199999999999974
survival_time_min	1.2500000000000004

No reset possible

24427

4226

Manfred Diaz

Baseline-IL-logs-tensorflow

aido3-LFV-sim-validation

step1-simulation

failed

ip-172-31-43-40-10496

2019-10-24 06:37:16+00:00

2019-10-24 06:38:12+00:00

0:00:56

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1334, in _do_call
               ||     return fn(*args)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1319, in _run_fn
               ||     options, feed_dict, fetch_list, target_list, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1407, in _call_tf_sessionrun
               ||     run_metadata)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[{{node prefix/ConvNet/conv_layer_1/kernel/read}}]]
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 71, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 60, in compute_action
               ||     x: observation
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 929, in run
               ||     run_metadata_ptr)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1152, in _run
               ||     feed_dict_tensor, options, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1328, in _do_run
               ||     run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1348, in _do_call
               ||     raise type(e)(node_def, op, message)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[node prefix/ConvNet/conv_layer_1/kernel/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               || Caused by op 'prefix/ConvNet/conv_layer_1/kernel/read', defined at:
               ||   File "imitation_agent.py", line 136, in <module>
               ||     main()
               ||   File "imitation_agent.py", line 132, in main
               ||     wrap_direct(node=node, protocol=protocol)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/interface.py", line 22, in wrap_direct
               ||     run_loop(node, protocol, args)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 196, in run_loop
               ||     config=config)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 71, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 43, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 442, in import_graph_def
               ||     _ProcessNewOps(graph)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 235, in _ProcessNewOps
               ||     for new_op in graph._add_new_tf_operations(compute_devices=False):  # pylint: disable=protected-access
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in _add_new_tf_operations
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in <listcomp>
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3325, in _create_op_from_tf_operation
               ||     ret = Operation(c_op, self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 1801, in __init__
               ||     self._traceback = tf_stack.extract_stack()
               ||
               || FailedPreconditionError (see above for traceback): Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[node prefix/ConvNet/conv_layer_1/kernel/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24399

4198

Manfred Diaz

challenge-aido_LF-template-tensorflow

aido3-LF-sim-testing

step1-simulation

error

ip-172-31-43-40-10496

2019-10-24 03:39:37+00:00

2019-10-24 03:42:28+00:00

0:02:51

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24388

4194

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

aido3-LF-sim-testing

step1-simulation

error

ip-172-31-43-40-10496

2019-10-23 20:54:38+00:00

2019-10-23 20:55:05+00:00

0:00:27

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24383

4189

Liam Paull 🇨🇦

challenge-aido_LF-template-ros - Template solution using ROS

aido3-LFV-sim-testing

step1-simulation

error

ip-172-31-43-40-10496

2019-10-23 19:51:38+00:00

2019-10-23 20:00:15+00:00

0:08:37

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24355

4176

Bhairav Mehta

challenge-aido_LF-template-pytorch

aido3-LFVI-sim-validation

step1-simulation

failed

ip-172-31-43-40-10496

2019-10-21 23:18:36+00:00

2019-10-21 23:22:10+00:00

0:03:34

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 298, in run_episode
    agent.write_topic_and_expect_zero('observations', recv.data.observations)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 105, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "observations".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 36, in on_received_observations
               ||     self.current_image = self.preprocessor.preprocess(obs)
               ||   File "/workspace/wrappers.py", line 9, in preprocess
               ||     from scipy.misc import imresize
               || ImportError: cannot import name 'imresize' from 'scipy.misc' (/usr/local/lib/python3.7/site-packages/scipy/misc/__init__.py)
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24347

4163

Tanli Chou 🇹🇼

challenge-aido_LF-template-random

aido3-LF-sim-validation

step1-simulation

success

ip-172-31-43-40-10496

2019-10-21 14:47:29+00:00

2019-10-21 14:52:23+00:00

0:04:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.13005513204193506
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.014219677006756816
agent_compute-ego_mean	0.013791675086516
agent_compute-ego_median	0.01361653472803816
agent_compute-ego_min	0.013566391140806908
deviation-center-line_max	0.2072381278624381
deviation-center-line_mean	0.13189395308989765
deviation-center-line_min	0.0788839760023766
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3206717506075888
deviation-heading_median	0.23606825392187256
deviation-heading_min	0.19401296908406307
driven_any_max	1.6182144577009443
driven_any_mean	0.861378585933269
driven_any_median	0.9933867744747804
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	0.8010406009604816
driven_lanedir_consec_mean	0.5597645764431625
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	0.8010406009604816
driven_lanedir_mean	0.5597645764431625
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.619999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.050394137700398765, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.007373730341593425, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.014219677006756816, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.0044435350983231155, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.0030191562793872974, "sim_compute_performance-ego": 0.004141445513124819, "sim_compute_robot_state-ego": 0.005165267873693396}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.050369337493298104, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.007148013395421645, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.013566391140806908, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.004500505970973594, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.002989596011591893, "sim_compute_performance-ego": 0.003765115550920075, "sim_compute_robot_state-ego": 0.005139869802138384}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.056865692138671875, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.007286268122055952, "in-drivable-lane": 0, "agent_compute-ego": 0.013591682209688077, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.004656244726742015, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.0031107033000272863, "sim_compute_performance-ego": 0.003837262882905848, "sim_compute_robot_state-ego": 0.005164146423339844}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.056690635681152346, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.007402791976928711, "in-drivable-lane": 0, "agent_compute-ego": 0.01396409034729004, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.004331331253051757, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.0030902767181396483, "sim_compute_performance-ego": 0.003862771987915039, "sim_compute_robot_state-ego": 0.005070610046386719}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6182144577009443, "sim_physics": 0.04931541636020322, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.007287689402133603, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.01361653472803816, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.004451772834681258, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.0029918393002280707, "sim_compute_performance-ego": 0.003832267809517776, "sim_compute_robot_state-ego": 0.005086488361600079}}
set_robot_commands_max	0.004656244726742015
set_robot_commands_mean	0.004476677976754348
set_robot_commands_median	0.004451772834681258
set_robot_commands_min	0.004331331253051757
sim_compute_performance-ego_max	0.004141445513124819
sim_compute_performance-ego_mean	0.003887772748876711
sim_compute_performance-ego_median	0.003837262882905848
sim_compute_performance-ego_min	0.003765115550920075
sim_compute_robot_state-ego_max	0.005165267873693396
sim_compute_robot_state-ego_mean	0.005125276501431684
sim_compute_robot_state-ego_median	0.005139869802138384
sim_compute_robot_state-ego_min	0.005070610046386719
sim_compute_sim_state_max	0.0031107033000272863
sim_compute_sim_state_mean	0.003040314321874839
sim_compute_sim_state_median	0.0030191562793872974
sim_compute_sim_state_min	0.002989596011591893
sim_physics_max	0.056865692138671875
sim_physics_mean	0.05272704387474486
sim_physics_median	0.050394137700398765
sim_physics_min	0.04931541636020322
sim_render-ego_max	0.007402791976928711
sim_render-ego_mean	0.007299698647626666
sim_render-ego_median	0.007287689402133603
sim_render-ego_min	0.007148013395421645
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2599999999999985
survival_time_min	0.8500000000000002

No reset possible