AI Driving Olympics Home Challenges Submissions Jobs

Submission 2598

Submission2598
Competingyes
Challengeaido2-LF-sim-testing
UserLiam Paull
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💜
Jobsstep1-simulation: 22872
Next
User labelchallenge-aido_LF-baseline-duckietown
Admin priority50
Blessing50
User priority

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
228722598Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerroryes-0:35:02
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
211792598Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationsuccessno-0:30:38Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9728259319462688
survival_time_median8.649999999999988
deviation-center-line_median0.5104711471618928
in-drivable-lane_median0.5000000000000071


other stats
agent_compute-ego_max0.07041733900705974
agent_compute-ego_mean0.06087060748032052
agent_compute-ego_median0.05940577030181885
agent_compute-ego_min0.05676190853118897
deviation-center-line_max1.1654905314143482
deviation-center-line_mean0.6080608162449143
deviation-center-line_min0.13106416838247445
deviation-heading_max7.958612269516624
deviation-heading_mean3.3947374849733234
deviation-heading_median3.748393915799017
deviation-heading_min0.6111076028411546
driven_any_max2.349019606646149
driven_any_mean1.4670928278938138
driven_any_median1.336423377573292
driven_any_min0.5490405471262901
driven_lanedir_consec_max2.1744512242876706
driven_lanedir_consec_mean0.9000335200810923
driven_lanedir_consec_min0.2576944085638201
driven_lanedir_max2.1744512242876706
driven_lanedir_mean1.0649405562930103
driven_lanedir_median0.991025233037688
driven_lanedir_min0.3915068993209565
in-drivable-lane_max5.100000000000028
in-drivable-lane_mean1.4033333333333406
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5723469732840017, "sim_physics": 0.06112433075904846, "survival_time": 3.999999999999994, "driven_lanedir": 0.46851368412724925, "sim_render-ego": 0.060966980457305905, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.070404252409935, "deviation-heading": 1.4433360005402749, "set_robot_commands": 0.07794272899627686, "deviation-center-line": 0.30116006899187303, "driven_lanedir_consec": 0.46851368412724925, "sim_compute_sim_state": 0.04063269197940826, "sim_compute_performance-ego": 0.06255659162998199, "sim_compute_robot_state-ego": 0.06384516060352326}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3488944291592406, "sim_physics": 0.05916766325632731, "survival_time": 14.950000000000076, "driven_lanedir": 1.8225336862463184, "sim_render-ego": 0.06057066202163696, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.07041733900705974, "deviation-heading": 6.301247486635548, "set_robot_commands": 0.08086400349934895, "deviation-center-line": 1.1654905314143482, "driven_lanedir_consec": 1.116596390847875, "sim_compute_sim_state": 0.04046719392140707, "sim_compute_performance-ego": 0.06359000444412231, "sim_compute_robot_state-ego": 0.06380349238713583}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.348885324747497, "sim_physics": 0.05410191218058268, "survival_time": 14.950000000000076, "driven_lanedir": 1.3368973883762625, "sim_render-ego": 0.05070286273956299, "in-drivable-lane": 4.750000000000033, "agent_compute-ego": 0.05676190853118897, "deviation-heading": 4.395993419676, "set_robot_commands": 0.07690264383951823, "deviation-center-line": 0.972871768141876, "driven_lanedir_consec": 1.034625477287083, "sim_compute_sim_state": 0.03287553628285726, "sim_compute_performance-ego": 0.05544238885243734, "sim_compute_robot_state-ego": 0.05782780408859253}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9427086011916876, "sim_physics": 0.062185766235474615, "survival_time": 6.199999999999986, "driven_lanedir": 0.3915068993209565, "sim_render-ego": 0.05278475822940949, "in-drivable-lane": 3.049999999999989, "agent_compute-ego": 0.060678320546304024, "deviation-heading": 1.2402244128416335, "set_robot_commands": 0.08056085917257494, "deviation-center-line": 0.13106416838247445, "driven_lanedir_consec": 0.3915068993209565, "sim_compute_sim_state": 0.033551867931119854, "sim_compute_performance-ego": 0.05843673598381781, "sim_compute_robot_state-ego": 0.060996630499439854}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.336423377573292, "sim_physics": 0.06117708834609544, "survival_time": 8.649999999999988, "driven_lanedir": 0.991025233037688, "sim_render-ego": 0.05341627418650368, "in-drivable-lane": 0.8500000000000023, "agent_compute-ego": 0.06279812520639055, "deviation-heading": 3.783660027059206, "set_robot_commands": 0.08216182620539142, "deviation-center-line": 0.5104711471618928, "driven_lanedir_consec": 0.991025233037688, "sim_compute_sim_state": 0.03471249927675104, "sim_compute_performance-ego": 0.05896971818339618, "sim_compute_robot_state-ego": 0.06146300045741087}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.995354638197359, "sim_physics": 0.059795530169617896, "survival_time": 12.750000000000046, "driven_lanedir": 1.6168801954409142, "sim_render-ego": 0.05246929654888078, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.060461774526857866, "deviation-heading": 5.463004568991806, "set_robot_commands": 0.08136537121791465, "deviation-center-line": 0.863763852173395, "driven_lanedir_consec": 1.3107497457896948, "sim_compute_sim_state": 0.03400785128275553, "sim_compute_performance-ego": 0.05864219665527344, "sim_compute_robot_state-ego": 0.06120491214826995}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.581185142689715, "sim_physics": 0.06239950505993034, "survival_time": 3.949999999999994, "driven_lanedir": 0.5407566564107662, "sim_render-ego": 0.05308826060234746, "in-drivable-lane": 0, "agent_compute-ego": 0.06142218505279928, "deviation-heading": 1.268434290782806, "set_robot_commands": 0.08167744286452668, "deviation-center-line": 0.1962085144097894, "driven_lanedir_consec": 0.5407566564107662, "sim_compute_sim_state": 0.03517694111111798, "sim_compute_performance-ego": 0.05880541439297833, "sim_compute_robot_state-ego": 0.06119129929361464}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.6133428884948714, "sim_physics": 0.06145943503781973, "survival_time": 4.149999999999993, "driven_lanedir": 0.5955288077842755, "sim_render-ego": 0.05223904460309499, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.059918064668954135, "deviation-heading": 0.6111076028411546, "set_robot_commands": 0.08123797680958207, "deviation-center-line": 0.436452675419868, "driven_lanedir_consec": 0.5955288077842755, "sim_compute_sim_state": 0.033271657415183196, "sim_compute_performance-ego": 0.05875509905527873, "sim_compute_robot_state-ego": 0.06104280862463526}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.348956387742561, "sim_physics": 0.058013965288798014, "survival_time": 14.950000000000076, "driven_lanedir": 1.699556312865187, "sim_render-ego": 0.05127685705820719, "in-drivable-lane": 3.1500000000000448, "agent_compute-ego": 0.05911563793818156, "deviation-heading": 3.748393915799017, "set_robot_commands": 0.07899840752283732, "deviation-center-line": 0.7687095130619535, "driven_lanedir_consec": 1.3603360818830563, "sim_compute_sim_state": 0.033196252981821696, "sim_compute_performance-ego": 0.05688260157903035, "sim_compute_robot_state-ego": 0.059259254137674966}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.6855791676075682, "sim_physics": 0.05543597884800123, "survival_time": 4.599999999999992, "driven_lanedir": 0.5907236351524603, "sim_render-ego": 0.05077934265136719, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.05805407399716585, "deviation-heading": 1.562154570069967, "set_robot_commands": 0.07695954778920049, "deviation-center-line": 0.3266907003805604, "driven_lanedir_consec": 0.5907236351524603, "sim_compute_sim_state": 0.03222929394763449, "sim_compute_performance-ego": 0.05558885957883752, "sim_compute_robot_state-ego": 0.057638417119565216}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.3487060646412132, "sim_physics": 0.05399859587351481, "survival_time": 14.950000000000076, "driven_lanedir": 1.1997582028558544, "sim_render-ego": 0.051592822869618735, "in-drivable-lane": 5.100000000000028, "agent_compute-ego": 0.05930304368336996, "deviation-heading": 5.644613141181135, "set_robot_commands": 0.07902486801147461, "deviation-center-line": 0.8002607769983502, "driven_lanedir_consec": 0.9728259319462688, "sim_compute_sim_state": 0.03251713752746582, "sim_compute_performance-ego": 0.05580749750137329, "sim_compute_robot_state-ego": 0.05777495940526327}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.5490405471262901, "sim_physics": 0.05531530062357585, "survival_time": 3.7499999999999942, "driven_lanedir": 0.5328889563104755, "sim_render-ego": 0.05072143872578939, "in-drivable-lane": 0, "agent_compute-ego": 0.05929364522298177, "deviation-heading": 0.7515881976722553, "set_robot_commands": 0.07764305750528971, "deviation-center-line": 0.33563118549893733, "driven_lanedir_consec": 0.5328889563104755, "sim_compute_sim_state": 0.03283562978108724, "sim_compute_performance-ego": 0.056045856475830075, "sim_compute_robot_state-ego": 0.058146003087361654}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.637311906310082, "sim_physics": 0.05574350301609483, "survival_time": 4.299999999999993, "driven_lanedir": 0.4387069217775893, "sim_render-ego": 0.05091926108959109, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.05729331249414488, "deviation-heading": 2.2076731579858597, "set_robot_commands": 0.07761735971583876, "deviation-center-line": 0.4101282326429562, "driven_lanedir_consec": 0.2576944085638201, "sim_compute_sim_state": 0.03259492752163909, "sim_compute_performance-ego": 0.055253197980481526, "sim_compute_robot_state-ego": 0.057921129603718605}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.3486373629956825, "sim_physics": 0.05434144020080566, "survival_time": 14.950000000000076, "driven_lanedir": 1.574380540401488, "sim_render-ego": 0.05085734128952026, "in-drivable-lane": 1.8500000000000112, "agent_compute-ego": 0.05940577030181885, "deviation-heading": 7.958612269516624, "set_robot_commands": 0.0786990475654602, "deviation-center-line": 0.9638583517215892, "driven_lanedir_consec": 1.162279668467043, "sim_compute_sim_state": 0.03297285238901774, "sim_compute_performance-ego": 0.05594704627990723, "sim_compute_robot_state-ego": 0.0575019097328186}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.349019606646149, "sim_physics": 0.0540623140335083, "survival_time": 14.950000000000076, "driven_lanedir": 2.1744512242876706, "sim_render-ego": 0.05037465651830037, "in-drivable-lane": 0, "agent_compute-ego": 0.05773165861765544, "deviation-heading": 4.541019213006566, "set_robot_commands": 0.07844901561737061, "deviation-center-line": 0.9381507572738508, "driven_lanedir_consec": 2.1744512242876706, "sim_compute_sim_state": 0.03253411610921224, "sim_compute_performance-ego": 0.055934058825174965, "sim_compute_robot_state-ego": 0.05744236707687378}}
set_robot_commands_max0.08216182620539142
set_robot_commands_mean0.07934027708884035
set_robot_commands_median0.07899840752283732
set_robot_commands_min0.07690264383951823
sim_compute_performance-ego_max0.06359000444412231
sim_compute_performance-ego_mean0.057777151161194744
sim_compute_performance-ego_median0.05688260157903035
sim_compute_performance-ego_min0.055253197980481526
sim_compute_robot_state-ego_max0.06384516060352326
sim_compute_robot_state-ego_mean0.05980394321772655
sim_compute_robot_state-ego_median0.059259254137674966
sim_compute_robot_state-ego_min0.05744236707687378
sim_compute_sim_state_max0.04063269197940826
sim_compute_sim_state_mean0.03423842996389857
sim_compute_sim_state_median0.033196252981821696
sim_compute_sim_state_min0.03222929394763449
sim_physics_max0.06239950505993034
sim_physics_mean0.05788815526194634
sim_physics_median0.058013965288798014
sim_physics_min0.05399859587351481
sim_render-ego_max0.060966980457305905
sim_render-ego_mean0.05285065730607576
sim_render-ego_median0.051592822869618735
sim_render-ego_min0.05037465651830037
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.47000000000003
survival_time_min3.7499999999999942
211482598Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationhost-errorno-0:03:35
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2598/step1-simulation-ip-172-31-40-253-31940-job21148/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
204552598Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationsuccessno-0:10:41Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4562629591334715
survival_time_median8.349999999999984
deviation-center-line_median0.3482319483052215
in-drivable-lane_median4.199999999999995


other stats
agent_compute-ego_max0.06450506528218587
agent_compute-ego_mean0.06069491336802345
agent_compute-ego_median0.06007293239235878
agent_compute-ego_min0.058695916334788
deviation-center-line_max0.7137289931513128
deviation-center-line_mean0.446172404981034
deviation-center-line_min0.31330748535748865
deviation-heading_max5.6019910117778196
deviation-heading_mean3.225457911812221
deviation-heading_median3.058441352931268
deviation-heading_min0.4258169633377884
driven_any_max2.348143016533108
driven_any_mean1.4373528996533305
driven_any_median1.2878126431008812
driven_any_min0.46055575767077384
driven_lanedir_consec_max0.8482961047158355
driven_lanedir_consec_mean0.4989960391532248
driven_lanedir_consec_min0.2622146519781854
driven_lanedir_max1.2409106030301893
driven_lanedir_mean0.7076393036054673
driven_lanedir_median0.6456638962437875
driven_lanedir_min0.39201500107392784
in-drivable-lane_max7.250000000000043
in-drivable-lane_mean3.2400000000000175
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7427234593278016, "sim_physics": 0.07994694756989432, "survival_time": 5.04999999999999, "driven_lanedir": 0.6456638962437875, "sim_render-ego": 0.04710555076599121, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.05999210093281056, "deviation-heading": 1.8063701739902644, "set_robot_commands": 0.06876230948042161, "deviation-center-line": 0.3482319483052215, "driven_lanedir_consec": 0.6456638962437875, "sim_compute_sim_state": 0.029348002802027335, "sim_compute_performance-ego": 0.05044747579215777, "sim_compute_robot_state-ego": 0.05439806928729067}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2878126431008812, "sim_physics": 0.08694411037924761, "survival_time": 8.349999999999984, "driven_lanedir": 0.39201500107392784, "sim_render-ego": 0.04776945513879468, "in-drivable-lane": 4.199999999999995, "agent_compute-ego": 0.06020855189797407, "deviation-heading": 3.058441352931268, "set_robot_commands": 0.07278336879022107, "deviation-center-line": 0.31330748535748865, "driven_lanedir_consec": 0.2622146519781854, "sim_compute_sim_state": 0.03070013109081519, "sim_compute_performance-ego": 0.05218525989326888, "sim_compute_robot_state-ego": 0.053813801554148784}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.46055575767077384, "sim_physics": 0.0634208619594574, "survival_time": 3.1999999999999966, "driven_lanedir": 0.4562629591334715, "sim_render-ego": 0.06192838028073311, "in-drivable-lane": 0, "agent_compute-ego": 0.06007293239235878, "deviation-heading": 0.4258169633377884, "set_robot_commands": 0.07148580253124237, "deviation-center-line": 0.3362487341527758, "driven_lanedir_consec": 0.4562629591334715, "sim_compute_sim_state": 0.031121041625738144, "sim_compute_performance-ego": 0.05747748538851738, "sim_compute_robot_state-ego": 0.05436886847019195}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.348143016533108, "sim_physics": 0.08626725355784098, "survival_time": 14.950000000000076, "driven_lanedir": 1.2409106030301893, "sim_render-ego": 0.04372002124786377, "in-drivable-lane": 4.700000000000051, "agent_compute-ego": 0.06450506528218587, "deviation-heading": 5.6019910117778196, "set_robot_commands": 0.06987876892089843, "deviation-center-line": 0.7137289931513128, "driven_lanedir_consec": 0.8482961047158355, "sim_compute_sim_state": 0.028920493125915527, "sim_compute_performance-ego": 0.05001047452290853, "sim_compute_robot_state-ego": 0.05363982597986857}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.347529621634087, "sim_physics": 0.09356731414794922, "survival_time": 14.950000000000076, "driven_lanedir": 0.8033440585459606, "sim_render-ego": 0.04653447945912679, "in-drivable-lane": 7.250000000000043, "agent_compute-ego": 0.058695916334788, "deviation-heading": 5.234670057023964, "set_robot_commands": 0.07039210319519043, "deviation-center-line": 0.5193448639383714, "driven_lanedir_consec": 0.28254258369484386, "sim_compute_sim_state": 0.030360409418741865, "sim_compute_performance-ego": 0.05131896495819092, "sim_compute_robot_state-ego": 0.05611933946609497}}
set_robot_commands_max0.07278336879022107
set_robot_commands_mean0.07066047058359479
set_robot_commands_median0.07039210319519043
set_robot_commands_min0.06876230948042161
sim_compute_performance-ego_max0.05747748538851738
sim_compute_performance-ego_mean0.0522879321110087
sim_compute_performance-ego_median0.05131896495819092
sim_compute_performance-ego_min0.05001047452290853
sim_compute_robot_state-ego_max0.05611933946609497
sim_compute_robot_state-ego_mean0.05446798095151899
sim_compute_robot_state-ego_median0.05436886847019195
sim_compute_robot_state-ego_min0.05363982597986857
sim_compute_sim_state_max0.031121041625738144
sim_compute_sim_state_mean0.030090015612647607
sim_compute_sim_state_median0.030360409418741865
sim_compute_sim_state_min0.028920493125915527
sim_physics_max0.09356731414794922
sim_physics_mean0.08202929752287791
sim_physics_median0.08626725355784098
sim_physics_min0.0634208619594574
sim_render-ego_max0.06192838028073311
sim_render-ego_mean0.04941157737850191
sim_render-ego_median0.04710555076599121
sim_render-ego_min0.04372002124786377
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.300000000000026
survival_time_min3.1999999999999966
194902598Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationsuccessno-0:17:46Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.177285395289443
survival_time_median14.950000000000076
deviation-center-line_median1.042586759550595
in-drivable-lane_median2.0000000000000124


other stats
agent_compute-ego_max0.07659868876139322
agent_compute-ego_mean0.07472287054088603
agent_compute-ego_median0.07447521225744937
agent_compute-ego_min0.07239107131958007
deviation-center-line_max1.1458701765582588
deviation-center-line_mean0.8735473633828403
deviation-center-line_min0.19112317915112173
deviation-heading_max6.820564690693029
deviation-heading_mean4.303029287808786
deviation-heading_median3.3392886560483857
deviation-heading_min1.5769547747132515
driven_any_max2.3556774769756066
driven_any_mean2.063994816978094
driven_any_median2.355074217494031
driven_any_min0.9090801038753694
driven_lanedir_consec_max2.2611439193707783
driven_lanedir_consec_mean1.3716266314676104
driven_lanedir_consec_min0.4056449447220096
driven_lanedir_max2.2611439193707783
driven_lanedir_mean1.6032864379845826
driven_lanedir_median1.6648678486073911
driven_lanedir_min0.4056449447220096
in-drivable-lane_max2.5500000000000203
in-drivable-lane_mean1.5300000000000042
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.344895003587564, "sim_physics": 0.02174866835276286, "survival_time": 14.950000000000076, "driven_lanedir": 2.2611439193707783, "sim_render-ego": 0.05533046086629232, "in-drivable-lane": 0, "agent_compute-ego": 0.07659868876139322, "deviation-heading": 3.337710107951181, "set_robot_commands": 0.08499777714411418, "deviation-center-line": 1.0601789579695955, "driven_lanedir_consec": 2.2611439193707783, "sim_compute_sim_state": 0.033864699204762774, "sim_compute_performance-ego": 0.059827430248260496, "sim_compute_robot_state-ego": 0.0627977999051412}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3556774769756066, "sim_physics": 0.02299911101659139, "survival_time": 14.950000000000076, "driven_lanedir": 2.1782457165960305, "sim_render-ego": 0.06045380353927613, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.07416653553644816, "deviation-heading": 3.3392886560483857, "set_robot_commands": 0.09688610474268596, "deviation-center-line": 1.1458701765582588, "driven_lanedir_consec": 2.1782457165960305, "sim_compute_sim_state": 0.037596909205118816, "sim_compute_performance-ego": 0.06734742561976115, "sim_compute_robot_state-ego": 0.07041957855224609}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3552472829579, "sim_physics": 0.023936814467112225, "survival_time": 14.950000000000076, "driven_lanedir": 1.6648678486073911, "sim_render-ego": 0.06152062813440959, "in-drivable-lane": 2.0000000000000124, "agent_compute-ego": 0.07598284482955933, "deviation-heading": 6.440628209638086, "set_robot_commands": 0.09833296219507852, "deviation-center-line": 0.9279777436846308, "driven_lanedir_consec": 1.177285395289443, "sim_compute_sim_state": 0.03809566974639893, "sim_compute_performance-ego": 0.06855262200037639, "sim_compute_robot_state-ego": 0.07175386587778727}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9090801038753694, "sim_physics": 0.025666170761364848, "survival_time": 5.949999999999987, "driven_lanedir": 0.4056449447220096, "sim_render-ego": 0.06281457828874347, "in-drivable-lane": 2.549999999999991, "agent_compute-ego": 0.07447521225744937, "deviation-heading": 1.5769547747132515, "set_robot_commands": 0.09253838082321553, "deviation-center-line": 0.19112317915112173, "driven_lanedir_consec": 0.4056449447220096, "sim_compute_sim_state": 0.037833884984505274, "sim_compute_performance-ego": 0.06993378510996073, "sim_compute_robot_state-ego": 0.07296467628799566}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.355074217494031, "sim_physics": 0.02305680751800537, "survival_time": 14.950000000000076, "driven_lanedir": 1.5065297606267043, "sim_render-ego": 0.059023324648539224, "in-drivable-lane": 2.5500000000000203, "agent_compute-ego": 0.07239107131958007, "deviation-heading": 6.820564690693029, "set_robot_commands": 0.09321588118871052, "deviation-center-line": 1.042586759550595, "driven_lanedir_consec": 0.8358131813597915, "sim_compute_sim_state": 0.03793955723444621, "sim_compute_performance-ego": 0.0663619836171468, "sim_compute_robot_state-ego": 0.06790700515111288}}
set_robot_commands_max0.09833296219507852
set_robot_commands_mean0.09319422121876096
set_robot_commands_median0.09321588118871052
set_robot_commands_min0.08499777714411418
sim_compute_performance-ego_max0.06993378510996073
sim_compute_performance-ego_mean0.0664046493191011
sim_compute_performance-ego_median0.06734742561976115
sim_compute_performance-ego_min0.059827430248260496
sim_compute_robot_state-ego_max0.07296467628799566
sim_compute_robot_state-ego_mean0.0691685851548566
sim_compute_robot_state-ego_median0.07041957855224609
sim_compute_robot_state-ego_min0.0627977999051412
sim_compute_sim_state_max0.03809566974639893
sim_compute_sim_state_mean0.037066144075046395
sim_compute_sim_state_median0.037833884984505274
sim_compute_sim_state_min0.033864699204762774
sim_physics_max0.025666170761364848
sim_physics_mean0.023481514423167336
sim_physics_median0.02305680751800537
sim_physics_min0.02174866835276286
sim_render-ego_max0.06281457828874347
sim_render-ego_mean0.059828559095452136
sim_render-ego_median0.06045380353927613
sim_render-ego_min0.05533046086629232
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.15000000000006
survival_time_min5.949999999999987
187382598Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerrorno-0:20:56
Waited 1203 seconds [...]
Waited 1203 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
183922598Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationsuccessno-0:15:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4333067017118708
survival_time_median9.650000000000002
deviation-center-line_median0.6629755679455226
in-drivable-lane_median0.15000000000000213


other stats
agent_compute-ego_max0.06387174924214681
agent_compute-ego_mean0.06244247336154696
agent_compute-ego_median0.06273268690012922
agent_compute-ego_min0.05977379013510312
deviation-center-line_max1.3135551800361052
deviation-center-line_mean0.790321866850897
deviation-center-line_min0.2750776795227707
deviation-heading_max4.517073532149278
deviation-heading_mean2.913782177134337
deviation-heading_median2.4558495796795143
deviation-heading_min1.3382281632126254
driven_any_max2.3556803821176406
driven_any_mean1.6511459321559006
driven_any_median1.503824579811731
driven_any_min0.7376905152110877
driven_lanedir_consec_max2.2072886600459887
driven_lanedir_consec_mean1.5064960359565522
driven_lanedir_consec_min0.6866186178852083
driven_lanedir_max2.2072886600459887
driven_lanedir_mean1.5064960359565522
driven_lanedir_median1.4333067017118708
driven_lanedir_min0.6866186178852083
in-drivable-lane_max0.7499999999999991
in-drivable-lane_mean0.2400000000000011
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7376905152110877, "sim_physics": 0.01668704880608453, "survival_time": 4.94999999999999, "driven_lanedir": 0.6866186178852083, "sim_render-ego": 0.05813899184718276, "in-drivable-lane": 0, "agent_compute-ego": 0.06273268690012922, "deviation-heading": 1.3382281632126254, "set_robot_commands": 0.07450511720445421, "deviation-center-line": 0.2750776795227707, "driven_lanedir_consec": 0.6866186178852083, "sim_compute_sim_state": 0.036900021813132546, "sim_compute_performance-ego": 0.05951831075880262, "sim_compute_robot_state-ego": 0.06145080893930763}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3395378219248837, "sim_physics": 0.015601041742446848, "survival_time": 14.850000000000076, "driven_lanedir": 2.0394031394468666, "sim_render-ego": 0.05963416292209818, "in-drivable-lane": 0.7499999999999991, "agent_compute-ego": 0.06384053294506137, "deviation-heading": 4.517073532149278, "set_robot_commands": 0.07482116390960385, "deviation-center-line": 1.0912793424376614, "driven_lanedir_consec": 2.0394031394468666, "sim_compute_sim_state": 0.037915679340812095, "sim_compute_performance-ego": 0.060930803568676264, "sim_compute_robot_state-ego": 0.06086365301601012}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3556803821176406, "sim_physics": 0.01579522212346395, "survival_time": 14.950000000000076, "driven_lanedir": 2.2072886600459887, "sim_render-ego": 0.0592636235555013, "in-drivable-lane": 0.15000000000000213, "agent_compute-ego": 0.06387174924214681, "deviation-heading": 3.9307763100241937, "set_robot_commands": 0.07482973337173462, "deviation-center-line": 1.3135551800361052, "driven_lanedir_consec": 2.2072886600459887, "sim_compute_sim_state": 0.03739697615305582, "sim_compute_performance-ego": 0.06057746410369873, "sim_compute_robot_state-ego": 0.06259443283081055}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.503824579811731, "sim_physics": 0.018304869300960876, "survival_time": 9.650000000000002, "driven_lanedir": 1.4333067017118708, "sim_render-ego": 0.06214893790724364, "in-drivable-lane": 0, "agent_compute-ego": 0.06199360758529426, "deviation-heading": 2.3269833006060723, "set_robot_commands": 0.07306085719963429, "deviation-center-line": 0.6629755679455226, "driven_lanedir_consec": 1.4333067017118708, "sim_compute_sim_state": 0.0383239200078144, "sim_compute_performance-ego": 0.06209919613260061, "sim_compute_robot_state-ego": 0.06273002698631484}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.31899636171416, "sim_physics": 0.015242488244000605, "survival_time": 8.499999999999986, "driven_lanedir": 1.1658630606928262, "sim_render-ego": 0.05719570272109088, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.05977379013510312, "deviation-heading": 2.4558495796795143, "set_robot_commands": 0.07261215238010182, "deviation-center-line": 0.6087215643124251, "driven_lanedir_consec": 1.1658630606928262, "sim_compute_sim_state": 0.03451577915864832, "sim_compute_performance-ego": 0.05818420017466826, "sim_compute_robot_state-ego": 0.05904504691853243}}
set_robot_commands_max0.07482973337173462
set_robot_commands_mean0.07396580481310576
set_robot_commands_median0.07450511720445421
set_robot_commands_min0.07261215238010182
sim_compute_performance-ego_max0.06209919613260061
sim_compute_performance-ego_mean0.0602619949476893
sim_compute_performance-ego_median0.06057746410369873
sim_compute_performance-ego_min0.05818420017466826
sim_compute_robot_state-ego_max0.06273002698631484
sim_compute_robot_state-ego_mean0.06133679373819512
sim_compute_robot_state-ego_median0.06145080893930763
sim_compute_robot_state-ego_min0.05904504691853243
sim_compute_sim_state_max0.0383239200078144
sim_compute_sim_state_mean0.03701047529469263
sim_compute_sim_state_median0.03739697615305582
sim_compute_sim_state_min0.03451577915864832
sim_physics_max0.018304869300960876
sim_physics_mean0.01632613404339136
sim_physics_median0.01579522212346395
sim_physics_min0.015242488244000605
sim_render-ego_max0.06214893790724364
sim_render-ego_mean0.05927628379062335
sim_render-ego_median0.0592636235555013
sim_render-ego_min0.05719570272109088
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.580000000000028
survival_time_min4.94999999999999
182092598Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationsuccessno-0:17:42Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.3718955388188578
survival_time_median14.250000000000068
deviation-center-line_median1.0913625725679328
in-drivable-lane_median1.2000000000000002


other stats
agent_compute-ego_max0.06185475399619655
agent_compute-ego_mean0.06019480685606752
agent_compute-ego_median0.06052307593516815
agent_compute-ego_min0.05758928140004476
deviation-center-line_max1.3446469219133124
deviation-center-line_mean0.9996385490926424
deviation-center-line_min0.441975693506799
deviation-heading_max5.380312368891966
deviation-heading_mean4.083371647398661
deviation-heading_median4.153144182407269
deviation-heading_min2.459843470763079
driven_any_max2.3555959043314787
driven_any_mean2.078597272898532
driven_any_median2.243086731015725
driven_any_min1.3029696106309303
driven_lanedir_consec_max2.001297202025861
driven_lanedir_consec_mean1.4349105348896465
driven_lanedir_consec_min1.0775236221846518
driven_lanedir_max2.0609409749550753
driven_lanedir_mean1.734693288107308
driven_lanedir_median1.7585123811007786
driven_lanedir_min1.1366299814157594
in-drivable-lane_max1.3000000000000185
in-drivable-lane_mean1.000000000000005
in-drivable-lane_min0.4000000000000048
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.135761711385022, "sim_physics": 0.01468478629003951, "survival_time": 13.65000000000006, "driven_lanedir": 1.7160859010390654, "sim_render-ego": 0.05371032966362251, "in-drivable-lane": 1.2000000000000002, "agent_compute-ego": 0.06052307593516815, "deviation-heading": 4.592333207438047, "set_robot_commands": 0.07407154093731891, "deviation-center-line": 1.1335923412166118, "driven_lanedir_consec": 1.0775236221846518, "sim_compute_sim_state": 0.03528877754351158, "sim_compute_performance-ego": 0.056252752031598775, "sim_compute_robot_state-ego": 0.05827971081157307}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.243086731015725, "sim_physics": 0.014862317369695297, "survival_time": 14.250000000000068, "driven_lanedir": 1.7585123811007786, "sim_render-ego": 0.05407543600651256, "in-drivable-lane": 1.2500000000000062, "agent_compute-ego": 0.06185475399619655, "deviation-heading": 5.380312368891966, "set_robot_commands": 0.07240669685497618, "deviation-center-line": 1.0913625725679328, "driven_lanedir_consec": 1.3718955388188578, "sim_compute_sim_state": 0.03546237778245357, "sim_compute_performance-ego": 0.05705245837830661, "sim_compute_robot_state-ego": 0.05857486390230948}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3555959043314787, "sim_physics": 0.01455013354619344, "survival_time": 14.950000000000076, "driven_lanedir": 2.001297202025861, "sim_render-ego": 0.05576692501703898, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.05940068324406942, "deviation-heading": 3.8312250074929457, "set_robot_commands": 0.07178133169809978, "deviation-center-line": 1.3446469219133124, "driven_lanedir_consec": 2.001297202025861, "sim_compute_sim_state": 0.034911410808563234, "sim_compute_performance-ego": 0.056577125390370686, "sim_compute_robot_state-ego": 0.05939144372940063}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3029696106309303, "sim_physics": 0.015151451031366983, "survival_time": 8.399999999999984, "driven_lanedir": 1.1366299814157594, "sim_render-ego": 0.05557702978452047, "in-drivable-lane": 0.4000000000000048, "agent_compute-ego": 0.06160623970485869, "deviation-heading": 2.459843470763079, "set_robot_commands": 0.07360100178491502, "deviation-center-line": 0.441975693506799, "driven_lanedir_consec": 1.1366299814157594, "sim_compute_sim_state": 0.034644844986143564, "sim_compute_performance-ego": 0.056129793326059975, "sim_compute_robot_state-ego": 0.057655184041886104}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3555724071295048, "sim_physics": 0.013993172645568848, "survival_time": 14.950000000000076, "driven_lanedir": 2.0609409749550753, "sim_render-ego": 0.054272541999816896, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.05758928140004476, "deviation-heading": 4.153144182407269, "set_robot_commands": 0.07106000502904256, "deviation-center-line": 0.986615216258556, "driven_lanedir_consec": 1.5872063300031, "sim_compute_sim_state": 0.03365384101867676, "sim_compute_performance-ego": 0.05660493532816569, "sim_compute_robot_state-ego": 0.056529270807902016}}
set_robot_commands_max0.07407154093731891
set_robot_commands_mean0.07258411526087047
set_robot_commands_median0.07240669685497618
set_robot_commands_min0.07106000502904256
sim_compute_performance-ego_max0.05705245837830661
sim_compute_performance-ego_mean0.05652341289090035
sim_compute_performance-ego_median0.056577125390370686
sim_compute_performance-ego_min0.056129793326059975
sim_compute_robot_state-ego_max0.05939144372940063
sim_compute_robot_state-ego_mean0.058086094658614265
sim_compute_robot_state-ego_median0.05827971081157307
sim_compute_robot_state-ego_min0.056529270807902016
sim_compute_sim_state_max0.03546237778245357
sim_compute_sim_state_mean0.03479225042786974
sim_compute_sim_state_median0.034911410808563234
sim_compute_sim_state_min0.03365384101867676
sim_physics_max0.015151451031366983
sim_physics_mean0.014648372176572815
sim_physics_median0.01468478629003951
sim_physics_min0.013993172645568848
sim_render-ego_max0.05576692501703898
sim_render-ego_mean0.05468045249430228
sim_render-ego_median0.054272541999816896
sim_render-ego_min0.05371032966362251
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.240000000000055
survival_time_min8.399999999999984
180202598Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationsuccessno-0:05:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8569736453381824
survival_time_median3.4999999999999956
deviation-center-line_median0.2488329025912469
in-drivable-lane_median0.1999999999999993


other stats
agent_compute-ego_max0.046194568856970056
agent_compute-ego_mean0.045115489253119145
agent_compute-ego_median0.04509608207210418
agent_compute-ego_min0.043807661967721546
deviation-center-line_max1.035133442901883
deviation-center-line_mean0.35929277754560107
deviation-center-line_min0.11343748045575304
deviation-heading_max3.8673790149503233
deviation-heading_mean1.2587077318070006
deviation-heading_median0.6591315338497642
deviation-heading_min0.27750445464078066
driven_any_max3.963872322492996
driven_any_mean1.531392311811355
driven_any_median1.12436587678041
driven_any_min0.46597887950418865
driven_lanedir_consec_max3.018198439167669
driven_lanedir_consec_mean1.1522541543690257
driven_lanedir_consec_min0.40271285874754126
driven_lanedir_max3.3599865456001976
driven_lanedir_mean1.2206117756555313
driven_lanedir_median0.8569736453381824
driven_lanedir_min0.40271285874754126
in-drivable-lane_max2.0499999999999976
in-drivable-lane_mean0.5999999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.46597887950418865, "sim_physics": 0.008475703577841482, "survival_time": 1.5500000000000007, "driven_lanedir": 0.4559137810460543, "sim_render-ego": 0.03714821415562784, "in-drivable-lane": 0, "agent_compute-ego": 0.04509608207210418, "deviation-heading": 0.27750445464078066, "set_robot_commands": 0.05298640651087607, "deviation-center-line": 0.11343748045575304, "driven_lanedir_consec": 0.4559137810460543, "sim_compute_sim_state": 0.024796624337473223, "sim_compute_performance-ego": 0.03821477582377772, "sim_compute_robot_state-ego": 0.0435207889926049}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.963872322492996, "sim_physics": 0.00877745817547385, "survival_time": 12.35000000000004, "driven_lanedir": 3.3599865456001976, "sim_render-ego": 0.03648832355916259, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.043807661967721546, "deviation-heading": 3.8673790149503233, "set_robot_commands": 0.052941470976300566, "deviation-center-line": 1.035133442901883, "driven_lanedir_consec": 3.018198439167669, "sim_compute_sim_state": 0.024651479141914893, "sim_compute_performance-ego": 0.03804113411227701, "sim_compute_robot_state-ego": 0.0422604518380725}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.2350593464340756, "sim_physics": 0.009587479876233386, "survival_time": 3.8499999999999943, "driven_lanedir": 0.40271285874754126, "sim_render-ego": 0.03637133325849261, "in-drivable-lane": 2.0499999999999976, "agent_compute-ego": 0.046194568856970056, "deviation-heading": 1.1307755594979705, "set_robot_commands": 0.0527391495642724, "deviation-center-line": 0.14148670884535536, "driven_lanedir_consec": 0.40271285874754126, "sim_compute_sim_state": 0.02459589227453455, "sim_compute_performance-ego": 0.037712623546649886, "sim_compute_robot_state-ego": 0.04333383077150815}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.8676851338451044, "sim_physics": 0.0092296423735442, "survival_time": 2.6999999999999984, "driven_lanedir": 0.8569736453381824, "sim_render-ego": 0.03596682901735659, "in-drivable-lane": 0, "agent_compute-ego": 0.04484657005027488, "deviation-heading": 0.35874809609616476, "set_robot_commands": 0.05248284339904785, "deviation-center-line": 0.2575733529337675, "driven_lanedir_consec": 0.8569736453381824, "sim_compute_sim_state": 0.025259914221587004, "sim_compute_performance-ego": 0.03907412069815176, "sim_compute_robot_state-ego": 0.04300406244066027}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.12436587678041, "sim_physics": 0.010955616406032017, "survival_time": 3.4999999999999956, "driven_lanedir": 1.0274720475456802, "sim_render-ego": 0.03666729586465018, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.04563256331852504, "deviation-heading": 0.6591315338497642, "set_robot_commands": 0.05304055213928223, "deviation-center-line": 0.2488329025912469, "driven_lanedir_consec": 1.0274720475456802, "sim_compute_sim_state": 0.024704384803771972, "sim_compute_performance-ego": 0.03834059579031808, "sim_compute_robot_state-ego": 0.04209080083029611}}
set_robot_commands_max0.05304055213928223
set_robot_commands_mean0.05283808451795582
set_robot_commands_median0.052941470976300566
set_robot_commands_min0.05248284339904785
sim_compute_performance-ego_max0.03907412069815176
sim_compute_performance-ego_mean0.03827664999423489
sim_compute_performance-ego_median0.03821477582377772
sim_compute_performance-ego_min0.037712623546649886
sim_compute_robot_state-ego_max0.0435207889926049
sim_compute_robot_state-ego_mean0.04284198697462839
sim_compute_robot_state-ego_median0.04300406244066027
sim_compute_robot_state-ego_min0.04209080083029611
sim_compute_sim_state_max0.025259914221587004
sim_compute_sim_state_mean0.024801658955856332
sim_compute_sim_state_median0.024704384803771972
sim_compute_sim_state_min0.02459589227453455
sim_physics_max0.010955616406032017
sim_physics_mean0.009405180081824989
sim_physics_median0.0092296423735442
sim_physics_min0.008475703577841482
sim_render-ego_max0.03714821415562784
sim_render-ego_mean0.03652839917105795
sim_render-ego_median0.03648832355916259
sim_render-ego_min0.03596682901735659
simulation-passed1
survival_time_max12.35000000000004
survival_time_mean4.790000000000006
survival_time_min1.5500000000000007