Duckietown Challenges Home Challenges Submissions

Evaluator 605

ID605
evaluatoruberduck
ownerLiam Paull 🇨🇦
machineuberduck
processuberduck
versiond-c:4.0.12;d-c-r:4.0.15;d-s:4.0.13
first heard
last heard
statusinactive
# evaluating
# success6 17529
# timeout
# failed
# error4 17503
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
175842364Andrea Censi 🇨🇭random_agentaido2-LFV-sim-testingstep1-simulationsuccessnouberduck0:06:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2342705027983982
survival_time_median1.7500000000000009
deviation-center-line_median0.10801953665034704
in-drivable-lane_median0.7000000000000004


other stats
agent_compute-ego_max0.10042970521109444
agent_compute-ego_mean0.098898089942685
agent_compute-ego_median0.0988404637291318
agent_compute-ego_min0.09663361821855818
deviation-center-line_max0.17768774509810673
deviation-center-line_mean0.08758489727910898
deviation-center-line_min0.019005533143064354
deviation-heading_max0.759385645220147
deviation-heading_mean0.3195081252333424
deviation-heading_median0.1806788823983304
deviation-heading_min0.118601117425238
driven_any_max2.812198352312563
driven_any_mean1.6891781761410722
driven_any_median1.608242001486626
driven_any_min0.3130680825984642
driven_lanedir_consec_max1.7389031534183392
driven_lanedir_consec_mean0.9694700664283822
driven_lanedir_consec_min0.28316071129320397
driven_lanedir_max1.7389031534183392
driven_lanedir_mean0.9694700664283822
driven_lanedir_median1.2342705027983982
driven_lanedir_min0.28316071129320397
in-drivable-lane_max1.5999999999999988
in-drivable-lane_mean0.7299999999999995
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.956358012875939, "sim_physics": 0.01941016445989194, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32939421125240065, "sim_render-ego": 0.04736886853757112, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.10040151554605237, "deviation-heading": 0.118601117425238, "set_robot_commands": 0.07099329906961192, "deviation-center-line": 0.02280708605632212, "driven_lanedir_consec": 0.32939421125240065, "sim_compute_sim_state": 0.028319794198741085, "sim_compute_performance-ego": 0.05027492150016453, "sim_compute_robot_state-ego": 0.052421310673589294, "sim_compute_robot_state-npc0": 0.04893580726955248, "sim_compute_robot_state-npc1": 0.050486782322759216, "sim_compute_robot_state-npc2": 0.049446458401887314, "sim_compute_robot_state-npc3": 0.05036412114682405}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.756024431431769, "sim_physics": 0.021526113633186583, "survival_time": 3.099999999999997, "driven_lanedir": 1.2342705027983982, "sim_render-ego": 0.04551927505000945, "in-drivable-lane": 1.5999999999999988, "agent_compute-ego": 0.09818514700858824, "deviation-heading": 0.4185133321358317, "set_robot_commands": 0.06592312935859926, "deviation-center-line": 0.11040458544770476, "driven_lanedir_consec": 1.2342705027983982, "sim_compute_sim_state": 0.02890681835912889, "sim_compute_performance-ego": 0.04880223351140176, "sim_compute_robot_state-ego": 0.051296030321428855, "sim_compute_robot_state-npc0": 0.05255044275714505, "sim_compute_robot_state-npc1": 0.05058166673106532, "sim_compute_robot_state-npc2": 0.04960930347442627, "sim_compute_robot_state-npc3": 0.05044802927201794}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3130680825984642, "sim_physics": 0.02110116822378976, "survival_time": 0.35, "driven_lanedir": 0.28316071129320397, "sim_render-ego": 0.04762870924813407, "in-drivable-lane": 0, "agent_compute-ego": 0.10042970521109444, "deviation-heading": 0.1203616489871648, "set_robot_commands": 0.06521214757646833, "deviation-center-line": 0.019005533143064354, "driven_lanedir_consec": 0.28316071129320397, "sim_compute_sim_state": 0.030599423817225864, "sim_compute_performance-ego": 0.048647369657244, "sim_compute_robot_state-ego": 0.05163468633379255, "sim_compute_robot_state-npc0": 0.05561692374093192, "sim_compute_robot_state-npc1": 0.04804222924368722, "sim_compute_robot_state-npc2": 0.05052382605416434, "sim_compute_robot_state-npc3": 0.05231142044067383}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.608242001486626, "sim_physics": 0.018639544078281948, "survival_time": 1.7500000000000009, "driven_lanedir": 1.2616217533795693, "sim_render-ego": 0.04508190836225237, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.09663361821855818, "deviation-heading": 0.1806788823983304, "set_robot_commands": 0.06696481704711914, "deviation-center-line": 0.10801953665034704, "driven_lanedir_consec": 1.2616217533795693, "sim_compute_sim_state": 0.029487732478550504, "sim_compute_performance-ego": 0.04835506847926548, "sim_compute_robot_state-ego": 0.04958203179495675, "sim_compute_robot_state-npc0": 0.051294190543038506, "sim_compute_robot_state-npc1": 0.050085864748273576, "sim_compute_robot_state-npc2": 0.04905026299612863, "sim_compute_robot_state-npc3": 0.05042095184326171}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.812198352312563, "sim_physics": 0.02102873438880557, "survival_time": 3.149999999999997, "driven_lanedir": 1.7389031534183392, "sim_render-ego": 0.0464766782427591, "in-drivable-lane": 0.9999999999999982, "agent_compute-ego": 0.0988404637291318, "deviation-heading": 0.759385645220147, "set_robot_commands": 0.06700493418981159, "deviation-center-line": 0.17768774509810673, "driven_lanedir_consec": 1.7389031534183392, "sim_compute_sim_state": 0.02839802938794333, "sim_compute_performance-ego": 0.04846273906647213, "sim_compute_robot_state-ego": 0.05064554063100663, "sim_compute_robot_state-npc0": 0.050132573597014896, "sim_compute_robot_state-npc1": 0.050497626501416405, "sim_compute_robot_state-npc2": 0.04985701470147995, "sim_compute_robot_state-npc3": 0.0512458634754968}}
set_robot_commands_max0.07099329906961192
set_robot_commands_mean0.06721966544832204
set_robot_commands_median0.06696481704711914
set_robot_commands_min0.06521214757646833
sim_compute_performance-ego_max0.05027492150016453
sim_compute_performance-ego_mean0.04890846644290958
sim_compute_performance-ego_median0.048647369657244
sim_compute_performance-ego_min0.04835506847926548
sim_compute_robot_state-ego_max0.052421310673589294
sim_compute_robot_state-ego_mean0.05111591995095481
sim_compute_robot_state-ego_median0.051296030321428855
sim_compute_robot_state-ego_min0.04958203179495675
sim_compute_robot_state-npc0_max0.05561692374093192
sim_compute_robot_state-npc0_mean0.05170598758153657
sim_compute_robot_state-npc0_median0.051294190543038506
sim_compute_robot_state-npc0_min0.04893580726955248
sim_compute_robot_state-npc1_max0.05058166673106532
sim_compute_robot_state-npc1_mean0.049938833909440344
sim_compute_robot_state-npc1_median0.050486782322759216
sim_compute_robot_state-npc1_min0.04804222924368722
sim_compute_robot_state-npc2_max0.05052382605416434
sim_compute_robot_state-npc2_mean0.049697373125617304
sim_compute_robot_state-npc2_median0.04960930347442627
sim_compute_robot_state-npc2_min0.04905026299612863
sim_compute_robot_state-npc3_max0.05231142044067383
sim_compute_robot_state-npc3_mean0.050958077235654875
sim_compute_robot_state-npc3_median0.05044802927201794
sim_compute_robot_state-npc3_min0.05036412114682405
sim_compute_sim_state_max0.030599423817225864
sim_compute_sim_state_mean0.029142359648317937
sim_compute_sim_state_median0.02890681835912889
sim_compute_sim_state_min0.028319794198741085
sim_physics_max0.021526113633186583
sim_physics_mean0.02034114495679116
sim_physics_median0.02102873438880557
sim_physics_min0.018639544078281948
sim_render-ego_max0.04762870924813407
sim_render-ego_mean0.046415087888145225
sim_render-ego_median0.0464766782427591
sim_render-ego_min0.04508190836225237
simulation-passed1
survival_time_max3.149999999999997
survival_time_mean1.899999999999999
survival_time_min0.35
No reset possible
175792383Andrea Censi 🇨🇭Baseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationsuccessnouberduck0:03:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.08174922273061869
survival_time_median0.49999999999999994
deviation-center-line_median0.014423889620914326
in-drivable-lane_median0.19999999999999996


other stats
agent_compute-ego_max0.1379352699626576
agent_compute-ego_mean0.12886148491463106
agent_compute-ego_median0.1297707557678223
agent_compute-ego_min0.1210697719029018
deviation-center-line_max0.026847349439881284
deviation-center-line_mean0.015154406631586704
deviation-center-line_min0.007927958073861026
deviation-heading_max0.6505763557155801
deviation-heading_mean0.31218799372077033
deviation-heading_median0.24508270306293573
deviation-heading_min0.1568231251200332
driven_any_max0.5092911870017179
driven_any_mean0.22831839216922525
driven_any_median0.1529393093442673
driven_any_min0.14259196163049598
driven_lanedir_consec_max0.19098317268009168
driven_lanedir_consec_mean0.09334938355148278
driven_lanedir_consec_min0.041362776755115016
driven_lanedir_max0.19098317268009168
driven_lanedir_mean0.09334938355148278
driven_lanedir_median0.08174922273061869
driven_lanedir_min0.041362776755115016
in-drivable-lane_max0.7000000000000004
in-drivable-lane_mean0.24000000000000005
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.19135851800470036, "sim_physics": 0.012453621084039862, "survival_time": 0.5499999999999999, "driven_lanedir": 0.08174922273061869, "sim_render-ego": 0.048759807239879265, "in-drivable-lane": 0.24999999999999992, "agent_compute-ego": 0.1379352699626576, "deviation-heading": 0.1568231251200332, "set_robot_commands": 0.06726525046608665, "deviation-center-line": 0.007927958073861026, "driven_lanedir_consec": 0.08174922273061869, "sim_compute_sim_state": 0.029684673656116833, "sim_compute_performance-ego": 0.05108503861860795, "sim_compute_robot_state-ego": 0.05158038572831587}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1529393093442673, "sim_physics": 0.011868667602539063, "survival_time": 0.49999999999999994, "driven_lanedir": 0.041362776755115016, "sim_render-ego": 0.04666857719421387, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.13000433444976806, "deviation-heading": 0.24508270306293573, "set_robot_commands": 0.06897566318511963, "deviation-center-line": 0.01077773991312733, "driven_lanedir_consec": 0.041362776755115016, "sim_compute_sim_state": 0.030225849151611327, "sim_compute_performance-ego": 0.04891636371612549, "sim_compute_robot_state-ego": 0.06267426013946534}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.14541098486494472, "sim_physics": 0.01093111719403948, "survival_time": 0.35, "driven_lanedir": 0.08534850105435554, "sim_render-ego": 0.06437563896179199, "in-drivable-lane": 0, "agent_compute-ego": 0.1210697719029018, "deviation-heading": 0.2449330014779288, "set_robot_commands": 0.06487117494855608, "deviation-center-line": 0.015795096110149558, "driven_lanedir_consec": 0.08534850105435554, "sim_compute_sim_state": 0.03102949687412807, "sim_compute_performance-ego": 0.0512892518724714, "sim_compute_robot_state-ego": 0.05094797270638602}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.14259196163049598, "sim_physics": 0.012930840253829956, "survival_time": 0.4, "driven_lanedir": 0.06730324453723302, "sim_render-ego": 0.04645976424217224, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.1297707557678223, "deviation-heading": 0.2635247832273736, "set_robot_commands": 0.06989765167236328, "deviation-center-line": 0.014423889620914326, "driven_lanedir_consec": 0.06730324453723302, "sim_compute_sim_state": 0.02981626987457275, "sim_compute_performance-ego": 0.049445390701293945, "sim_compute_robot_state-ego": 0.052000850439071655}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5092911870017179, "sim_physics": 0.01234089583158493, "survival_time": 1.6000000000000008, "driven_lanedir": 0.19098317268009168, "sim_render-ego": 0.04782441258430481, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.1255272924900055, "deviation-heading": 0.6505763557155801, "set_robot_commands": 0.07122509181499481, "deviation-center-line": 0.026847349439881284, "driven_lanedir_consec": 0.19098317268009168, "sim_compute_sim_state": 0.0297669917345047, "sim_compute_performance-ego": 0.0508040264248848, "sim_compute_robot_state-ego": 0.051364265382289886}}
set_robot_commands_max0.07122509181499481
set_robot_commands_mean0.0684469664174241
set_robot_commands_median0.06897566318511963
set_robot_commands_min0.06487117494855608
sim_compute_performance-ego_max0.0512892518724714
sim_compute_performance-ego_mean0.05030801426667673
sim_compute_performance-ego_median0.0508040264248848
sim_compute_performance-ego_min0.04891636371612549
sim_compute_robot_state-ego_max0.06267426013946534
sim_compute_robot_state-ego_mean0.053713546879105754
sim_compute_robot_state-ego_median0.05158038572831587
sim_compute_robot_state-ego_min0.05094797270638602
sim_compute_sim_state_max0.03102949687412807
sim_compute_sim_state_mean0.030104656258186736
sim_compute_sim_state_median0.02981626987457275
sim_compute_sim_state_min0.029684673656116833
sim_physics_max0.012930840253829956
sim_physics_mean0.01210502839320666
sim_physics_median0.01234089583158493
sim_physics_min0.01093111719403948
sim_render-ego_max0.06437563896179199
sim_render-ego_mean0.05081764004447244
sim_render-ego_median0.04782441258430481
sim_render-ego_min0.04645976424217224
simulation-passed1
survival_time_max1.6000000000000008
survival_time_mean0.68
survival_time_min0.35
No reset possible
175742401Bhairav MehtaBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationerrornouberduck0:01:33
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
175672387Andrea Censi 🇨🇭Baseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationsuccessnouberduck0:03:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.08015382978574004
survival_time_median0.4
deviation-center-line_median0.019675203272866065
in-drivable-lane_median0.04999999999999999


other stats
agent_compute-ego_max0.13468459674290248
agent_compute-ego_mean0.1304902975332169
agent_compute-ego_median0.1297661542892456
agent_compute-ego_min0.12544149160385132
deviation-center-line_max0.02126826454740233
deviation-center-line_mean0.017516587025084965
deviation-center-line_min0.011611409052360263
deviation-heading_max0.30035325950559444
deviation-heading_mean0.26315869883093146
deviation-heading_median0.25635472591966374
deviation-heading_min0.2121705105065998
driven_any_max0.20580969893039375
driven_any_mean0.1589997189597014
driven_any_median0.1558184923530811
driven_any_min0.13154223240220828
driven_lanedir_consec_max0.14131733413694825
driven_lanedir_consec_mean0.08805227283288511
driven_lanedir_consec_min0.06303235967737386
driven_lanedir_max0.14131733413694825
driven_lanedir_mean0.08805227283288511
driven_lanedir_median0.08015382978574004
driven_lanedir_min0.06303235967737386
in-drivable-lane_max0.04999999999999999
in-drivable-lane_mean0.039999999999999994
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.1616601462800607, "sim_physics": 0.024807244539260864, "survival_time": 0.4, "driven_lanedir": 0.08744916732117103, "sim_render-ego": 0.04589870572090149, "in-drivable-lane": 0, "agent_compute-ego": 0.1327935755252838, "deviation-heading": 0.30035325950559444, "set_robot_commands": 0.06925013661384583, "deviation-center-line": 0.02077580427068772, "driven_lanedir_consec": 0.08744916732117103, "sim_compute_sim_state": 0.028391391038894653, "sim_compute_performance-ego": 0.04945001006126404, "sim_compute_robot_state-ego": 0.05027216672897339, "sim_compute_robot_state-npc0": 0.05013957619667053, "sim_compute_robot_state-npc1": 0.052194178104400635, "sim_compute_robot_state-npc2": 0.04980212450027466, "sim_compute_robot_state-npc3": 0.05092790722846985}, "udem1-1-0": {"driven_any": 0.13154223240220828, "sim_physics": 0.025434323719569617, "survival_time": 0.35, "driven_lanedir": 0.06303235967737386, "sim_render-ego": 0.04766498293195452, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.13468459674290248, "deviation-heading": 0.2121705105065998, "set_robot_commands": 0.06947486741202218, "deviation-center-line": 0.011611409052360263, "driven_lanedir_consec": 0.06303235967737386, "sim_compute_sim_state": 0.028789452144077847, "sim_compute_performance-ego": 0.04904985427856445, "sim_compute_robot_state-ego": 0.05154670987810407, "sim_compute_robot_state-npc0": 0.0507685797555106, "sim_compute_robot_state-npc1": 0.05298495292663574, "sim_compute_robot_state-npc2": 0.05003435271126883, "sim_compute_robot_state-npc3": 0.04946756362915039}, "udem1-2-0": {"driven_any": 0.1401680248327633, "sim_physics": 0.025999009609222412, "survival_time": 0.4, "driven_lanedir": 0.06830867324319234, "sim_render-ego": 0.04546484351158142, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.12544149160385132, "deviation-heading": 0.25635472591966374, "set_robot_commands": 0.06835028529167175, "deviation-center-line": 0.014252253982108446, "driven_lanedir_consec": 0.06830867324319234, "sim_compute_sim_state": 0.027969539165496823, "sim_compute_performance-ego": 0.04626217484474182, "sim_compute_robot_state-ego": 0.04768571257591248, "sim_compute_robot_state-npc0": 0.051516056060791016, "sim_compute_robot_state-npc1": 0.05146130919456482, "sim_compute_robot_state-npc2": 0.04627633094787598, "sim_compute_robot_state-npc3": 0.04902291297912598}, "udem1-3-0": {"driven_any": 0.1558184923530811, "sim_physics": 0.02451377444797092, "survival_time": 0.45, "driven_lanedir": 0.08015382978574004, "sim_render-ego": 0.050982899136013456, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.12976566950480142, "deviation-heading": 0.2978948517976438, "set_robot_commands": 0.066502226723565, "deviation-center-line": 0.019675203272866065, "driven_lanedir_consec": 0.08015382978574004, "sim_compute_sim_state": 0.028803904851277668, "sim_compute_performance-ego": 0.06430776913960774, "sim_compute_robot_state-ego": 0.050540553198920354, "sim_compute_robot_state-npc0": 0.05339278115166558, "sim_compute_robot_state-npc1": 0.05138217078314887, "sim_compute_robot_state-npc2": 0.050401926040649414, "sim_compute_robot_state-npc3": 0.05018917719523112}, "udem1-4-0": {"driven_any": 0.20580969893039375, "sim_physics": 0.0234266996383667, "survival_time": 0.49999999999999994, "driven_lanedir": 0.14131733413694825, "sim_render-ego": 0.04743397235870361, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.1297661542892456, "deviation-heading": 0.2490201464251557, "set_robot_commands": 0.06855049133300781, "deviation-center-line": 0.02126826454740233, "driven_lanedir_consec": 0.14131733413694825, "sim_compute_sim_state": 0.028369617462158204, "sim_compute_performance-ego": 0.04837601184844971, "sim_compute_robot_state-ego": 0.05073096752166748, "sim_compute_robot_state-npc0": 0.0503309965133667, "sim_compute_robot_state-npc1": 0.05094945430755615, "sim_compute_robot_state-npc2": 0.05258810520172119, "sim_compute_robot_state-npc3": 0.04960801601409912}}
set_robot_commands_max0.06947486741202218
set_robot_commands_mean0.0684256014748225
set_robot_commands_median0.06855049133300781
set_robot_commands_min0.066502226723565
sim_compute_performance-ego_max0.06430776913960774
sim_compute_performance-ego_mean0.051489164034525546
sim_compute_performance-ego_median0.04904985427856445
sim_compute_performance-ego_min0.04626217484474182
sim_compute_robot_state-ego_max0.05154670987810407
sim_compute_robot_state-ego_mean0.05015522198071556
sim_compute_robot_state-ego_median0.050540553198920354
sim_compute_robot_state-ego_min0.04768571257591248
sim_compute_robot_state-npc0_max0.05339278115166558
sim_compute_robot_state-npc0_mean0.05122959793560089
sim_compute_robot_state-npc0_median0.0507685797555106
sim_compute_robot_state-npc0_min0.05013957619667053
sim_compute_robot_state-npc1_max0.05298495292663574
sim_compute_robot_state-npc1_mean0.05179441306326125
sim_compute_robot_state-npc1_median0.05146130919456482
sim_compute_robot_state-npc1_min0.05094945430755615
sim_compute_robot_state-npc2_max0.05258810520172119
sim_compute_robot_state-npc2_mean0.04982056788035801
sim_compute_robot_state-npc2_median0.05003435271126883
sim_compute_robot_state-npc2_min0.04627633094787598
sim_compute_robot_state-npc3_max0.05092790722846985
sim_compute_robot_state-npc3_mean0.04984311540921529
sim_compute_robot_state-npc3_median0.04960801601409912
sim_compute_robot_state-npc3_min0.04902291297912598
sim_compute_sim_state_max0.028803904851277668
sim_compute_sim_state_mean0.02846478093238104
sim_compute_sim_state_median0.028391391038894653
sim_compute_sim_state_min0.027969539165496823
sim_physics_max0.025999009609222412
sim_physics_mean0.0248362103908781
sim_physics_median0.024807244539260864
sim_physics_min0.0234266996383667
sim_render-ego_max0.050982899136013456
sim_render-ego_mean0.047489080731830904
sim_render-ego_median0.04743397235870361
sim_render-ego_min0.04546484351158142
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.41999999999999993
survival_time_min0.35
No reset possible
175492373Liam Paull 🇨🇦minimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationsuccessnouberduck0:13:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.72155331423772
survival_time_median4.249999999999993
deviation-center-line_median0.15741823007542524
in-drivable-lane_median1.7499999999999938


other stats
agent_compute-ego_max0.11234229679765372
agent_compute-ego_mean0.11199728218750378
agent_compute-ego_median0.11199415452552564
agent_compute-ego_min0.11167705059051514
deviation-center-line_max0.32861340027620084
deviation-center-line_mean0.16720563088123774
deviation-center-line_min0.08372346350452832
deviation-heading_max1.6095487863912878
deviation-heading_mean0.7416120746207572
deviation-heading_median0.6111580236941071
deviation-heading_min0.3663194255812494
driven_any_max2.174849274549989
driven_any_mean1.370290316170529
driven_any_median1.2632550932005688
driven_any_min0.9890108043245008
driven_lanedir_consec_max1.0300199271670714
driven_lanedir_consec_mean0.7679244191832472
driven_lanedir_consec_min0.523101221541693
driven_lanedir_max1.0586376106182156
driven_lanedir_mean0.773647955873476
driven_lanedir_median0.72155331423772
driven_lanedir_min0.523101221541693
in-drivable-lane_max3.149999999999989
in-drivable-lane_mean1.7699999999999938
in-drivable-lane_min0.1999999999999993
per-episodes
details{"udem1-0-0": {"driven_any": 2.174849274549989, "sim_physics": 0.024323716656915073, "survival_time": 7.249999999999982, "driven_lanedir": 1.0586376106182156, "sim_render-ego": 0.04815048678167935, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.11234229679765372, "deviation-heading": 1.6095487863912878, "set_robot_commands": 0.06832846279801993, "deviation-center-line": 0.32861340027620084, "driven_lanedir_consec": 1.0300199271670714, "sim_compute_sim_state": 0.029217476680360992, "sim_compute_performance-ego": 0.04925300992768386, "sim_compute_robot_state-ego": 0.051846944874730606, "sim_compute_robot_state-npc0": 0.05065412521362304, "sim_compute_robot_state-npc1": 0.050532515295620625, "sim_compute_robot_state-npc2": 0.050358958079897126, "sim_compute_robot_state-npc3": 0.049970345661557954}, "udem1-1-0": {"driven_any": 0.9890108043245008, "sim_physics": 0.024296348745172672, "survival_time": 3.2999999999999963, "driven_lanedir": 0.6673090295116273, "sim_render-ego": 0.04719057227625991, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.11199415452552564, "deviation-heading": 0.6111580236941071, "set_robot_commands": 0.06775172912713254, "deviation-center-line": 0.08372346350452832, "driven_lanedir_consec": 0.6673090295116273, "sim_compute_sim_state": 0.02961575984954834, "sim_compute_performance-ego": 0.05015327352466005, "sim_compute_robot_state-ego": 0.05502595684745095, "sim_compute_robot_state-npc0": 0.050929452433730614, "sim_compute_robot_state-npc1": 0.05017658074696859, "sim_compute_robot_state-npc2": 0.04989469773841627, "sim_compute_robot_state-npc3": 0.05028308521617542}, "udem1-2-0": {"driven_any": 1.4132589628801058, "sim_physics": 0.026068337420199775, "survival_time": 4.699999999999991, "driven_lanedir": 0.523101221541693, "sim_render-ego": 0.04819935687044834, "in-drivable-lane": 2.8999999999999906, "agent_compute-ego": 0.11191040150662686, "deviation-heading": 0.3663194255812494, "set_robot_commands": 0.06679683543266134, "deviation-center-line": 0.10412585673382428, "driven_lanedir_consec": 0.523101221541693, "sim_compute_sim_state": 0.029631371193743768, "sim_compute_performance-ego": 0.0492914636084374, "sim_compute_robot_state-ego": 0.051684894460312866, "sim_compute_robot_state-npc0": 0.05076437808097677, "sim_compute_robot_state-npc1": 0.050458806626340176, "sim_compute_robot_state-npc2": 0.05062711746134656, "sim_compute_robot_state-npc3": 0.05107808874008504}, "udem1-3-0": {"driven_any": 1.2632550932005688, "sim_physics": 0.025593059203203983, "survival_time": 4.249999999999993, "driven_lanedir": 0.72155331423772, "sim_render-ego": 0.04710266730364631, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.11206250751719755, "deviation-heading": 0.37503744954470697, "set_robot_commands": 0.06684501872343175, "deviation-center-line": 0.15741823007542524, "driven_lanedir_consec": 0.72155331423772, "sim_compute_sim_state": 0.028379221523509305, "sim_compute_performance-ego": 0.04937545832465677, "sim_compute_robot_state-ego": 0.05161130288067986, "sim_compute_robot_state-npc0": 0.050800901300766886, "sim_compute_robot_state-npc1": 0.04967958786908318, "sim_compute_robot_state-npc2": 0.0503237948698156, "sim_compute_robot_state-npc3": 0.05166507047765395}, "udem1-4-0": {"driven_any": 1.0110774458974832, "sim_physics": 0.023828320643481088, "survival_time": 3.399999999999996, "driven_lanedir": 0.8976386034581241, "sim_render-ego": 0.04760429438422708, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.11167705059051514, "deviation-heading": 0.7459966878924339, "set_robot_commands": 0.06788932225283455, "deviation-center-line": 0.16214720381621003, "driven_lanedir_consec": 0.8976386034581241, "sim_compute_sim_state": 0.02980818467981675, "sim_compute_performance-ego": 0.04929121452219346, "sim_compute_robot_state-ego": 0.05024731159210205, "sim_compute_robot_state-npc0": 0.05319020327399759, "sim_compute_robot_state-npc1": 0.05021663623697618, "sim_compute_robot_state-npc2": 0.0507888864068424, "sim_compute_robot_state-npc3": 0.05069582953172572}}
set_robot_commands_max0.06832846279801993
set_robot_commands_mean0.06752227366681603
set_robot_commands_median0.06775172912713254
set_robot_commands_min0.06679683543266134
sim_compute_performance-ego_max0.05015327352466005
sim_compute_performance-ego_mean0.04947288398152631
sim_compute_performance-ego_median0.0492914636084374
sim_compute_performance-ego_min0.04925300992768386
sim_compute_robot_state-ego_max0.05502595684745095
sim_compute_robot_state-ego_mean0.052083282131055265
sim_compute_robot_state-ego_median0.051684894460312866
sim_compute_robot_state-ego_min0.05024731159210205
sim_compute_robot_state-npc0_max0.05319020327399759
sim_compute_robot_state-npc0_mean0.05126781206061898
sim_compute_robot_state-npc0_median0.050800901300766886
sim_compute_robot_state-npc0_min0.05065412521362304
sim_compute_robot_state-npc1_max0.050532515295620625
sim_compute_robot_state-npc1_mean0.05021282535499775
sim_compute_robot_state-npc1_median0.05021663623697618
sim_compute_robot_state-npc1_min0.04967958786908318
sim_compute_robot_state-npc2_max0.0507888864068424
sim_compute_robot_state-npc2_mean0.05039869091126359
sim_compute_robot_state-npc2_median0.050358958079897126
sim_compute_robot_state-npc2_min0.04989469773841627
sim_compute_robot_state-npc3_max0.05166507047765395
sim_compute_robot_state-npc3_mean0.050738483925439615
sim_compute_robot_state-npc3_median0.05069582953172572
sim_compute_robot_state-npc3_min0.049970345661557954
sim_compute_sim_state_max0.02980818467981675
sim_compute_sim_state_mean0.02933040278539583
sim_compute_sim_state_median0.02961575984954834
sim_compute_sim_state_min0.028379221523509305
sim_physics_max0.026068337420199775
sim_physics_mean0.02482195653379452
sim_physics_median0.024323716656915073
sim_physics_min0.023828320643481088
sim_render-ego_max0.04819935687044834
sim_render-ego_mean0.0476494755232522
sim_render-ego_median0.04760429438422708
sim_render-ego_min0.04710266730364631
simulation-passed1
survival_time_max7.249999999999982
survival_time_mean4.579999999999992
survival_time_min3.2999999999999963
No reset possible
175402378Liam Paull 🇨🇦minimal_agent_python2 (Python 2)aido2-LFV-sim-validationstep1-simulationsuccessnouberduck0:08:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2501898935829012
survival_time_median2.6499999999999986
deviation-center-line_median0.02537368915309797
in-drivable-lane_median0.4999999999999982


other stats
agent_compute-ego_max0.04476358305733159
agent_compute-ego_mean0.04433765644656971
agent_compute-ego_median0.044535680250688034
agent_compute-ego_min0.04340861428458736
deviation-center-line_max0.03472425682418009
deviation-center-line_mean0.026347234341453415
deviation-center-line_min0.020890767023363815
deviation-heading_max0.20304552908957563
deviation-heading_mean0.19365741902006536
deviation-heading_median0.2030454232515352
deviation-heading_min0.1784042009688801
driven_any_max2.7599999999999936
driven_any_mean1.7039999999999988
driven_any_median1.59
driven_any_min0.9900000000000012
driven_lanedir_consec_max2.526717455318104
driven_lanedir_consec_mean1.3866776713319673
driven_lanedir_consec_min0.6561020726944444
driven_lanedir_max2.526717455318104
driven_lanedir_mean1.3866776713319673
driven_lanedir_median1.2501898935829012
driven_lanedir_min0.6561020726944444
in-drivable-lane_max0.5000000000000004
in-drivable-lane_mean0.4699999999999987
in-drivable-lane_min0.34999999999999876
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900000000000012, "sim_physics": 0.019303625280206852, "survival_time": 1.6500000000000008, "driven_lanedir": 0.6561020726944444, "sim_render-ego": 0.04842874498078317, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.044535680250688034, "deviation-heading": 0.18074641270076017, "set_robot_commands": 0.06843546665076053, "deviation-center-line": 0.020890767023363815, "driven_lanedir_consec": 0.6561020726944444, "sim_compute_sim_state": 0.029686747175274475, "sim_compute_performance-ego": 0.05140858708005963, "sim_compute_robot_state-ego": 0.051617882468483665, "sim_compute_robot_state-npc0": 0.05140317570079456, "sim_compute_robot_state-npc1": 0.05117630236076586, "sim_compute_robot_state-npc2": 0.05242917031952829, "sim_compute_robot_state-npc3": 0.05062142285433682}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.7599999999999936, "sim_physics": 0.022914557353309963, "survival_time": 4.599999999999992, "driven_lanedir": 2.526717455318104, "sim_render-ego": 0.04831325230391129, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.04443420534548552, "deviation-heading": 0.1784042009688801, "set_robot_commands": 0.06910602942756984, "deviation-center-line": 0.03472425682418009, "driven_lanedir_consec": 2.526717455318104, "sim_compute_sim_state": 0.02978637166645216, "sim_compute_performance-ego": 0.05108354143474413, "sim_compute_robot_state-ego": 0.05188911894093389, "sim_compute_robot_state-npc0": 0.05188628642455391, "sim_compute_robot_state-npc1": 0.05116325875987177, "sim_compute_robot_state-npc2": 0.051433682441711426, "sim_compute_robot_state-npc3": 0.05163487921590391}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.59, "sim_physics": 0.02022890324862498, "survival_time": 2.6499999999999986, "driven_lanedir": 1.2501898935829012, "sim_render-ego": 0.04827294259701135, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.04340861428458736, "deviation-heading": 0.20304552908957563, "set_robot_commands": 0.06869262569355515, "deviation-center-line": 0.02537368915309797, "driven_lanedir_consec": 1.2501898935829012, "sim_compute_sim_state": 0.029948014133381395, "sim_compute_performance-ego": 0.05021230679637981, "sim_compute_robot_state-ego": 0.050567217592923146, "sim_compute_robot_state-npc0": 0.05096130101185924, "sim_compute_robot_state-npc1": 0.050893185273656306, "sim_compute_robot_state-npc2": 0.05173053381577978, "sim_compute_robot_state-npc3": 0.050983096068760135}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.59, "sim_physics": 0.02068509245818516, "survival_time": 2.6499999999999986, "driven_lanedir": 1.2501898935829012, "sim_render-ego": 0.04733914699194566, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.04454619929475604, "deviation-heading": 0.20304552908957563, "set_robot_commands": 0.06852450460757849, "deviation-center-line": 0.02537368915309797, "driven_lanedir_consec": 1.2501898935829012, "sim_compute_sim_state": 0.029627656036952756, "sim_compute_performance-ego": 0.05204620001451025, "sim_compute_robot_state-ego": 0.051762391936104254, "sim_compute_robot_state-npc0": 0.051698801652440486, "sim_compute_robot_state-npc1": 0.05163105028980183, "sim_compute_robot_state-npc2": 0.051654496282901405, "sim_compute_robot_state-npc3": 0.05132465992333754}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.59, "sim_physics": 0.02120342344607947, "survival_time": 2.6499999999999986, "driven_lanedir": 1.2501890414814851, "sim_render-ego": 0.04820985614128832, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.04476358305733159, "deviation-heading": 0.2030454232515352, "set_robot_commands": 0.06897884494853469, "deviation-center-line": 0.02537376955352725, "driven_lanedir_consec": 1.2501890414814851, "sim_compute_sim_state": 0.03057270679833754, "sim_compute_performance-ego": 0.050910360408279134, "sim_compute_robot_state-ego": 0.05125846053069493, "sim_compute_robot_state-npc0": 0.0516036681409152, "sim_compute_robot_state-npc1": 0.052352468922453106, "sim_compute_robot_state-npc2": 0.0519778458577282, "sim_compute_robot_state-npc3": 0.051200848705363726}}
set_robot_commands_max0.06910602942756984
set_robot_commands_mean0.06874749426559974
set_robot_commands_median0.06869262569355515
set_robot_commands_min0.06843546665076053
sim_compute_performance-ego_max0.05204620001451025
sim_compute_performance-ego_mean0.05113219914679459
sim_compute_performance-ego_median0.05108354143474413
sim_compute_performance-ego_min0.05021230679637981
sim_compute_robot_state-ego_max0.05188911894093389
sim_compute_robot_state-ego_mean0.05141901429382798
sim_compute_robot_state-ego_median0.051617882468483665
sim_compute_robot_state-ego_min0.050567217592923146
sim_compute_robot_state-npc0_max0.05188628642455391
sim_compute_robot_state-npc0_mean0.051510646586112686
sim_compute_robot_state-npc0_median0.0516036681409152
sim_compute_robot_state-npc0_min0.05096130101185924
sim_compute_robot_state-npc1_max0.052352468922453106
sim_compute_robot_state-npc1_mean0.051443253121309776
sim_compute_robot_state-npc1_median0.05117630236076586
sim_compute_robot_state-npc1_min0.050893185273656306
sim_compute_robot_state-npc2_max0.05242917031952829
sim_compute_robot_state-npc2_mean0.051845145743529816
sim_compute_robot_state-npc2_median0.05173053381577978
sim_compute_robot_state-npc2_min0.051433682441711426
sim_compute_robot_state-npc3_max0.05163487921590391
sim_compute_robot_state-npc3_mean0.051152981353540426
sim_compute_robot_state-npc3_median0.051200848705363726
sim_compute_robot_state-npc3_min0.05062142285433682
sim_compute_sim_state_max0.03057270679833754
sim_compute_sim_state_mean0.029924299162079664
sim_compute_sim_state_median0.02978637166645216
sim_compute_sim_state_min0.029627656036952756
sim_physics_max0.022914557353309963
sim_physics_mean0.020867120357281287
sim_physics_median0.02068509245818516
sim_physics_min0.019303625280206852
sim_render-ego_max0.04842874498078317
sim_render-ego_mean0.048112788602987955
sim_render-ego_median0.04827294259701135
sim_render-ego_min0.04733914699194566
simulation-passed1
survival_time_max4.599999999999992
survival_time_mean2.8399999999999976
survival_time_min1.6500000000000008
No reset possible
175292371Liam Paull 🇨🇦minimal_agent (Python 3)aido2-LFV-sim-testingstep1-simulationsuccessnouberduck0:11:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8516119779536884
survival_time_median3.399999999999996
deviation-center-line_median0.16534908678864438
in-drivable-lane_median1.3499999999999952


other stats
agent_compute-ego_max0.11132092475891112
agent_compute-ego_mean0.110897188478084
agent_compute-ego_median0.11089803532856268
agent_compute-ego_min0.11050248146057128
deviation-center-line_max0.2078435673968125
deviation-center-line_mean0.15835662027727432
deviation-center-line_min0.1128230942788872
deviation-heading_max0.3886055345167397
deviation-heading_mean0.352177996344455
deviation-heading_median0.37092376484647793
deviation-heading_min0.30707254041461957
driven_any_max1.4782765184420794
driven_any_mean1.1315473506196985
driven_any_median1.0097725221691731
driven_any_min0.9477327875430378
driven_lanedir_consec_max0.9654696798546664
driven_lanedir_consec_mean0.7930140409285634
driven_lanedir_consec_min0.5879893173150568
driven_lanedir_max0.9654696798546664
driven_lanedir_mean0.7930140409285634
driven_lanedir_median0.8516119779536884
driven_lanedir_min0.5879893173150568
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.079999999999996
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0097725221691731, "sim_physics": 0.02124865966684678, "survival_time": 3.399999999999996, "driven_lanedir": 0.5879893173150568, "sim_render-ego": 0.04841061550028184, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.11052968572167789, "deviation-heading": 0.3886055345167397, "set_robot_commands": 0.06639330877977259, "deviation-center-line": 0.1128230942788872, "driven_lanedir_consec": 0.5879893173150568, "sim_compute_sim_state": 0.029434288249296305, "sim_compute_performance-ego": 0.048935146892772, "sim_compute_robot_state-ego": 0.05146934355006499, "sim_compute_robot_state-npc0": 0.05060129656511195, "sim_compute_robot_state-npc1": 0.05037384524064906, "sim_compute_robot_state-npc2": 0.049755040337057674, "sim_compute_robot_state-npc3": 0.05028187527376063}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9477327875430378, "sim_physics": 0.023236520706661164, "survival_time": 3.149999999999997, "driven_lanedir": 0.941649338159904, "sim_render-ego": 0.047591440261356414, "in-drivable-lane": 0, "agent_compute-ego": 0.11050248146057128, "deviation-heading": 0.31560468369522693, "set_robot_commands": 0.06745213175576831, "deviation-center-line": 0.18553797137348788, "driven_lanedir_consec": 0.941649338159904, "sim_compute_sim_state": 0.02956292364332411, "sim_compute_performance-ego": 0.04967039350479368, "sim_compute_robot_state-ego": 0.05211619725303045, "sim_compute_robot_state-npc0": 0.050655686666095066, "sim_compute_robot_state-npc1": 0.05028945680648562, "sim_compute_robot_state-npc2": 0.04976081469702342, "sim_compute_robot_state-npc3": 0.0506138839418926}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9705553879075428, "sim_physics": 0.02194360953110915, "survival_time": 3.2499999999999964, "driven_lanedir": 0.9654696798546664, "sim_render-ego": 0.04769537999079777, "in-drivable-lane": 0, "agent_compute-ego": 0.11132092475891112, "deviation-heading": 0.30707254041461957, "set_robot_commands": 0.0670996592595027, "deviation-center-line": 0.2078435673968125, "driven_lanedir_consec": 0.9654696798546664, "sim_compute_sim_state": 0.0295042478121244, "sim_compute_performance-ego": 0.04966354003319373, "sim_compute_robot_state-ego": 0.05234414980961726, "sim_compute_robot_state-npc0": 0.05106455362760104, "sim_compute_robot_state-npc1": 0.051297583946814905, "sim_compute_robot_state-npc2": 0.050535733883197494, "sim_compute_robot_state-npc3": 0.05048511578486515}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.251399537036658, "sim_physics": 0.022218928104493677, "survival_time": 4.099999999999993, "driven_lanedir": 0.6183498913595016, "sim_render-ego": 0.0468242371954569, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.11089803532856268, "deviation-heading": 0.37092376484647793, "set_robot_commands": 0.06709484065451272, "deviation-center-line": 0.1202293815485396, "driven_lanedir_consec": 0.6183498913595016, "sim_compute_sim_state": 0.029445313825839904, "sim_compute_performance-ego": 0.0506157497080361, "sim_compute_robot_state-ego": 0.051528881235820494, "sim_compute_robot_state-npc0": 0.051298725895765354, "sim_compute_robot_state-npc1": 0.050623256985734146, "sim_compute_robot_state-npc2": 0.05126482684437821, "sim_compute_robot_state-npc3": 0.05064980867432385}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4782765184420794, "sim_physics": 0.022834179401397703, "survival_time": 4.99999999999999, "driven_lanedir": 0.8516119779536884, "sim_render-ego": 0.04826863288879395, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.11123481512069702, "deviation-heading": 0.3786834582492112, "set_robot_commands": 0.06775984287261963, "deviation-center-line": 0.16534908678864438, "driven_lanedir_consec": 0.8516119779536884, "sim_compute_sim_state": 0.02925590515136719, "sim_compute_performance-ego": 0.049518065452575685, "sim_compute_robot_state-ego": 0.05063360929489136, "sim_compute_robot_state-npc0": 0.05387993812561035, "sim_compute_robot_state-npc1": 0.05119637489318848, "sim_compute_robot_state-npc2": 0.05058317422866821, "sim_compute_robot_state-npc3": 0.05118647813796997}}
set_robot_commands_max0.06775984287261963
set_robot_commands_mean0.0671599566644352
set_robot_commands_median0.0670996592595027
set_robot_commands_min0.06639330877977259
sim_compute_performance-ego_max0.0506157497080361
sim_compute_performance-ego_mean0.04968057911827424
sim_compute_performance-ego_median0.04966354003319373
sim_compute_performance-ego_min0.048935146892772
sim_compute_robot_state-ego_max0.05234414980961726
sim_compute_robot_state-ego_mean0.051618436228684915
sim_compute_robot_state-ego_median0.051528881235820494
sim_compute_robot_state-ego_min0.05063360929489136
sim_compute_robot_state-npc0_max0.05387993812561035
sim_compute_robot_state-npc0_mean0.05150004017603675
sim_compute_robot_state-npc0_median0.05106455362760104
sim_compute_robot_state-npc0_min0.05060129656511195
sim_compute_robot_state-npc1_max0.051297583946814905
sim_compute_robot_state-npc1_mean0.05075610357457444
sim_compute_robot_state-npc1_median0.050623256985734146
sim_compute_robot_state-npc1_min0.05028945680648562
sim_compute_robot_state-npc2_max0.05126482684437821
sim_compute_robot_state-npc2_mean0.050379917998065
sim_compute_robot_state-npc2_median0.050535733883197494
sim_compute_robot_state-npc2_min0.049755040337057674
sim_compute_robot_state-npc3_max0.05118647813796997
sim_compute_robot_state-npc3_mean0.050643432362562434
sim_compute_robot_state-npc3_median0.0506138839418926
sim_compute_robot_state-npc3_min0.05028187527376063
sim_compute_sim_state_max0.02956292364332411
sim_compute_sim_state_mean0.029440535736390383
sim_compute_sim_state_median0.029445313825839904
sim_compute_sim_state_min0.02925590515136719
sim_physics_max0.023236520706661164
sim_physics_mean0.022296379482101693
sim_physics_median0.022218928104493677
sim_physics_min0.02124865966684678
sim_render-ego_max0.04841061550028184
sim_render-ego_mean0.04775806116733737
sim_render-ego_median0.04769537999079777
sim_render-ego_min0.0468242371954569
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean3.779999999999995
survival_time_min3.149999999999997
No reset possible
175212360Andrea Censi 🇨🇭PredictorMeanaido2-PREDstep1-simulationerrornouberduck0:00:17
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 28, in main
    agent_ci.write('seed', seed)
AttributeError: 'ComponentInterface' object has no attribute 'write'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 72, in <module>
    main(cie)
  File "experiment_manager.py", line 64, in main
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
175112267Andrea Censi 🇨🇭PredictorLastaido2-PREDstep1-simulationerrornouberduck0:02:42
Timeout: Waited 120 [...]
Timeout:

Waited 120 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
175032303Andrea Censi 🇨🇭PredictorLastaido2-PREDstep1-simulationerrornouberduck0:02:54
Timeout: Waited 120 [...]
Timeout:

Waited 120 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible