Duckietown Challenges Home Challenges Submissions

Evaluator 918

ID918
evaluatorip-172-31-42-167-7194
ownerI don't have one 😀
machineip-172-31-42-167
processip-172-31-42-167-7194
versiond-c:4.0.25;d-c-r:4.0.32;d-s:4.0.21
first heard
last heard
statusinactive
# evaluating
# success4 21760
# timeout
# failed
# error1 21715
# aborted
# host-error4 21717
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
219163347Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido2-LFV-sim-testingstep1-simulationsuccessnoip-172-31-42-167-71940:56:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.5018829386263537
survival_time_median14.950000000000076
deviation-center-line_median1.109123650541186
in-drivable-lane_median0.9500000000000136


other stats
agent_compute-ego_max0.13579525073369345
agent_compute-ego_mean0.09171537412763228
agent_compute-ego_median0.06261357545852661
agent_compute-ego_min0.05245465732245856
deviation-center-line_max1.3171915308434985
deviation-center-line_mean1.0394484471218215
deviation-center-line_min0.23465359483055895
deviation-heading_max3.2894998237338733
deviation-heading_mean2.153569280244606
deviation-heading_median2.179416652759577
deviation-heading_min0.38334638160903545
driven_any_max2.891670024268534
driven_any_mean2.399534157916546
driven_any_median2.6206540811933356
driven_any_min0.3584723564231656
driven_lanedir_consec_max2.797801343606216
driven_lanedir_consec_mean2.23374864371674
driven_lanedir_consec_min0.35310074879629694
driven_lanedir_max2.797801343606216
driven_lanedir_mean2.23374864371674
driven_lanedir_median2.5018829386263537
driven_lanedir_min0.35310074879629694
in-drivable-lane_max2.600000000000037
in-drivable-lane_mean0.8900000000000106
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.539117016809044, "sim_physics": 0.09348508437474568, "survival_time": 14.950000000000076, "driven_lanedir": 2.3467116701170716, "sim_render-ego": 0.036595629851023354, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.05405745267868042, "deviation-heading": 2.608749172149957, "set_robot_commands": 0.06804514726003011, "deviation-center-line": 1.01120254957571, "driven_lanedir_consec": 2.3467116701170716, "sim_compute_sim_state": 0.02262753168741862, "sim_compute_performance-ego": 0.03950123230616251, "sim_compute_robot_state-ego": 0.0419959553082784, "sim_compute_robot_state-npc0": 0.04228177467981974, "sim_compute_robot_state-npc1": 0.040026251475016275, "sim_compute_robot_state-npc2": 0.04004010836283366, "sim_compute_robot_state-npc3": 0.039762918949127195}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.83368486735831, "sim_physics": 0.09183181206385296, "survival_time": 14.950000000000076, "driven_lanedir": 2.5801867002295853, "sim_render-ego": 0.036032599608103434, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.053196028868357344, "deviation-heading": 2.179416652759577, "set_robot_commands": 0.06981865723927816, "deviation-center-line": 1.2334385007162123, "driven_lanedir_consec": 2.5801867002295853, "sim_compute_sim_state": 0.02282800277074178, "sim_compute_performance-ego": 0.03906227827072144, "sim_compute_robot_state-ego": 0.04154286781946818, "sim_compute_robot_state-npc0": 0.04173473040262858, "sim_compute_robot_state-npc1": 0.03983864466349284, "sim_compute_robot_state-npc2": 0.040851574738820395, "sim_compute_robot_state-npc3": 0.039887676239013674}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.6206540811933356, "sim_physics": 0.09158321539560954, "survival_time": 14.950000000000076, "driven_lanedir": 2.5917370395300434, "sim_render-ego": 0.03621167580286662, "in-drivable-lane": 0, "agent_compute-ego": 0.054025994141896565, "deviation-heading": 1.9708065538684347, "set_robot_commands": 0.06921907663345336, "deviation-center-line": 1.0295191829373436, "driven_lanedir_consec": 2.5917370395300434, "sim_compute_sim_state": 0.022783405780792236, "sim_compute_performance-ego": 0.03939202308654785, "sim_compute_robot_state-ego": 0.042702980041503906, "sim_compute_robot_state-npc0": 0.04184712171554565, "sim_compute_robot_state-npc1": 0.04029223918914795, "sim_compute_robot_state-npc2": 0.0404458475112915, "sim_compute_robot_state-npc3": 0.03980016311009725}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0185166382263924, "sim_physics": 0.09765920396578516, "survival_time": 5.899999999999987, "driven_lanedir": 0.9808241139198288, "sim_render-ego": 0.03661746695890265, "in-drivable-lane": 0, "agent_compute-ego": 0.0537999908802873, "deviation-heading": 1.0973789266953666, "set_robot_commands": 0.06991722422131037, "deviation-center-line": 0.47526275012889785, "driven_lanedir_consec": 0.9808241139198288, "sim_compute_sim_state": 0.02276689723386603, "sim_compute_performance-ego": 0.039328280141798115, "sim_compute_robot_state-ego": 0.041736495696892174, "sim_compute_robot_state-npc0": 0.04170886540817002, "sim_compute_robot_state-npc1": 0.043585494413214215, "sim_compute_robot_state-npc2": 0.040118740776837886, "sim_compute_robot_state-npc3": 0.03978013588210283}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.345880313644866, "sim_physics": 0.08600109525387653, "survival_time": 13.350000000000056, "driven_lanedir": 2.1820890135504816, "sim_render-ego": 0.036057529378026615, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.05245465732245856, "deviation-heading": 2.0442401590856636, "set_robot_commands": 0.06737910674305891, "deviation-center-line": 1.0055816252624508, "driven_lanedir_consec": 2.1820890135504816, "sim_compute_sim_state": 0.022695159197746593, "sim_compute_performance-ego": 0.038875603943728326, "sim_compute_robot_state-ego": 0.04172806525498294, "sim_compute_robot_state-npc0": 0.04164495003803839, "sim_compute_robot_state-npc1": 0.04103851139768679, "sim_compute_robot_state-npc2": 0.03976831543311645, "sim_compute_robot_state-npc3": 0.03958354817794057}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.578594449967396, "sim_physics": 0.09370814641316733, "survival_time": 14.950000000000076, "driven_lanedir": 2.5018829386263537, "sim_render-ego": 0.03701469739278158, "in-drivable-lane": 0, "agent_compute-ego": 0.0531943678855896, "deviation-heading": 2.9373156354547074, "set_robot_commands": 0.07097854614257812, "deviation-center-line": 1.3129962712511796, "driven_lanedir_consec": 2.5018829386263537, "sim_compute_sim_state": 0.02264898459116618, "sim_compute_performance-ego": 0.03902589718500773, "sim_compute_robot_state-ego": 0.04164507786432902, "sim_compute_robot_state-npc0": 0.04196256558100382, "sim_compute_robot_state-npc1": 0.04016757965087891, "sim_compute_robot_state-npc2": 0.040066537062327066, "sim_compute_robot_state-npc3": 0.039567193190256755}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 2.5306254875619603, "sim_physics": 0.09474448124567668, "survival_time": 14.950000000000076, "driven_lanedir": 2.150171774145237, "sim_render-ego": 0.036347765922546384, "in-drivable-lane": 2.600000000000037, "agent_compute-ego": 0.05299423853556315, "deviation-heading": 2.837648527070206, "set_robot_commands": 0.0678271222114563, "deviation-center-line": 1.1039693913960409, "driven_lanedir_consec": 2.150171774145237, "sim_compute_sim_state": 0.02265778462092082, "sim_compute_performance-ego": 0.0401654593149821, "sim_compute_robot_state-ego": 0.04159162044525146, "sim_compute_robot_state-npc0": 0.04207646131515503, "sim_compute_robot_state-npc1": 0.03994756539662679, "sim_compute_robot_state-npc2": 0.039793262481689455, "sim_compute_robot_state-npc3": 0.03973853588104248}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.779931245228635, "sim_physics": 0.08675656239191691, "survival_time": 14.950000000000076, "driven_lanedir": 2.4327135272375244, "sim_render-ego": 0.03620169957478841, "in-drivable-lane": 1.8500000000000263, "agent_compute-ego": 0.06261357545852661, "deviation-heading": 2.271276599593209, "set_robot_commands": 0.06668259620666504, "deviation-center-line": 1.162639664874482, "driven_lanedir_consec": 2.4327135272375244, "sim_compute_sim_state": 0.022845858732859298, "sim_compute_performance-ego": 0.039005388418833414, "sim_compute_robot_state-ego": 0.04170609712600708, "sim_compute_robot_state-npc0": 0.04146124283472697, "sim_compute_robot_state-npc1": 0.04047438542048137, "sim_compute_robot_state-npc2": 0.039676104386647544, "sim_compute_robot_state-npc3": 0.039711280663808184}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.691909380656996, "sim_physics": 0.09742075284322103, "survival_time": 14.950000000000076, "driven_lanedir": 2.5848638390460317, "sim_render-ego": 0.03611896991729736, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.13579525073369345, "deviation-heading": 2.6111470410684268, "set_robot_commands": 0.05509305079778035, "deviation-center-line": 1.109123650541186, "driven_lanedir_consec": 2.5848638390460317, "sim_compute_sim_state": 0.022583060264587403, "sim_compute_performance-ego": 0.03983063062032064, "sim_compute_robot_state-ego": 0.04174484968185425, "sim_compute_robot_state-npc0": 0.04120313962300619, "sim_compute_robot_state-npc1": 0.04043505271275838, "sim_compute_robot_state-npc2": 0.04001245657602946, "sim_compute_robot_state-npc3": 0.04011681318283081}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.891670024268534, "sim_physics": 0.0905006464322408, "survival_time": 14.950000000000076, "driven_lanedir": 2.6075578875523058, "sim_render-ego": 0.035871572494506836, "in-drivable-lane": 1.900000000000027, "agent_compute-ego": 0.13306247234344482, "deviation-heading": 1.4509919648873273, "set_robot_commands": 0.0565929651260376, "deviation-center-line": 1.293583966730593, "driven_lanedir_consec": 2.6075578875523058, "sim_compute_sim_state": 0.022712581157684326, "sim_compute_performance-ego": 0.03954344113667806, "sim_compute_robot_state-ego": 0.04167037566502889, "sim_compute_robot_state-npc0": 0.04160115321477254, "sim_compute_robot_state-npc1": 0.04036651134490967, "sim_compute_robot_state-npc2": 0.040039321581522624, "sim_compute_robot_state-npc3": 0.04013758182525635}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.508025058748701, "sim_physics": 0.09009256601333618, "survival_time": 14.950000000000076, "driven_lanedir": 2.162868686808208, "sim_render-ego": 0.036487775643666585, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.13403133471806844, "deviation-heading": 3.2894998237338733, "set_robot_commands": 0.056231482823689775, "deviation-center-line": 1.219274110365697, "driven_lanedir_consec": 2.162868686808208, "sim_compute_sim_state": 0.022794748942057293, "sim_compute_performance-ego": 0.0404994797706604, "sim_compute_robot_state-ego": 0.04141329447428385, "sim_compute_robot_state-npc0": 0.04122111002604167, "sim_compute_robot_state-npc1": 0.03994937260945638, "sim_compute_robot_state-npc2": 0.040065810680389405, "sim_compute_robot_state-npc3": 0.03986523866653442}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.3584723564231656, "sim_physics": 0.08590967953205109, "survival_time": 2.3999999999999995, "driven_lanedir": 0.35310074879629694, "sim_render-ego": 0.03643361230691274, "in-drivable-lane": 0, "agent_compute-ego": 0.132408673564593, "deviation-heading": 0.38334638160903545, "set_robot_commands": 0.054964145024617515, "deviation-center-line": 0.23465359483055895, "driven_lanedir_consec": 0.35310074879629694, "sim_compute_sim_state": 0.02280577023824056, "sim_compute_performance-ego": 0.03954386214415232, "sim_compute_robot_state-ego": 0.04156642158826193, "sim_compute_robot_state-npc0": 0.0417231023311615, "sim_compute_robot_state-npc1": 0.04022923608620962, "sim_compute_robot_state-npc2": 0.04034519692262014, "sim_compute_robot_state-npc3": 0.03971010446548462}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.844464924955288, "sim_physics": 0.08858758449554444, "survival_time": 14.950000000000076, "driven_lanedir": 2.797801343606216, "sim_render-ego": 0.036843833128611246, "in-drivable-lane": 0, "agent_compute-ego": 0.1345440379778544, "deviation-heading": 2.1349777295946497, "set_robot_commands": 0.05543451627095541, "deviation-center-line": 1.1123415759189803, "driven_lanedir_consec": 2.797801343606216, "sim_compute_sim_state": 0.023137399355570475, "sim_compute_performance-ego": 0.039940132300059, "sim_compute_robot_state-ego": 0.041774582862854, "sim_compute_robot_state-npc0": 0.042445685068766274, "sim_compute_robot_state-npc1": 0.041409126122792565, "sim_compute_robot_state-npc2": 0.040598238309224446, "sim_compute_robot_state-npc3": 0.04028565486272176}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.663564481477922, "sim_physics": 0.09015828529993691, "survival_time": 14.950000000000076, "driven_lanedir": 2.6262713374112296, "sim_render-ego": 0.03659181197484334, "in-drivable-lane": 0, "agent_compute-ego": 0.13524166663487752, "deviation-heading": 1.9609326215700544, "set_robot_commands": 0.05491440057754517, "deviation-center-line": 0.9709483414544888, "driven_lanedir_consec": 2.6262713374112296, "sim_compute_sim_state": 0.02283639430999756, "sim_compute_performance-ego": 0.04131608327229818, "sim_compute_robot_state-ego": 0.04195708274841309, "sim_compute_robot_state-npc0": 0.042018872102101645, "sim_compute_robot_state-npc1": 0.04063657204310099, "sim_compute_robot_state-npc2": 0.04049076318740845, "sim_compute_robot_state-npc3": 0.040452895164489744}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.7879020422276435, "sim_physics": 0.09127273082733156, "survival_time": 14.950000000000076, "driven_lanedir": 2.607449035174686, "sim_render-ego": 0.03606430689493815, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.13431087017059326, "deviation-heading": 2.5258114145286, "set_robot_commands": 0.05761168162027995, "deviation-center-line": 1.3171915308434985, "driven_lanedir_consec": 2.607449035174686, "sim_compute_sim_state": 0.02253241856892904, "sim_compute_performance-ego": 0.03951253334681193, "sim_compute_robot_state-ego": 0.04157005627950033, "sim_compute_robot_state-npc0": 0.04095591545104981, "sim_compute_robot_state-npc1": 0.039915151596069336, "sim_compute_robot_state-npc2": 0.03989189942677816, "sim_compute_robot_state-npc3": 0.03994509299596151}}
set_robot_commands_max0.07097854614257812
set_robot_commands_mean0.06271398125991574
set_robot_commands_median0.06668259620666504
set_robot_commands_min0.05491440057754517
sim_compute_performance-ego_max0.04131608327229818
sim_compute_performance-ego_mean0.03963615501725081
sim_compute_performance-ego_median0.03951253334681193
sim_compute_performance-ego_min0.038875603943728326
sim_compute_robot_state-ego_max0.042702980041503906
sim_compute_robot_state-ego_mean0.04175638819046063
sim_compute_robot_state-ego_median0.04170609712600708
sim_compute_robot_state-ego_min0.04141329447428385
sim_compute_robot_state-npc0_max0.042445685068766274
sim_compute_robot_state-npc0_mean0.041725779319465854
sim_compute_robot_state-npc0_median0.0417231023311615
sim_compute_robot_state-npc0_min0.04095591545104981
sim_compute_robot_state-npc1_max0.043585494413214215
sim_compute_robot_state-npc1_mean0.04055411294145613
sim_compute_robot_state-npc1_median0.04029223918914795
sim_compute_robot_state-npc1_min0.03983864466349284
sim_compute_robot_state-npc2_max0.040851574738820395
sim_compute_robot_state-npc2_mean0.04014694516250244
sim_compute_robot_state-npc2_median0.040065810680389405
sim_compute_robot_state-npc2_min0.039676104386647544
sim_compute_robot_state-npc3_max0.040452895164489744
sim_compute_robot_state-npc3_mean0.03988965555044454
sim_compute_robot_state-npc3_median0.03980016311009725
sim_compute_robot_state-npc3_min0.039567193190256755
sim_compute_sim_state_max0.023137399355570475
sim_compute_sim_state_mean0.022750399830171877
sim_compute_sim_state_median0.02276689723386603
sim_compute_sim_state_min0.02253241856892904
sim_physics_max0.09765920396578516
sim_physics_mean0.09131412310321951
sim_physics_median0.09127273082733156
sim_physics_min0.08590967953205109
sim_render-ego_max0.03701469739278158
sim_render-ego_mean0.03636606312332101
sim_render-ego_median0.036347765922546384
sim_render-ego_min0.035871572494506836
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.403333333333396
survival_time_min2.3999999999999995
No reset possible
219043344Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido2-LFV-sim-validationstep1-simulationsuccessnoip-172-31-42-167-71940:17:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.512066858408012
survival_time_median14.950000000000076
deviation-center-line_median1.0425284673387196
in-drivable-lane_median0


other stats
agent_compute-ego_max0.05487339496612549
agent_compute-ego_mean0.05374903228955391
agent_compute-ego_median0.05346897919972737
agent_compute-ego_min0.053398774220393255
deviation-center-line_max1.100356688114419
deviation-center-line_mean0.9272221386231512
deviation-center-line_min0.5264218539247022
deviation-heading_max2.613933276575648
deviation-heading_mean1.988113038694307
deviation-heading_median1.9294836444798416
deviation-heading_min1.3326880547533084
driven_any_max2.7212596585265274
driven_any_mean2.3528185197344627
driven_any_median2.611458948271722
driven_any_min1.1642798532864451
driven_lanedir_consec_max2.6957291349061223
driven_lanedir_consec_mean2.263393288539296
driven_lanedir_consec_min1.133167987145537
driven_lanedir_max2.6957291349061223
driven_lanedir_mean2.263393288539296
driven_lanedir_median2.512066858408012
driven_lanedir_min1.133167987145537
in-drivable-lane_max1.200000000000017
in-drivable-lane_mean0.4400000000000063
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.569130923005739, "sim_physics": 0.09431596676508586, "survival_time": 14.950000000000076, "driven_lanedir": 2.3953165373877434, "sim_render-ego": 0.03710454305013021, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.05487339496612549, "deviation-heading": 2.1361636471408723, "set_robot_commands": 0.06997842868169149, "deviation-center-line": 0.8860134572974047, "driven_lanedir_consec": 2.3953165373877434, "sim_compute_sim_state": 0.022826600074768066, "sim_compute_performance-ego": 0.03964339335759481, "sim_compute_robot_state-ego": 0.04187292098999024, "sim_compute_robot_state-npc0": 0.04217913389205932, "sim_compute_robot_state-npc1": 0.040383372306823734, "sim_compute_robot_state-npc2": 0.04014780124028524, "sim_compute_robot_state-npc3": 0.04004256089528402}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.1642798532864451, "sim_physics": 0.0976025911477896, "survival_time": 6.499999999999985, "driven_lanedir": 1.133167987145537, "sim_render-ego": 0.03636988859910231, "in-drivable-lane": 0, "agent_compute-ego": 0.053398774220393255, "deviation-heading": 1.3326880547533084, "set_robot_commands": 0.06887165216299204, "deviation-center-line": 0.5264218539247022, "driven_lanedir_consec": 1.133167987145537, "sim_compute_sim_state": 0.022785551731403057, "sim_compute_performance-ego": 0.039153381494375375, "sim_compute_robot_state-ego": 0.04206007994138278, "sim_compute_robot_state-npc0": 0.04174444308647743, "sim_compute_robot_state-npc1": 0.03997483620276818, "sim_compute_robot_state-npc2": 0.040056127768296465, "sim_compute_robot_state-npc3": 0.039967852372389576}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.7212596585265274, "sim_physics": 0.09341395616531371, "survival_time": 14.950000000000076, "driven_lanedir": 2.6957291349061223, "sim_render-ego": 0.036442792415618895, "in-drivable-lane": 0, "agent_compute-ego": 0.05346897919972737, "deviation-heading": 1.9294836444798416, "set_robot_commands": 0.06823683818181356, "deviation-center-line": 1.100356688114419, "driven_lanedir_consec": 2.6957291349061223, "sim_compute_sim_state": 0.022943239212036132, "sim_compute_performance-ego": 0.03954721768697103, "sim_compute_robot_state-ego": 0.04175877412160238, "sim_compute_robot_state-npc0": 0.041948161125183105, "sim_compute_robot_state-npc1": 0.04007127602895101, "sim_compute_robot_state-npc2": 0.04001702785491943, "sim_compute_robot_state-npc3": 0.03975885470708211}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.611458948271722, "sim_physics": 0.09193161487579346, "survival_time": 14.950000000000076, "driven_lanedir": 2.580685924849065, "sim_render-ego": 0.03635475794474284, "in-drivable-lane": 0, "agent_compute-ego": 0.05345877170562744, "deviation-heading": 1.9282965705218669, "set_robot_commands": 0.06865007003148396, "deviation-center-line": 1.0807902264405114, "driven_lanedir_consec": 2.580685924849065, "sim_compute_sim_state": 0.02285640239715576, "sim_compute_performance-ego": 0.03964262406031291, "sim_compute_robot_state-ego": 0.04188123861948649, "sim_compute_robot_state-npc0": 0.04193736076354981, "sim_compute_robot_state-npc1": 0.04009686549504598, "sim_compute_robot_state-npc2": 0.0400542140007019, "sim_compute_robot_state-npc3": 0.03980696598688761}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.6979632155818796, "sim_physics": 0.08757522503534952, "survival_time": 14.950000000000076, "driven_lanedir": 2.512066858408012, "sim_render-ego": 0.03626610517501831, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.053545241355895994, "deviation-heading": 2.613933276575648, "set_robot_commands": 0.07099072933197022, "deviation-center-line": 1.0425284673387196, "driven_lanedir_consec": 2.512066858408012, "sim_compute_sim_state": 0.022754673957824708, "sim_compute_performance-ego": 0.039507656892140704, "sim_compute_robot_state-ego": 0.04163734118143717, "sim_compute_robot_state-npc0": 0.0417992385228475, "sim_compute_robot_state-npc1": 0.04024520715077718, "sim_compute_robot_state-npc2": 0.04007348457972209, "sim_compute_robot_state-npc3": 0.03984867095947266}}
set_robot_commands_max0.07099072933197022
set_robot_commands_mean0.06934554367799026
set_robot_commands_median0.06887165216299204
set_robot_commands_min0.06823683818181356
sim_compute_performance-ego_max0.03964339335759481
sim_compute_performance-ego_mean0.03949885469827896
sim_compute_performance-ego_median0.03954721768697103
sim_compute_performance-ego_min0.039153381494375375
sim_compute_robot_state-ego_max0.04206007994138278
sim_compute_robot_state-ego_mean0.04184207097077981
sim_compute_robot_state-ego_median0.04187292098999024
sim_compute_robot_state-ego_min0.04163734118143717
sim_compute_robot_state-npc0_max0.04217913389205932
sim_compute_robot_state-npc0_mean0.04192166747802344
sim_compute_robot_state-npc0_median0.04193736076354981
sim_compute_robot_state-npc0_min0.04174444308647743
sim_compute_robot_state-npc1_max0.040383372306823734
sim_compute_robot_state-npc1_mean0.040154311436873216
sim_compute_robot_state-npc1_median0.04009686549504598
sim_compute_robot_state-npc1_min0.03997483620276818
sim_compute_robot_state-npc2_max0.04014780124028524
sim_compute_robot_state-npc2_mean0.04006973108878502
sim_compute_robot_state-npc2_median0.040056127768296465
sim_compute_robot_state-npc2_min0.04001702785491943
sim_compute_robot_state-npc3_max0.04004256089528402
sim_compute_robot_state-npc3_mean0.0398849809842232
sim_compute_robot_state-npc3_median0.03984867095947266
sim_compute_robot_state-npc3_min0.03975885470708211
sim_compute_sim_state_max0.022943239212036132
sim_compute_sim_state_mean0.022833293474637546
sim_compute_sim_state_median0.022826600074768066
sim_compute_sim_state_min0.022754673957824708
sim_physics_max0.0976025911477896
sim_physics_mean0.09296787079786643
sim_physics_median0.09341395616531371
sim_physics_min0.08757522503534952
sim_render-ego_max0.03710454305013021
sim_render-ego_mean0.03650761743692251
sim_render-ego_median0.03636988859910231
sim_render-ego_min0.03626610517501831
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.260000000000058
survival_time_min6.499999999999985
No reset possible
219003343Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido2-LFV-sim-testingstep1-simulationhost-errornoip-172-31-42-167-71940:25:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission3343/step1-simulation-ip-172-31-42-167-7194-job21900/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
218693328jiang pengRL - TH -xyzaido2-LFV-sim-validationstep1-simulationhost-errornoip-172-31-42-167-71940:05:53
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation/submission3328/step1-simulation-ip-172-31-42-167-7194-job21869/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
217742379Liam Paull 🇨🇦minimal_agent_python2 (Python 2)aido2-LFVI-sim-testingstep1-simulationsuccessnoip-172-31-42-167-71940:21:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4674075261701268
survival_time_median3.699999999999995
deviation-center-line_median0.2037212999690195
in-drivable-lane_median0


other stats
agent_compute-ego_max0.04737218438762508
agent_compute-ego_mean0.043179991217196886
agent_compute-ego_median0.04525129215137379
agent_compute-ego_min0.034693930600140546
deviation-center-line_max0.5183621890690367
deviation-center-line_mean0.2365365432439713
deviation-center-line_min0.1001276403534276
deviation-heading_max1.8192903310562811
deviation-heading_mean0.7195980419067693
deviation-heading_median0.5070424162880826
deviation-heading_min0.2495279988048577
driven_any_max2.764827318571964
driven_any_mean1.0818349506618754
driven_any_median1.0098273192909006
driven_any_min0.3648701917101222
driven_lanedir_consec_max1.9044523873117627
driven_lanedir_consec_mean0.759860328609196
driven_lanedir_consec_min0.3272146444894328
driven_lanedir_max1.9045033171069223
driven_lanedir_mean0.7732651243581526
driven_lanedir_median0.6173586051289615
driven_lanedir_min0.3272146444894328
in-drivable-lane_max3.7999999999999887
in-drivable-lane_mean0.8633333333333326
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5648273185720385, "sim_physics": 0.10027639071146648, "survival_time": 5.549999999999988, "driven_lanedir": 1.5590414710313567, "sim_render-ego": 0.03512761184761116, "in-drivable-lane": 0, "agent_compute-ego": 0.034693930600140546, "deviation-heading": 0.47436593881657807, "set_robot_commands": 0.05387919228356164, "deviation-center-line": 0.3652019984091639, "driven_lanedir_consec": 1.5588337849539742, "sim_compute_sim_state": 0.02186046419916926, "sim_compute_performance-ego": 0.03764757809338269, "sim_compute_robot_state-ego": 0.040231333122597086, "sim_compute_robot_state-npc0": 0.039033894066338067, "sim_compute_robot_state-npc1": 0.03856655284091159, "sim_compute_robot_state-npc2": 0.03848533802204304, "sim_compute_robot_state-npc3": 0.038499039572638435}, "udem1-1-0": {"driven_any": 0.4548365617710335, "sim_physics": 0.10230302810668944, "survival_time": 1.850000000000001, "driven_lanedir": 0.4295989448974513, "sim_render-ego": 0.03539794844550055, "in-drivable-lane": 0, "agent_compute-ego": 0.03487505139531316, "deviation-heading": 0.6191860504142408, "set_robot_commands": 0.05337289861730627, "deviation-center-line": 0.13177328060574295, "driven_lanedir_consec": 0.4295989448974513, "sim_compute_sim_state": 0.021846242853113124, "sim_compute_performance-ego": 0.037723431716094144, "sim_compute_robot_state-ego": 0.040155153016786314, "sim_compute_robot_state-npc0": 0.0391031213708826, "sim_compute_robot_state-npc1": 0.03837178848885201, "sim_compute_robot_state-npc2": 0.03837999782046756, "sim_compute_robot_state-npc3": 0.03839468311619114}, "udem1-2-0": {"driven_any": 2.164827318571943, "sim_physics": 0.11999399140970596, "survival_time": 7.549999999999981, "driven_lanedir": 1.7225432153016964, "sim_render-ego": 0.04049541460757224, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.04024582982852759, "deviation-heading": 0.5111746004355058, "set_robot_commands": 0.061660196607476035, "deviation-center-line": 0.4236146577511261, "driven_lanedir_consec": 1.7224824270719754, "sim_compute_sim_state": 0.02525269590466228, "sim_compute_performance-ego": 0.04310407228027748, "sim_compute_robot_state-ego": 0.04621321476058455, "sim_compute_robot_state-npc0": 0.04538705175286097, "sim_compute_robot_state-npc1": 0.04470000045978471, "sim_compute_robot_state-npc2": 0.04353494675743659, "sim_compute_robot_state-npc3": 0.04420676768220813}, "udem1-3-0": {"driven_any": 2.764827318571964, "sim_physics": 0.12848472595214844, "survival_time": 9.55, "driven_lanedir": 1.9045033171069223, "sim_render-ego": 0.046446697874219005, "in-drivable-lane": 2.8500000000000165, "agent_compute-ego": 0.04596220136312914, "deviation-heading": 0.4989824923438323, "set_robot_commands": 0.06775379056081722, "deviation-center-line": 0.5183621890690367, "driven_lanedir_consec": 1.9044523873117627, "sim_compute_sim_state": 0.028908431217932577, "sim_compute_performance-ego": 0.05093652165997091, "sim_compute_robot_state-ego": 0.05216818455002071, "sim_compute_robot_state-npc0": 0.05165727600377268, "sim_compute_robot_state-npc1": 0.05234928905027699, "sim_compute_robot_state-npc2": 0.04979224105155905, "sim_compute_robot_state-npc3": 0.05043152739240237}, "udem1-4-0": {"driven_any": 0.37986052535838966, "sim_physics": 0.12758761644363403, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3667130323691865, "sim_render-ego": 0.03852888196706772, "in-drivable-lane": 0, "agent_compute-ego": 0.03897664695978165, "deviation-heading": 0.42218734391092383, "set_robot_commands": 0.05662135034799576, "deviation-center-line": 0.10686438692139356, "driven_lanedir_consec": 0.3667130323691865, "sim_compute_sim_state": 0.02428258955478668, "sim_compute_performance-ego": 0.040681131184101105, "sim_compute_robot_state-ego": 0.04380420595407486, "sim_compute_robot_state-npc0": 0.04249989986419678, "sim_compute_robot_state-npc1": 0.044894956052303314, "sim_compute_robot_state-npc2": 0.04431665688753128, "sim_compute_robot_state-npc3": 0.04384041577577591}, "udem1-5-0": {"driven_any": 1.0548273189057942, "sim_physics": 0.1298650178042325, "survival_time": 3.8499999999999943, "driven_lanedir": 0.39637369698573455, "sim_render-ego": 0.0412574526551482, "in-drivable-lane": 1.7499999999999971, "agent_compute-ego": 0.0433104843288273, "deviation-heading": 1.272726140232846, "set_robot_commands": 0.06587265064189961, "deviation-center-line": 0.2037212999690195, "driven_lanedir_consec": 0.39637369698573455, "sim_compute_sim_state": 0.026683640170406985, "sim_compute_performance-ego": 0.04406749428092659, "sim_compute_robot_state-ego": 0.04788131837720995, "sim_compute_robot_state-npc0": 0.04680872892404531, "sim_compute_robot_state-npc1": 0.045203809614305375, "sim_compute_robot_state-npc2": 0.04537283909785283, "sim_compute_robot_state-npc3": 0.05371343625056279}, "udem1-6-0": {"driven_any": 0.8898273241328052, "sim_physics": 0.1486357847849528, "survival_time": 3.2999999999999963, "driven_lanedir": 0.8871438691197218, "sim_render-ego": 0.04285327593485514, "in-drivable-lane": 0, "agent_compute-ego": 0.04197511167237253, "deviation-heading": 0.2564691131854334, "set_robot_commands": 0.0632508776404641, "deviation-center-line": 0.3019392944051749, "driven_lanedir_consec": 0.8871438691197218, "sim_compute_sim_state": 0.027188192714344372, "sim_compute_performance-ego": 0.04662485917409261, "sim_compute_robot_state-ego": 0.04904678373625784, "sim_compute_robot_state-npc0": 0.050850207155401055, "sim_compute_robot_state-npc1": 0.05002232753869259, "sim_compute_robot_state-npc2": 0.04958274147727273, "sim_compute_robot_state-npc3": 0.048427097725145744}, "udem1-7-0": {"driven_any": 1.0098273192909006, "sim_physics": 0.14259906717248866, "survival_time": 3.699999999999995, "driven_lanedir": 0.8892952338440012, "sim_render-ego": 0.04605865478515625, "in-drivable-lane": 0, "agent_compute-ego": 0.04525129215137379, "deviation-heading": 1.3305395181824708, "set_robot_commands": 0.06846025505581417, "deviation-center-line": 0.2328954250769578, "driven_lanedir_consec": 0.8751257158125099, "sim_compute_sim_state": 0.028422165561366727, "sim_compute_performance-ego": 0.04862538866094641, "sim_compute_robot_state-ego": 0.04981394071836729, "sim_compute_robot_state-npc0": 0.04995798742448961, "sim_compute_robot_state-npc1": 0.04904699647748793, "sim_compute_robot_state-npc2": 0.048710697406047096, "sim_compute_robot_state-npc3": 0.04973166375546842}, "udem1-8-0": {"driven_any": 1.024827319128602, "sim_physics": 0.12966801961263022, "survival_time": 3.7499999999999942, "driven_lanedir": 0.6173586051289615, "sim_render-ego": 0.04139111836751302, "in-drivable-lane": 0.9999999999999978, "agent_compute-ego": 0.04534409205118815, "deviation-heading": 1.2558531851712094, "set_robot_commands": 0.06782545725504557, "deviation-center-line": 0.25318000812184893, "driven_lanedir_consec": 0.6173586051289615, "sim_compute_sim_state": 0.02647109349568685, "sim_compute_performance-ego": 0.04626709938049317, "sim_compute_robot_state-ego": 0.047463296254475915, "sim_compute_robot_state-npc0": 0.04706812540690104, "sim_compute_robot_state-npc1": 0.04576348940531413, "sim_compute_robot_state-npc2": 0.04841820081075032, "sim_compute_robot_state-npc3": 0.04856377601623535}, "udem1-9-0": {"driven_any": 0.45483656177104664, "sim_physics": 0.14991577251537427, "survival_time": 1.850000000000001, "driven_lanedir": 0.4388914430822646, "sim_render-ego": 0.042999937727644634, "in-drivable-lane": 0, "agent_compute-ego": 0.04710590517198717, "deviation-heading": 0.49131063474122394, "set_robot_commands": 0.06870070663658348, "deviation-center-line": 0.1166531854243332, "driven_lanedir_consec": 0.4388914430822646, "sim_compute_sim_state": 0.026798705796937685, "sim_compute_performance-ego": 0.046589993141792914, "sim_compute_robot_state-ego": 0.04942509290334341, "sim_compute_robot_state-npc0": 0.047323774647068335, "sim_compute_robot_state-npc1": 0.04656013282569679, "sim_compute_robot_state-npc2": 0.047097560521718616, "sim_compute_robot_state-npc3": 0.04925617656192264}, "udem1-10-0": {"driven_any": 0.3648701917101222, "sim_physics": 0.13382696336315525, "survival_time": 1.5500000000000007, "driven_lanedir": 0.34552109787971164, "sim_render-ego": 0.04283427423046481, "in-drivable-lane": 0, "agent_compute-ego": 0.044675211752614664, "deviation-heading": 0.5070424162880826, "set_robot_commands": 0.06642712316205425, "deviation-center-line": 0.1001276403534276, "driven_lanedir_consec": 0.34552109787971164, "sim_compute_sim_state": 0.02742791944934476, "sim_compute_performance-ego": 0.04712437814281833, "sim_compute_robot_state-ego": 0.047517930307695945, "sim_compute_robot_state-npc0": 0.045517859920378656, "sim_compute_robot_state-npc1": 0.04404992441977224, "sim_compute_robot_state-npc2": 0.04718047572720435, "sim_compute_robot_state-npc3": 0.04908716294073289}, "udem1-11-0": {"driven_any": 0.4098472254790859, "sim_physics": 0.13347916042103486, "survival_time": 1.7000000000000008, "driven_lanedir": 0.4054397040222266, "sim_render-ego": 0.04488057949963738, "in-drivable-lane": 0, "agent_compute-ego": 0.04589017699746525, "deviation-heading": 0.2495279988048577, "set_robot_commands": 0.0648640744826373, "deviation-center-line": 0.16731842400967326, "driven_lanedir_consec": 0.4054397040222266, "sim_compute_sim_state": 0.0277020861120785, "sim_compute_performance-ego": 0.046633397831636315, "sim_compute_robot_state-ego": 0.04919118740979363, "sim_compute_robot_state-npc0": 0.049484512385200054, "sim_compute_robot_state-npc1": 0.047934560214771944, "sim_compute_robot_state-npc2": 0.04829715279971852, "sim_compute_robot_state-npc3": 0.04943248103646671}, "udem1-12-0": {"driven_any": 1.4748273185722356, "sim_physics": 0.13897994813464937, "survival_time": 5.249999999999989, "driven_lanedir": 0.3272146444894328, "sim_render-ego": 0.04480626923697335, "in-drivable-lane": 3.7999999999999887, "agent_compute-ego": 0.04602826436360677, "deviation-heading": 0.3112188917063981, "set_robot_commands": 0.06440244402204241, "deviation-center-line": 0.16525953982768174, "driven_lanedir_consec": 0.3272146444894328, "sim_compute_sim_state": 0.028238539468674433, "sim_compute_performance-ego": 0.04803399131411598, "sim_compute_robot_state-ego": 0.04969441777183896, "sim_compute_robot_state-npc0": 0.05080188115437825, "sim_compute_robot_state-npc1": 0.05015858922685896, "sim_compute_robot_state-npc2": 0.05073456310090565, "sim_compute_robot_state-npc3": 0.05295839309692383}, "udem1-13-0": {"driven_any": 0.9948273195001724, "sim_physics": 0.13758529702278033, "survival_time": 3.649999999999995, "driven_lanedir": 0.6553480498428992, "sim_render-ego": 0.04542801804738502, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.04737218438762508, "deviation-heading": 0.7740959733116568, "set_robot_commands": 0.06913649872557757, "deviation-center-line": 0.19736301642105017, "driven_lanedir_consec": 0.6553480498428992, "sim_compute_sim_state": 0.02727015051123214, "sim_compute_performance-ego": 0.0530910851204232, "sim_compute_robot_state-ego": 0.05167623415385207, "sim_compute_robot_state-npc0": 0.05131547744960001, "sim_compute_robot_state-npc1": 0.05032554717913066, "sim_compute_robot_state-npc2": 0.0491760985492027, "sim_compute_robot_state-npc3": 0.04947709384029859}, "udem1-14-0": {"driven_any": 1.219827318592, "sim_physics": 0.1409523297439922, "survival_time": 4.399999999999992, "driven_lanedir": 0.6539905402707253, "sim_render-ego": 0.04632661830295216, "in-drivable-lane": 1.2499999999999962, "agent_compute-ego": 0.045993485234000465, "deviation-heading": 1.8192903310562811, "set_robot_commands": 0.06892824172973633, "deviation-center-line": 0.26377380229393954, "driven_lanedir_consec": 0.4674075261701268, "sim_compute_sim_state": 0.028862405907024036, "sim_compute_performance-ego": 0.050855278968811035, "sim_compute_robot_state-ego": 0.05299998955293135, "sim_compute_robot_state-npc0": 0.05378881096839905, "sim_compute_robot_state-npc1": 0.051905155181884766, "sim_compute_robot_state-npc2": 0.05184919454834678, "sim_compute_robot_state-npc3": 0.05609008127992803}}
set_robot_commands_max0.06913649872557757
set_robot_commands_mean0.06407705051793411
set_robot_commands_median0.06587265064189961
set_robot_commands_min0.05337289861730627
sim_compute_performance-ego_max0.0530910851204232
sim_compute_performance-ego_mean0.04586704672999219
sim_compute_performance-ego_median0.04662485917409261
sim_compute_performance-ego_min0.03764757809338269
sim_compute_robot_state-ego_max0.05299998955293135
sim_compute_robot_state-ego_mean0.04781881883932199
sim_compute_robot_state-ego_median0.04904678373625784
sim_compute_robot_state-ego_min0.040155153016786314
sim_compute_robot_state-npc0_max0.05378881096839905
sim_compute_robot_state-npc0_mean0.04737324056626082
sim_compute_robot_state-npc0_median0.047323774647068335
sim_compute_robot_state-npc0_min0.039033894066338067
sim_compute_robot_state-npc1_max0.05234928905027699
sim_compute_robot_state-npc1_mean0.04665687459840293
sim_compute_robot_state-npc1_median0.04656013282569679
sim_compute_robot_state-npc1_min0.03837178848885201
sim_compute_robot_state-npc2_max0.05184919454834678
sim_compute_robot_state-npc2_mean0.046728580305203805
sim_compute_robot_state-npc2_median0.04829715279971852
sim_compute_robot_state-npc2_min0.03837999782046756
sim_compute_robot_state-npc3_max0.05609008127992803
sim_compute_robot_state-npc3_mean0.04814065306952674
sim_compute_robot_state-npc3_median0.04925617656192264
sim_compute_robot_state-npc3_min0.03839468311619114
sim_compute_sim_state_max0.028908431217932577
sim_compute_sim_state_mean0.026481021527784032
sim_compute_sim_state_median0.027188192714344372
sim_compute_sim_state_min0.021846242853113124
sim_physics_max0.14991577251537427
sim_physics_mean0.130943540879929
sim_physics_median0.13347916042103486
sim_physics_min0.10027639071146648
sim_render-ego_max0.046446697874219005
sim_render-ego_mean0.04232218356864671
sim_render-ego_median0.04285327593485514
sim_render-ego_min0.03512761184761116
simulation-passed1
survival_time_max9.55
survival_time_mean3.939999999999995
survival_time_min1.5500000000000007
No reset possible
217702373Liam Paull 🇨🇦minimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationhost-errornoip-172-31-42-167-71940:05:55
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2373/step1-simulation-ip-172-31-42-167-7194-job21770/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
217602698Konstantin Chaikachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessnoip-172-31-42-167-71940:51:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.26897986430285936
survival_time_median4.94999999999999
deviation-center-line_median0.23201677970567
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.08837924581585509
agent_compute-ego_mean0.08469400771532992
agent_compute-ego_median0.08487581512303029
agent_compute-ego_min0.08124936103820801
deviation-center-line_max1.371040975353535
deviation-center-line_mean0.423534742397397
deviation-center-line_min0.11068809342680222
deviation-heading_max5.876058854462256
deviation-heading_mean2.1642598166353952
deviation-heading_median1.9871541583380812
deviation-heading_min0.5286957449450764
driven_any_max2.3488348518586797
driven_any_mean0.8805087537126413
driven_any_median0.7418597586883019
driven_any_min0.21153329129324583
driven_lanedir_consec_max1.4207119128920318
driven_lanedir_consec_mean0.5234610639073595
driven_lanedir_consec_min0.17982449484824214
driven_lanedir_max2.008761748306352
driven_lanedir_mean0.6382586817815119
driven_lanedir_median0.4222718400681744
driven_lanedir_min0.18145862701147888
in-drivable-lane_max3.500000000000024
in-drivable-lane_mean0.7866666666666698
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.7570363112533882, "sim_physics": 0.22087184665272536, "survival_time": 5.14999999999999, "driven_lanedir": 0.46022022950792296, "sim_render-ego": 0.0693718414862179, "in-drivable-lane": 0.8499999999999981, "agent_compute-ego": 0.08487581512303029, "deviation-heading": 2.209376887678384, "set_robot_commands": 0.10163084511618012, "deviation-center-line": 0.4401214778553918, "driven_lanedir_consec": 0.21750833460823585, "sim_compute_sim_state": 0.040765917416915154, "sim_compute_performance-ego": 0.0695634883584328, "sim_compute_robot_state-ego": 0.07638844471533322, "sim_compute_robot_state-npc0": 0.07242552053581164, "sim_compute_robot_state-npc1": 0.07337870875608574, "sim_compute_robot_state-npc2": 0.07264501377216821, "sim_compute_robot_state-npc3": 0.07229175845396171}, "udem1-1-0": {"driven_any": 0.7418597586883019, "sim_physics": 0.24298986039980497, "survival_time": 4.94999999999999, "driven_lanedir": 0.6638207049179472, "sim_render-ego": 0.0693812370300293, "in-drivable-lane": 0, "agent_compute-ego": 0.08837924581585509, "deviation-heading": 1.8231211521989776, "set_robot_commands": 0.10892899831136069, "deviation-center-line": 0.2652548453371599, "driven_lanedir_consec": 0.6638207049179472, "sim_compute_sim_state": 0.043164246010057854, "sim_compute_performance-ego": 0.07683837052547571, "sim_compute_robot_state-ego": 0.08506342377325501, "sim_compute_robot_state-npc0": 0.07592344284057617, "sim_compute_robot_state-npc1": 0.07684641895872174, "sim_compute_robot_state-npc2": 0.07758492171162307, "sim_compute_robot_state-npc3": 0.07519517041215992}, "udem1-2-0": {"driven_any": 0.5489454593207354, "sim_physics": 0.22989628156026204, "survival_time": 3.7499999999999942, "driven_lanedir": 0.4222718400681744, "sim_render-ego": 0.07313657442728679, "in-drivable-lane": 0, "agent_compute-ego": 0.08124936103820801, "deviation-heading": 1.9871541583380812, "set_robot_commands": 0.1010088062286377, "deviation-center-line": 0.23201677970567, "driven_lanedir_consec": 0.4222718400681744, "sim_compute_sim_state": 0.04255357106526693, "sim_compute_performance-ego": 0.0751569398244222, "sim_compute_robot_state-ego": 0.07765964190165202, "sim_compute_robot_state-npc0": 0.07268621126810709, "sim_compute_robot_state-npc1": 0.07286102612813314, "sim_compute_robot_state-npc2": 0.07293388048807779, "sim_compute_robot_state-npc3": 0.07448301633199056}, "udem1-3-0": {"driven_any": 0.2838533216575648, "sim_physics": 0.2291357744307745, "survival_time": 2.1000000000000005, "driven_lanedir": 0.26897986430285936, "sim_render-ego": 0.07094264598119826, "in-drivable-lane": 0, "agent_compute-ego": 0.08573784146990095, "deviation-heading": 0.5286957449450764, "set_robot_commands": 0.10045813946496872, "deviation-center-line": 0.18423762918535097, "driven_lanedir_consec": 0.26897986430285936, "sim_compute_sim_state": 0.041982866468883696, "sim_compute_performance-ego": 0.07537086804707845, "sim_compute_robot_state-ego": 0.07505058674585252, "sim_compute_robot_state-npc0": 0.07507428668794178, "sim_compute_robot_state-npc1": 0.07440251963479179, "sim_compute_robot_state-npc2": 0.07500941980452765, "sim_compute_robot_state-npc3": 0.07603514762151808}, "udem1-4-0": {"driven_any": 2.3488348518586797, "sim_physics": 0.21591806014378864, "survival_time": 14.950000000000076, "driven_lanedir": 1.6704492671217632, "sim_render-ego": 0.06807569503784179, "in-drivable-lane": 2.450000000000035, "agent_compute-ego": 0.08492926994959514, "deviation-heading": 5.354360722017447, "set_robot_commands": 0.10707393010457356, "deviation-center-line": 1.1181515913136686, "driven_lanedir_consec": 1.4013431034682162, "sim_compute_sim_state": 0.042137495676676434, "sim_compute_performance-ego": 0.07412284930547078, "sim_compute_robot_state-ego": 0.08159304777781169, "sim_compute_robot_state-npc0": 0.07539489189783732, "sim_compute_robot_state-npc1": 0.07645613193511963, "sim_compute_robot_state-npc2": 0.07487233877182006, "sim_compute_robot_state-npc3": 0.07699924310048421}, "udem1-5-0": {"driven_any": 0.7899734180552008, "sim_physics": 0.23092829840523857, "survival_time": 5.249999999999989, "driven_lanedir": 0.40323252659784337, "sim_render-ego": 0.06979344458807082, "in-drivable-lane": 1.4999999999999958, "agent_compute-ego": 0.08377737317766462, "deviation-heading": 2.446122014797115, "set_robot_commands": 0.10593542598542711, "deviation-center-line": 0.39583105134006213, "driven_lanedir_consec": 0.17982449484824214, "sim_compute_sim_state": 0.042332733245123, "sim_compute_performance-ego": 0.0776115303947812, "sim_compute_robot_state-ego": 0.08558951105390276, "sim_compute_robot_state-npc0": 0.07758951641264417, "sim_compute_robot_state-npc1": 0.07663764726547968, "sim_compute_robot_state-npc2": 0.07633648826962426, "sim_compute_robot_state-npc3": 0.077208677927653}, "udem1-6-0": {"driven_any": 2.212352952575204, "sim_physics": 0.22239002944729852, "survival_time": 14.100000000000064, "driven_lanedir": 2.008761748306352, "sim_render-ego": 0.06888540501290179, "in-drivable-lane": 0.350000000000005, "agent_compute-ego": 0.08322177795653647, "deviation-heading": 3.923670577605858, "set_robot_commands": 0.10357855989577924, "deviation-center-line": 1.371040975353535, "driven_lanedir_consec": 1.4207119128920318, "sim_compute_sim_state": 0.0413173479391328, "sim_compute_performance-ego": 0.07798862541820986, "sim_compute_robot_state-ego": 0.0827576015012484, "sim_compute_robot_state-npc0": 0.07404156187747388, "sim_compute_robot_state-npc1": 0.07493214827057318, "sim_compute_robot_state-npc2": 0.0754777505888161, "sim_compute_robot_state-npc3": 0.0744942528136233}, "udem1-7-0": {"driven_any": 0.8142156273465649, "sim_physics": 0.24162687637187816, "survival_time": 5.399999999999989, "driven_lanedir": 0.5581460103033158, "sim_render-ego": 0.06847099904660825, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.08449013365639581, "deviation-heading": 2.163156848151377, "set_robot_commands": 0.10337020953496295, "deviation-center-line": 0.28455938550047083, "driven_lanedir_consec": 0.48898425400301426, "sim_compute_sim_state": 0.04129987292819553, "sim_compute_performance-ego": 0.07394543179759273, "sim_compute_robot_state-ego": 0.08147421148088244, "sim_compute_robot_state-npc0": 0.07472284855665984, "sim_compute_robot_state-npc1": 0.07569702024813052, "sim_compute_robot_state-npc2": 0.07553400375224927, "sim_compute_robot_state-npc3": 0.0730848025392603}, "udem1-8-0": {"driven_any": 2.34867678671763, "sim_physics": 0.22158355633417764, "survival_time": 14.950000000000076, "driven_lanedir": 1.4539642714065528, "sim_render-ego": 0.07120156208674112, "in-drivable-lane": 3.500000000000024, "agent_compute-ego": 0.08530524174372354, "deviation-heading": 5.876058854462256, "set_robot_commands": 0.11229994376500448, "deviation-center-line": 1.0979912717877682, "driven_lanedir_consec": 1.200600259305142, "sim_compute_sim_state": 0.04247512976328532, "sim_compute_performance-ego": 0.0775346573193868, "sim_compute_robot_state-ego": 0.08401493549346924, "sim_compute_robot_state-npc0": 0.0761800201733907, "sim_compute_robot_state-npc1": 0.0761854902903239, "sim_compute_robot_state-npc2": 0.0751823099454244, "sim_compute_robot_state-npc3": 0.07614025990168254}, "udem1-9-0": {"driven_any": 0.2758088459994388, "sim_physics": 0.2679606647026248, "survival_time": 2.0500000000000007, "driven_lanedir": 0.230723652491037, "sim_render-ego": 0.06835794448852539, "in-drivable-lane": 0, "agent_compute-ego": 0.08654568253493891, "deviation-heading": 0.96572569722068, "set_robot_commands": 0.1041751140501441, "deviation-center-line": 0.11068809342680222, "driven_lanedir_consec": 0.230723652491037, "sim_compute_sim_state": 0.0441498116749089, "sim_compute_performance-ego": 0.07600057415845918, "sim_compute_robot_state-ego": 0.07966752168608875, "sim_compute_robot_state-npc0": 0.07611508485747547, "sim_compute_robot_state-npc1": 0.07606141741682844, "sim_compute_robot_state-npc2": 0.07455093686173601, "sim_compute_robot_state-npc3": 0.0752009531346763}, "udem1-10-0": {"driven_any": 0.4767200322346447, "sim_physics": 0.21215649084611377, "survival_time": 3.2999999999999963, "driven_lanedir": 0.45509084911246656, "sim_render-ego": 0.06671223495945786, "in-drivable-lane": 0, "agent_compute-ego": 0.08139849431586987, "deviation-heading": 0.887396890501525, "set_robot_commands": 0.09368039261211047, "deviation-center-line": 0.21747953892093536, "driven_lanedir_consec": 0.45509084911246656, "sim_compute_sim_state": 0.04094239075978597, "sim_compute_performance-ego": 0.07159614562988281, "sim_compute_robot_state-ego": 0.0767808249502471, "sim_compute_robot_state-npc0": 0.07435172615629254, "sim_compute_robot_state-npc1": 0.0745268590522535, "sim_compute_robot_state-npc2": 0.0711432695388794, "sim_compute_robot_state-npc3": 0.07117502978353789}, "udem1-11-0": {"driven_any": 0.26777129583468867, "sim_physics": 0.21459805965423584, "survival_time": 2.000000000000001, "driven_lanedir": 0.24678400532891143, "sim_render-ego": 0.06938487887382508, "in-drivable-lane": 0, "agent_compute-ego": 0.08503487110137939, "deviation-heading": 0.5563148484114218, "set_robot_commands": 0.10013986229896546, "deviation-center-line": 0.1842223096183376, "driven_lanedir_consec": 0.24678400532891143, "sim_compute_sim_state": 0.03907457590103149, "sim_compute_performance-ego": 0.07191388607025147, "sim_compute_robot_state-ego": 0.07767710089683533, "sim_compute_robot_state-npc0": 0.07293475270271302, "sim_compute_robot_state-npc1": 0.07576728463172913, "sim_compute_robot_state-npc2": 0.0765555202960968, "sim_compute_robot_state-npc3": 0.07259440422058105}, "udem1-12-0": {"driven_any": 0.3079463691881248, "sim_physics": 0.23513069682651097, "survival_time": 2.25, "driven_lanedir": 0.2513475189202812, "sim_render-ego": 0.07328800095452202, "in-drivable-lane": 0, "agent_compute-ego": 0.08662067519293891, "deviation-heading": 1.091603283997008, "set_robot_commands": 0.10610418319702147, "deviation-center-line": 0.1518869961210991, "driven_lanedir_consec": 0.2513475189202812, "sim_compute_sim_state": 0.043060392803616, "sim_compute_performance-ego": 0.0773660765753852, "sim_compute_robot_state-ego": 0.08334887822469075, "sim_compute_robot_state-npc0": 0.07242579989963108, "sim_compute_robot_state-npc1": 0.07241088549296061, "sim_compute_robot_state-npc2": 0.07749429278903537, "sim_compute_robot_state-npc3": 0.07401303715176052}, "udem1-13-0": {"driven_any": 0.21153329129324583, "sim_physics": 0.20977017373749704, "survival_time": 1.6500000000000008, "driven_lanedir": 0.18145862701147888, "sim_render-ego": 0.07086227156899193, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.08408432295828154, "deviation-heading": 0.5619553201193092, "set_robot_commands": 0.10184987386067708, "deviation-center-line": 0.14234269376170486, "driven_lanedir_consec": 0.18145862701147888, "sim_compute_sim_state": 0.04152715567386511, "sim_compute_performance-ego": 0.07557978774562027, "sim_compute_robot_state-ego": 0.08043526158188329, "sim_compute_robot_state-npc0": 0.0715901923902107, "sim_compute_robot_state-npc1": 0.07474837881146056, "sim_compute_robot_state-npc2": 0.07132599570534447, "sim_compute_robot_state-npc3": 0.07351627494349625}, "udem1-14-0": {"driven_any": 0.8221029836662049, "sim_physics": 0.23810701195253145, "survival_time": 5.449999999999989, "driven_lanedir": 0.29862911132577263, "sim_render-ego": 0.06814817988544429, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.08476000969563055, "deviation-heading": 2.0891842490864123, "set_robot_commands": 0.10672548714034054, "deviation-center-line": 0.1571964967329998, "driven_lanedir_consec": 0.2224665373323531, "sim_compute_sim_state": 0.042473659602873914, "sim_compute_performance-ego": 0.07391719861861763, "sim_compute_robot_state-ego": 0.08391152390646278, "sim_compute_robot_state-npc0": 0.07664742819759823, "sim_compute_robot_state-npc1": 0.07451763284315757, "sim_compute_robot_state-npc2": 0.0734477458743874, "sim_compute_robot_state-npc3": 0.07444918483769128}}
set_robot_commands_max0.11229994376500448
set_robot_commands_mean0.10379731810441026
set_robot_commands_median0.10357855989577924
set_robot_commands_min0.09368039261211047
sim_compute_performance-ego_max0.07798862541820986
sim_compute_performance-ego_mean0.07496709531927115
sim_compute_performance-ego_median0.07537086804707845
sim_compute_performance-ego_min0.0695634883584328
sim_compute_robot_state-ego_max0.08558951105390276
sim_compute_robot_state-ego_mean0.08076083437930769
sim_compute_robot_state-ego_median0.08147421148088244
sim_compute_robot_state-ego_min0.07505058674585252
sim_compute_robot_state-npc0_max0.07758951641264417
sim_compute_robot_state-npc0_mean0.07454021896362423
sim_compute_robot_state-npc0_median0.07472284855665984
sim_compute_robot_state-npc0_min0.0715901923902107
sim_compute_robot_state-npc1_max0.07684641895872174
sim_compute_robot_state-npc1_mean0.07502863798238328
sim_compute_robot_state-npc1_median0.07493214827057318
sim_compute_robot_state-npc1_min0.07241088549296061
sim_compute_robot_state-npc2_max0.07758492171162307
sim_compute_robot_state-npc2_mean0.07467292587798736
sim_compute_robot_state-npc2_median0.07500941980452765
sim_compute_robot_state-npc2_min0.0711432695388794
sim_compute_robot_state-npc3_max0.077208677927653
sim_compute_robot_state-npc3_mean0.07445874754493848
sim_compute_robot_state-npc3_median0.07448301633199056
sim_compute_robot_state-npc3_min0.07117502978353789
sim_compute_sim_state_max0.0441498116749089
sim_compute_sim_state_mean0.041950477795307875
sim_compute_sim_state_median0.042137495676676434
sim_compute_sim_state_min0.03907457590103149
sim_physics_max0.2679606647026248
sim_physics_mean0.22887091209769747
sim_physics_median0.2291357744307745
sim_physics_min0.20977017373749704
sim_render-ego_max0.07328800095452202
sim_render-ego_mean0.06973419436184417
sim_render-ego_median0.0693812370300293
sim_render-ego_min0.06671223495945786
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean5.82000000000001
survival_time_min1.6500000000000008
No reset possible
217173078Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationhost-errornoip-172-31-42-167-71941:01:55
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission3078/step1-simulation-ip-172-31-42-167-7194-job21717/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
217152648Egor Zamotaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationerrornoip-172-31-42-167-71940:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 >
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible