Duckietown Challenges Home Challenges Submissions

Evaluator 5217

ID5217
evaluatornoname
ownerVictor Guerra 🇫🇷
machinevubuntu
processnoname_vubuntu
version6.2.20
first heard
last heard
statusinactive
# evaluating
# success10 76075
# timeout
# failed
# error
# aborted3 76076
# host-error
arm0
x86_641
Mac0
gpu available0
Number of processors4
Processor frequency (MHz)3.0 GHz
Free % of processors98%
RAM total (MB)3.6 GB
RAM free (MB)2.5 GB
Disk (MB)915.4 GB
Disk available (MB)741.5 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
7975016114Victor Guerra 🇫🇷objdet exercisemooc-objdetsimsuccessnononame0:20:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median18.300000000000125
driven_lanedir_consec_median4.810667681787954


other stats
agent_compute-ego0_max0.047847367790588645
agent_compute-ego0_mean0.04719240667497433
agent_compute-ego0_median0.04719240667497433
agent_compute-ego0_min0.04653744555936001
complete-iteration_max0.6809878338892907
complete-iteration_mean0.5821577048053269
complete-iteration_median0.5821577048053269
complete-iteration_min0.48332757572136303
deviation-center-line_max0.26892281627655074
deviation-center-line_mean0.21630701637268143
deviation-center-line_median0.21630701637268143
deviation-center-line_min0.16369121646881216
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.73934300422758
distance-from-start_mean4.810621862412031
distance-from-start_median4.810621862412031
distance-from-start_min2.881900720596483
driven_any_max6.73934300422758
driven_any_mean4.810621862412031
driven_any_median4.810621862412031
driven_any_min2.881900720596483
driven_lanedir_consec_max6.739416375324249
driven_lanedir_consec_mean4.810667681787954
driven_lanedir_consec_min2.8819189882516576
driven_lanedir_max6.739416375324249
driven_lanedir_mean4.810667681787954
driven_lanedir_median4.810667681787954
driven_lanedir_min2.8819189882516576
get_duckie_state_max0.05888614279734516
get_duckie_state_mean0.05826403836475395
get_duckie_state_median0.05826403836475395
get_duckie_state_min0.05764193393216275
get_robot_state_max0.011172517418340824
get_robot_state_mean0.010753901151477082
get_robot_state_median0.010753901151477082
get_robot_state_min0.01033528488461334
get_state_dump_max0.029864987952219868
get_state_dump_mean0.025984709901647647
get_state_dump_median0.025984709901647647
get_state_dump_min0.022104431851075423
get_ui_image_max0.13287889801258604
get_ui_image_mean0.1322630084840708
get_ui_image_median0.1322630084840708
get_ui_image_min0.13164711895555553
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_median0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 6.73934300422758, "get_ui_image": 0.13164711895555553, "step_physics": 0.13212609243865062, "survival_time": 25.200000000000223, "driven_lanedir": 6.739416375324249, "get_state_dump": 0.022104431851075423, "get_robot_state": 0.01033528488461334, "sim_render-ego0": 0.0101365858965581, "get_duckie_state": 0.05764193393216275, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "agent_compute-ego0": 0.04653744555936001, "complete-iteration": 0.48332757572136303, "set_robot_commands": 0.006524887179384137, "distance-from-start": 6.73934300422758, "deviation-center-line": 0.16369121646881216, "driven_lanedir_consec": 6.739416375324249, "sim_compute_sim_state": 0.06008382504529292, "sim_compute_performance-ego0": 0.005978492226931129}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 2.881900720596483, "get_ui_image": 0.13287889801258604, "step_physics": 0.30212132378957157, "survival_time": 11.400000000000029, "driven_lanedir": 2.8819189882516576, "get_state_dump": 0.029864987952219868, "get_robot_state": 0.011172517418340824, "sim_render-ego0": 0.0107819836212558, "get_duckie_state": 0.05888614279734516, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "agent_compute-ego0": 0.047847367790588645, "complete-iteration": 0.6809878338892907, "set_robot_commands": 0.006596382007848748, "distance-from-start": 2.881900720596483, "deviation-center-line": 0.26892281627655074, "driven_lanedir_consec": 2.8819189882516576, "sim_compute_sim_state": 0.0702052022692418, "sim_compute_performance-ego0": 0.010420380721446208}}
set_robot_commands_max0.006596382007848748
set_robot_commands_mean0.0065606345936164425
set_robot_commands_median0.0065606345936164425
set_robot_commands_min0.006524887179384137
sim_compute_performance-ego0_max0.010420380721446208
sim_compute_performance-ego0_mean0.008199436474188668
sim_compute_performance-ego0_median0.008199436474188668
sim_compute_performance-ego0_min0.005978492226931129
sim_compute_sim_state_max0.0702052022692418
sim_compute_sim_state_mean0.06514451365726737
sim_compute_sim_state_median0.06514451365726737
sim_compute_sim_state_min0.06008382504529292
sim_render-ego0_max0.0107819836212558
sim_render-ego0_mean0.01045928475890695
sim_render-ego0_median0.01045928475890695
sim_render-ego0_min0.0101365858965581
simulation-passed1
step_physics_max0.30212132378957157
step_physics_mean0.21712370811411108
step_physics_median0.21712370811411108
step_physics_min0.13212609243865062
survival_time_max25.200000000000223
survival_time_mean18.300000000000125
survival_time_min11.400000000000029
No reset possible
7964416080Victor Guerra 🇫🇷objdet exercisemooc-objdetsimsuccessnononame0:45:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median35.724999999999376
driven_lanedir_consec_median1.6303740805269886


other stats
agent_compute-ego0_max0.11359626002933668
agent_compute-ego0_mean0.07047450012798714
agent_compute-ego0_median0.07047450012798714
agent_compute-ego0_min0.027352740226637612
complete-iteration_max0.897083938640097
complete-iteration_mean0.736712436429951
complete-iteration_median0.736712436429951
complete-iteration_min0.576340934219805
deviation-center-line_max0.3897409915923899
deviation-center-line_mean0.32992164695262066
deviation-center-line_median0.32992164695262066
deviation-center-line_min0.27010230231285143
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.88190072059649
distance-from-start_mean1.6303284144402357
distance-from-start_median1.6303284144402357
distance-from-start_min0.37875610828398143
driven_any_max2.88190072059649
driven_any_mean1.6303284144402357
driven_any_median1.6303284144402357
driven_any_min0.37875610828398143
driven_lanedir_consec_max2.8819191074614428
driven_lanedir_consec_mean1.6303740805269886
driven_lanedir_consec_min0.3788290535925345
driven_lanedir_max2.8819191074614428
driven_lanedir_mean1.6303740805269886
driven_lanedir_median1.6303740805269886
driven_lanedir_min0.3788290535925345
get_duckie_state_max0.05746526925460152
get_duckie_state_mean0.05714549691189519
get_duckie_state_median0.05714549691189519
get_duckie_state_min0.056825724569188864
get_robot_state_max0.011050573639247729
get_robot_state_mean0.010691751024912335
get_robot_state_median0.010691751024912335
get_robot_state_min0.01033292841057694
get_state_dump_max0.024974866535352625
get_state_dump_mean0.022981817012925378
get_state_dump_median0.022981817012925378
get_state_dump_min0.020988767490498137
get_ui_image_max0.3081093881441199
get_ui_image_mean0.2469289595038222
get_ui_image_median0.2469289595038222
get_ui_image_min0.18574853086352447
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_median0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 0.37875610828398143, "get_ui_image": 0.18574853086352447, "step_physics": 0.19185475266843316, "survival_time": 59.99999999999873, "driven_lanedir": 0.3788290535925345, "get_state_dump": 0.020988767490498137, "get_robot_state": 0.01033292841057694, "sim_render-ego0": 0.010038780431564802, "get_duckie_state": 0.056825724569188864, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "agent_compute-ego0": 0.027352740226637612, "complete-iteration": 0.576340934219805, "set_robot_commands": 0.007207005149021831, "distance-from-start": 0.37875610828398143, "deviation-center-line": 0.3897409915923899, "driven_lanedir_consec": 0.3788290535925345, "sim_compute_sim_state": 0.06000157399141818, "sim_compute_performance-ego0": 0.005774348105717261}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 2.88190072059649, "get_ui_image": 0.3081093881441199, "step_physics": 0.2884855612464573, "survival_time": 11.450000000000028, "driven_lanedir": 2.8819191074614428, "get_state_dump": 0.024974866535352625, "get_robot_state": 0.011050573639247729, "sim_render-ego0": 0.010777069174725077, "get_duckie_state": 0.05746526925460152, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "agent_compute-ego0": 0.11359626002933668, "complete-iteration": 0.897083938640097, "set_robot_commands": 0.007249206045399541, "distance-from-start": 2.88190072059649, "deviation-center-line": 0.27010230231285143, "driven_lanedir_consec": 2.8819191074614428, "sim_compute_sim_state": 0.06912888651308806, "sim_compute_performance-ego0": 0.0060270589330922}}
set_robot_commands_max0.007249206045399541
set_robot_commands_mean0.007228105597210686
set_robot_commands_median0.007228105597210686
set_robot_commands_min0.007207005149021831
sim_compute_performance-ego0_max0.0060270589330922
sim_compute_performance-ego0_mean0.00590070351940473
sim_compute_performance-ego0_median0.00590070351940473
sim_compute_performance-ego0_min0.005774348105717261
sim_compute_sim_state_max0.06912888651308806
sim_compute_sim_state_mean0.06456523025225312
sim_compute_sim_state_median0.06456523025225312
sim_compute_sim_state_min0.06000157399141818
sim_render-ego0_max0.010777069174725077
sim_render-ego0_mean0.010407924803144938
sim_render-ego0_median0.010407924803144938
sim_render-ego0_min0.010038780431564802
simulation-passed1
step_physics_max0.2884855612464573
step_physics_mean0.24017015695744523
step_physics_median0.24017015695744523
step_physics_min0.19185475266843316
survival_time_max59.99999999999873
survival_time_mean35.724999999999376
survival_time_min11.450000000000028
No reset possible
7774515705Victor Guerra 🇫🇷template-rosmooc-visservoingsimsuccessnononame0:27:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median2.5750000000000366
deviation-center-line_median2.9581408698429796
driven_lanedir_consec_median3.876345978597669
survival_time_median40.79999999999945


other stats
agent_compute-ego0_max0.07373266572489749
agent_compute-ego0_mean0.06596131695512938
agent_compute-ego0_median0.06596131695512938
agent_compute-ego0_min0.05818996818536128
complete-iteration_max0.32469664269727044
complete-iteration_mean0.3200638764832965
complete-iteration_median0.3200638764832965
complete-iteration_min0.3154311102693226
deviation-center-line_max5.106998626093993
deviation-center-line_mean2.9581408698429796
deviation-center-line_min0.8092831135919666
deviation-heading_max9.27181732121801
deviation-heading_mean5.770022621923395
deviation-heading_median5.770022621923395
deviation-heading_min2.268227922628779
distance-from-start_max1.6552365912325744
distance-from-start_mean1.5487362035846908
distance-from-start_median1.5487362035846908
distance-from-start_min1.4422358159368074
driven_any_max6.2483501715125955
driven_any_mean4.199114060505439
driven_any_median4.199114060505439
driven_any_min2.1498779494982827
driven_lanedir_consec_max6.011296626518096
driven_lanedir_consec_mean3.876345978597669
driven_lanedir_consec_min1.741395330677242
driven_lanedir_max6.011296626518096
driven_lanedir_mean3.876345978597669
driven_lanedir_median3.876345978597669
driven_lanedir_min1.741395330677242
get_duckie_state_max3.4006308187788683e-06
get_duckie_state_mean3.3359939127260905e-06
get_duckie_state_median3.3359939127260905e-06
get_duckie_state_min3.2713570066733127e-06
get_robot_state_max0.011357374609755588
get_robot_state_mean0.011277874283150448
get_robot_state_median0.011277874283150448
get_robot_state_min0.011198373956545306
get_state_dump_max0.013527203559081422
get_state_dump_mean0.013294100852419506
get_state_dump_median0.013294100852419506
get_state_dump_min0.01306099814575759
get_ui_image_max0.09520355768622207
get_ui_image_mean0.0950227847845608
get_ui_image_median0.0950227847845608
get_ui_image_min0.09484201188289952
in-drivable-lane_max4.20000000000006
in-drivable-lane_mean2.5750000000000366
in-drivable-lane_min0.9500000000000136
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 2.1498779494982827, "get_ui_image": 0.09520355768622207, "step_physics": 0.0989417104743094, "survival_time": 21.600000000000172, "driven_lanedir": 1.741395330677242, "get_state_dump": 0.01306099814575759, "get_robot_state": 0.011357374609755588, "sim_render-ego0": 0.009169138056026043, "get_duckie_state": 3.4006308187788683e-06, "in-drivable-lane": 4.20000000000006, "deviation-heading": 2.268227922628779, "agent_compute-ego0": 0.07373266572489749, "complete-iteration": 0.32469664269727044, "set_robot_commands": 0.006606361331895648, "distance-from-start": 1.4422358159368074, "deviation-center-line": 0.8092831135919666, "driven_lanedir_consec": 1.741395330677242, "sim_compute_sim_state": 0.01083589976709379, "sim_compute_performance-ego0": 0.005581585969991002}, "LF-small-loop-001-ego0": {"driven_any": 6.2483501715125955, "get_ui_image": 0.09484201188289952, "step_physics": 0.105766028786182, "survival_time": 59.99999999999873, "driven_lanedir": 6.011296626518096, "get_state_dump": 0.013527203559081422, "get_robot_state": 0.011198373956545306, "sim_render-ego0": 0.009147528903271931, "get_duckie_state": 3.2713570066733127e-06, "in-drivable-lane": 0.9500000000000136, "deviation-heading": 9.27181732121801, "agent_compute-ego0": 0.05818996818536128, "complete-iteration": 0.3154311102693226, "set_robot_commands": 0.006014724059664737, "distance-from-start": 1.6552365912325744, "deviation-center-line": 5.106998626093993, "driven_lanedir_consec": 6.011296626518096, "sim_compute_sim_state": 0.010991029397931128, "sim_compute_performance-ego0": 0.005545977847363728}}
set_robot_commands_max0.006606361331895648
set_robot_commands_mean0.006310542695780193
set_robot_commands_median0.006310542695780193
set_robot_commands_min0.006014724059664737
sim_compute_performance-ego0_max0.005581585969991002
sim_compute_performance-ego0_mean0.0055637819086773645
sim_compute_performance-ego0_median0.0055637819086773645
sim_compute_performance-ego0_min0.005545977847363728
sim_compute_sim_state_max0.010991029397931128
sim_compute_sim_state_mean0.01091346458251246
sim_compute_sim_state_median0.01091346458251246
sim_compute_sim_state_min0.01083589976709379
sim_render-ego0_max0.009169138056026043
sim_render-ego0_mean0.009158333479648988
sim_render-ego0_median0.009158333479648988
sim_render-ego0_min0.009147528903271931
simulation-passed1
step_physics_max0.105766028786182
step_physics_mean0.1023538696302457
step_physics_median0.1023538696302457
step_physics_min0.0989417104743094
survival_time_max59.99999999999873
survival_time_mean40.79999999999945
survival_time_min21.600000000000172
No reset possible
7773715702Victor Guerra 🇫🇷template-rosmooc-visservoingsimsuccessnononame0:32:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median2.3249999999998785
deviation-center-line_median3.159522732581568
driven_lanedir_consec_median4.622512476042038
survival_time_median50.14999999999929


other stats
agent_compute-ego0_max0.04176130850223509
agent_compute-ego0_mean0.03526131453449447
agent_compute-ego0_median0.03526131453449447
agent_compute-ego0_min0.02876132056675386
complete-iteration_max0.3148568129162308
complete-iteration_mean0.3079540796295169
complete-iteration_median0.3079540796295169
complete-iteration_min0.30105134634280295
deviation-center-line_max4.637864185640272
deviation-center-line_mean3.159522732581568
deviation-center-line_min1.6811812795228651
deviation-heading_max17.63362237264118
deviation-heading_mean13.6773659859582
deviation-heading_median13.6773659859582
deviation-heading_min9.72110959927522
distance-from-start_max1.6493276632355711
distance-from-start_mean1.410720260377916
distance-from-start_median1.410720260377916
distance-from-start_min1.1721128575202613
driven_any_max6.248198829735702
driven_any_mean5.17642653570678
driven_any_median5.17642653570678
driven_any_min4.104654241677856
driven_lanedir_consec_max5.758755521298976
driven_lanedir_consec_mean4.622512476042038
driven_lanedir_consec_min3.486269430785099
driven_lanedir_max5.758755521298976
driven_lanedir_mean4.622512476042038
driven_lanedir_median4.622512476042038
driven_lanedir_min3.486269430785099
get_duckie_state_max3.31125886712245e-06
get_duckie_state_mean3.2594153773689475e-06
get_duckie_state_median3.2594153773689475e-06
get_duckie_state_min3.207571887615445e-06
get_robot_state_max0.011296207281441198
get_robot_state_mean0.010695237659776627
get_robot_state_median0.010695237659776627
get_robot_state_min0.01009426803811206
get_state_dump_max0.01478064884055564
get_state_dump_mean0.013732865454319253
get_state_dump_median0.013732865454319253
get_state_dump_min0.012685082068082864
get_ui_image_max0.0986935858126981
get_ui_image_mean0.09721808771972971
get_ui_image_median0.09721808771972971
get_ui_image_min0.09574258962676133
in-drivable-lane_max4.349999999999753
in-drivable-lane_mean2.3249999999998785
in-drivable-lane_min0.30000000000000426
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 4.104654241677856, "get_ui_image": 0.09574258962676133, "step_physics": 0.1078071990125389, "survival_time": 40.29999999999985, "driven_lanedir": 3.486269430785099, "get_state_dump": 0.012685082068082864, "get_robot_state": 0.011296207281441198, "sim_render-ego0": 0.00923459001042438, "get_duckie_state": 3.207571887615445e-06, "in-drivable-lane": 4.349999999999753, "deviation-heading": 9.72110959927522, "agent_compute-ego0": 0.04176130850223509, "complete-iteration": 0.30105134634280295, "set_robot_commands": 0.005973991408223999, "distance-from-start": 1.1721128575202613, "deviation-center-line": 1.6811812795228651, "driven_lanedir_consec": 3.486269430785099, "sim_compute_sim_state": 0.010785849120980302, "sim_compute_performance-ego0": 0.005558627836470858}, "LF-small-loop-001-ego0": {"driven_any": 6.248198829735702, "get_ui_image": 0.0986935858126981, "step_physics": 0.13085756512307606, "survival_time": 59.99999999999873, "driven_lanedir": 5.758755521298976, "get_state_dump": 0.01478064884055564, "get_robot_state": 0.01009426803811206, "sim_render-ego0": 0.008922078627333057, "get_duckie_state": 3.31125886712245e-06, "in-drivable-lane": 0.30000000000000426, "deviation-heading": 17.63362237264118, "agent_compute-ego0": 0.02876132056675386, "complete-iteration": 0.3148568129162308, "set_robot_commands": 0.0062154772676695, "distance-from-start": 1.6493276632355711, "deviation-center-line": 4.637864185640272, "driven_lanedir_consec": 5.758755521298976, "sim_compute_sim_state": 0.010847828965897763, "sim_compute_performance-ego0": 0.005480784559924835}}
set_robot_commands_max0.0062154772676695
set_robot_commands_mean0.00609473433794675
set_robot_commands_median0.00609473433794675
set_robot_commands_min0.005973991408223999
sim_compute_performance-ego0_max0.005558627836470858
sim_compute_performance-ego0_mean0.005519706198197846
sim_compute_performance-ego0_median0.005519706198197846
sim_compute_performance-ego0_min0.005480784559924835
sim_compute_sim_state_max0.010847828965897763
sim_compute_sim_state_mean0.010816839043439032
sim_compute_sim_state_median0.010816839043439032
sim_compute_sim_state_min0.010785849120980302
sim_render-ego0_max0.00923459001042438
sim_render-ego0_mean0.00907833431887872
sim_render-ego0_median0.00907833431887872
sim_render-ego0_min0.008922078627333057
simulation-passed1
step_physics_max0.13085756512307606
step_physics_mean0.11933238206780748
step_physics_median0.11933238206780748
step_physics_min0.1078071990125389
survival_time_max59.99999999999873
survival_time_mean50.14999999999929
survival_time_min40.29999999999985
No reset possible
7608515192Victor Guerra 🇫🇷template-rosmooc-modconsimsuccessnononame0:24:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median18.70000000000013
deviation-center-line_median0.4089716331420085
driven_lanedir_consec_median0.5790159205948404
survival_time_median23.250000000000195


other stats
agent_compute-ego0_max0.04783598169657753
agent_compute-ego0_mean0.041758127320055016
agent_compute-ego0_median0.041758127320055016
agent_compute-ego0_min0.0356802729435325
complete-iteration_max0.561577364882331
complete-iteration_mean0.5433797852483613
complete-iteration_median0.5433797852483613
complete-iteration_min0.5251822056143917
deviation-center-line_max0.817943266284017
deviation-center-line_mean0.4089716331420085
deviation-center-line_min0.0
deviation-heading_max1.500545831595436
deviation-heading_mean0.750272915797718
deviation-heading_median0.750272915797718
deviation-heading_min0.0
distance-from-start_max3.7399745734676983
distance-from-start_mean3.0629776848838395
distance-from-start_median3.0629776848838395
distance-from-start_min2.385980796299981
driven_any_max3.754017911030845
driven_any_mean3.09713452975119
driven_any_median3.09713452975119
driven_any_min2.4402511484715355
driven_lanedir_consec_max1.1580318411896808
driven_lanedir_consec_mean0.5790159205948404
driven_lanedir_consec_min0.0
driven_lanedir_max1.1580318411896808
driven_lanedir_mean0.5790159205948404
driven_lanedir_median0.5790159205948404
driven_lanedir_min0.0
get_duckie_state_max3.018903348784664e-06
get_duckie_state_mean2.990930984784599e-06
get_duckie_state_median2.990930984784599e-06
get_duckie_state_min2.9629586207845343e-06
get_robot_state_max0.009512902159170515
get_robot_state_mean0.00940419660321699
get_robot_state_median0.00940419660321699
get_robot_state_min0.009295491047263463
get_state_dump_max0.014352716998678627
get_state_dump_mean0.012647855554372572
get_state_dump_median0.012647855554372572
get_state_dump_min0.010942994110066514
get_ui_image_max0.2021629840188888
get_ui_image_mean0.1985169951688319
get_ui_image_median0.1985169951688319
get_ui_image_min0.194871006318775
in-drivable-lane_max18.800000000000132
in-drivable-lane_mean18.70000000000013
in-drivable-lane_min18.60000000000013
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 3.754017911030845, "get_ui_image": 0.2021629840188888, "step_physics": 0.19059919031446865, "survival_time": 27.90000000000026, "driven_lanedir": 1.1580318411896808, "get_state_dump": 0.014352716998678627, "get_robot_state": 0.009512902159170515, "sim_render-ego0": 0.00903523074919508, "get_duckie_state": 2.9629586207845343e-06, "in-drivable-lane": 18.800000000000132, "deviation-heading": 1.500545831595436, "agent_compute-ego0": 0.04783598169657753, "complete-iteration": 0.561577364882331, "set_robot_commands": 0.006491204280546185, "distance-from-start": 3.7399745734676983, "deviation-center-line": 0.817943266284017, "driven_lanedir_consec": 1.1580318411896808, "sim_compute_sim_state": 0.07630590889236369, "sim_compute_performance-ego0": 0.005090500672942624}, "LF-full-loop-001-ego0": {"driven_any": 2.4402511484715355, "get_ui_image": 0.194871006318775, "step_physics": 0.1840419545569944, "survival_time": 18.60000000000013, "driven_lanedir": 0.0, "get_state_dump": 0.010942994110066514, "get_robot_state": 0.009295491047263463, "sim_render-ego0": 0.00937048104109777, "get_duckie_state": 3.018903348784664e-06, "in-drivable-lane": 18.60000000000013, "deviation-heading": 0.0, "agent_compute-ego0": 0.0356802729435325, "complete-iteration": 0.5251822056143917, "set_robot_commands": 0.007488413087164749, "distance-from-start": 2.385980796299981, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.06808380083488076, "sim_compute_performance-ego0": 0.005212501929848188}}
set_robot_commands_max0.007488413087164749
set_robot_commands_mean0.006989808683855467
set_robot_commands_median0.006989808683855467
set_robot_commands_min0.006491204280546185
sim_compute_performance-ego0_max0.005212501929848188
sim_compute_performance-ego0_mean0.005151501301395406
sim_compute_performance-ego0_median0.005151501301395406
sim_compute_performance-ego0_min0.005090500672942624
sim_compute_sim_state_max0.07630590889236369
sim_compute_sim_state_mean0.07219485486362223
sim_compute_sim_state_median0.07219485486362223
sim_compute_sim_state_min0.06808380083488076
sim_render-ego0_max0.00937048104109777
sim_render-ego0_mean0.009202855895146423
sim_render-ego0_median0.009202855895146423
sim_render-ego0_min0.00903523074919508
simulation-passed1
step_physics_max0.19059919031446865
step_physics_mean0.18732057243573152
step_physics_median0.18732057243573152
step_physics_min0.1840419545569944
survival_time_max27.90000000000026
survival_time_mean23.250000000000195
survival_time_min18.60000000000013
No reset possible
7608415189Victor Guerra 🇫🇷template-rosmooc-modconsimsuccessnononame0:19:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median17.825000000000152
deviation-center-line_median0.3481629217374221
driven_lanedir_consec_median0.4473542371191655
survival_time_median21.45000000000017


other stats
agent_compute-ego0_max0.03168275823298189
agent_compute-ego0_mean0.031607989262059794
agent_compute-ego0_median0.031607989262059794
agent_compute-ego0_min0.0315332202911377
complete-iteration_max0.4909903074900309
complete-iteration_mean0.4781101013393336
complete-iteration_median0.4781101013393336
complete-iteration_min0.4652298951886364
deviation-center-line_max0.4572745423037492
deviation-center-line_mean0.3481629217374221
deviation-center-line_min0.23905130117109497
deviation-heading_max1.7297506427822054
deviation-heading_mean1.6712445498648891
deviation-heading_median1.6712445498648891
deviation-heading_min1.612738456947573
distance-from-start_max2.998908153814507
distance-from-start_mean2.7162389217435003
distance-from-start_median2.7162389217435003
distance-from-start_min2.4335696896724937
driven_any_max3.222917673013706
driven_any_mean2.845560323990072
driven_any_median2.845560323990072
driven_any_min2.4682029749664385
driven_lanedir_consec_max0.6258372684371187
driven_lanedir_consec_mean0.4473542371191655
driven_lanedir_consec_min0.2688712058012124
driven_lanedir_max0.6258372684371187
driven_lanedir_mean0.4473542371191655
driven_lanedir_median0.4473542371191655
driven_lanedir_min0.2688712058012124
get_duckie_state_max3.254572550455729e-06
get_duckie_state_mean3.248041028419311e-06
get_duckie_state_median3.248041028419311e-06
get_duckie_state_min3.241509506382893e-06
get_robot_state_max0.01122575569152832
get_robot_state_mean0.010714450452745576
get_robot_state_median0.010714450452745576
get_robot_state_min0.01020314521396283
get_state_dump_max0.015406198501586914
get_state_dump_mean0.01402115177862423
get_state_dump_median0.01402115177862423
get_state_dump_min0.012636105055661545
get_ui_image_max0.1631630770365397
get_ui_image_mean0.16274083401329328
get_ui_image_median0.16274083401329328
get_ui_image_min0.16231859099004686
in-drivable-lane_max21.700000000000173
in-drivable-lane_mean17.825000000000152
in-drivable-lane_min13.950000000000134
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 2.4682029749664385, "get_ui_image": 0.1631630770365397, "step_physics": 0.17618073145548502, "survival_time": 18.70000000000013, "driven_lanedir": 0.6258372684371187, "get_state_dump": 0.015406198501586914, "get_robot_state": 0.01122575569152832, "sim_render-ego0": 0.010423756281534831, "get_duckie_state": 3.254572550455729e-06, "in-drivable-lane": 13.950000000000134, "deviation-heading": 1.612738456947573, "agent_compute-ego0": 0.0315332202911377, "complete-iteration": 0.4909903074900309, "set_robot_commands": 0.007151220321655273, "distance-from-start": 2.4335696896724937, "deviation-center-line": 0.4572745423037492, "driven_lanedir_consec": 0.6258372684371187, "sim_compute_sim_state": 0.06964714241027832, "sim_compute_performance-ego0": 0.006044210433959961}, "LF-full-loop-001-ego0": {"driven_any": 3.222917673013706, "get_ui_image": 0.16231859099004686, "step_physics": 0.1566964591901327, "survival_time": 24.20000000000021, "driven_lanedir": 0.2688712058012124, "get_state_dump": 0.012636105055661545, "get_robot_state": 0.01020314521396283, "sim_render-ego0": 0.009892048786595924, "get_duckie_state": 3.241509506382893e-06, "in-drivable-lane": 21.700000000000173, "deviation-heading": 1.7297506427822054, "agent_compute-ego0": 0.03168275823298189, "complete-iteration": 0.4652298951886364, "set_robot_commands": 0.0069392061725105205, "distance-from-start": 2.998908153814507, "deviation-center-line": 0.23905130117109497, "driven_lanedir_consec": 0.2688712058012124, "sim_compute_sim_state": 0.06889543484166726, "sim_compute_performance-ego0": 0.005753426699294258}}
set_robot_commands_max0.007151220321655273
set_robot_commands_mean0.007045213247082897
set_robot_commands_median0.007045213247082897
set_robot_commands_min0.0069392061725105205
sim_compute_performance-ego0_max0.006044210433959961
sim_compute_performance-ego0_mean0.00589881856662711
sim_compute_performance-ego0_median0.00589881856662711
sim_compute_performance-ego0_min0.005753426699294258
sim_compute_sim_state_max0.06964714241027832
sim_compute_sim_state_mean0.06927128862597279
sim_compute_sim_state_median0.06927128862597279
sim_compute_sim_state_min0.06889543484166726
sim_render-ego0_max0.010423756281534831
sim_render-ego0_mean0.01015790253406538
sim_render-ego0_median0.01015790253406538
sim_render-ego0_min0.009892048786595924
simulation-passed1
step_physics_max0.17618073145548502
step_physics_mean0.16643859532280886
step_physics_median0.16643859532280886
step_physics_min0.1566964591901327
survival_time_max24.20000000000021
survival_time_mean21.45000000000017
survival_time_min18.70000000000013
No reset possible
7608315187Victor Guerra 🇫🇷template-rosmooc-modconsimsuccessnononame0:19:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median17.950000000000152
deviation-center-line_median0.34207815522725094
driven_lanedir_consec_median0.4437253819397189
survival_time_median21.55000000000017


other stats
agent_compute-ego0_max0.03193627611796061
agent_compute-ego0_mean0.03184809845064315
agent_compute-ego0_median0.03184809845064315
agent_compute-ego0_min0.03175992078332569
complete-iteration_max0.4939863573710124
complete-iteration_mean0.479834020706286
complete-iteration_median0.479834020706286
complete-iteration_min0.4656816840415596
deviation-center-line_max0.4584960635353445
deviation-center-line_mean0.34207815522725094
deviation-center-line_min0.22566024691915731
deviation-heading_max1.710067654842892
deviation-heading_mean1.654467170632798
deviation-heading_median1.654467170632798
deviation-heading_min1.5988666864227044
distance-from-start_max3.011525944743067
distance-from-start_mean2.7255361877140984
distance-from-start_median2.7255361877140984
distance-from-start_min2.4395464306851298
driven_any_max3.2508699750255365
driven_any_mean2.8595365793993093
driven_any_median2.8595365793993093
driven_any_min2.468203183773082
driven_lanedir_consec_max0.6338245220615053
driven_lanedir_consec_mean0.4437253819397189
driven_lanedir_consec_min0.2536262418179325
driven_lanedir_max0.6338245220615053
driven_lanedir_mean0.4437253819397189
driven_lanedir_median0.4437253819397189
driven_lanedir_min0.2536262418179325
get_duckie_state_max3.2634735107421876e-06
get_duckie_state_mean3.2085172969139425e-06
get_duckie_state_median3.2085172969139425e-06
get_duckie_state_min3.153561083085698e-06
get_robot_state_max0.010674147923787436
get_robot_state_mean0.0103998812751536
get_robot_state_median0.0103998812751536
get_robot_state_min0.010125614626519765
get_state_dump_max0.014883660634358723
get_state_dump_mean0.013771339207826704
get_state_dump_median0.013771339207826704
get_state_dump_min0.012659017781294683
get_ui_image_max0.16298164034182308
get_ui_image_mean0.1628736781293873
get_ui_image_median0.1628736781293873
get_ui_image_min0.1627657159169515
in-drivable-lane_max22.000000000000178
in-drivable-lane_mean17.950000000000152
in-drivable-lane_min13.900000000000126
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 2.468203183773082, "get_ui_image": 0.1627657159169515, "step_physics": 0.18077129173278808, "survival_time": 18.70000000000013, "driven_lanedir": 0.6338245220615053, "get_state_dump": 0.014883660634358723, "get_robot_state": 0.010674147923787436, "sim_render-ego0": 0.009954540888468423, "get_duckie_state": 3.2634735107421876e-06, "in-drivable-lane": 13.900000000000126, "deviation-heading": 1.5988666864227044, "agent_compute-ego0": 0.03193627611796061, "complete-iteration": 0.4939863573710124, "set_robot_commands": 0.007623660405476888, "distance-from-start": 2.4395464306851298, "deviation-center-line": 0.4584960635353445, "driven_lanedir_consec": 0.6338245220615053, "sim_compute_sim_state": 0.06926011530558268, "sim_compute_performance-ego0": 0.005900638580322266}, "LF-full-loop-001-ego0": {"driven_any": 3.2508699750255365, "get_ui_image": 0.16298164034182308, "step_physics": 0.1558195769421162, "survival_time": 24.40000000000021, "driven_lanedir": 0.2536262418179325, "get_state_dump": 0.012659017781294683, "get_robot_state": 0.010125614626519765, "sim_render-ego0": 0.009877256089192958, "get_duckie_state": 3.153561083085698e-06, "in-drivable-lane": 22.000000000000178, "deviation-heading": 1.710067654842892, "agent_compute-ego0": 0.03175992078332569, "complete-iteration": 0.4656816840415596, "set_robot_commands": 0.00695421993122998, "distance-from-start": 3.011525944743067, "deviation-center-line": 0.22566024691915731, "driven_lanedir_consec": 0.2536262418179325, "sim_compute_sim_state": 0.06952215703718502, "sim_compute_performance-ego0": 0.005767188433001622}}
set_robot_commands_max0.007623660405476888
set_robot_commands_mean0.007288940168353434
set_robot_commands_median0.007288940168353434
set_robot_commands_min0.00695421993122998
sim_compute_performance-ego0_max0.005900638580322266
sim_compute_performance-ego0_mean0.005833913506661944
sim_compute_performance-ego0_median0.005833913506661944
sim_compute_performance-ego0_min0.005767188433001622
sim_compute_sim_state_max0.06952215703718502
sim_compute_sim_state_mean0.06939113617138384
sim_compute_sim_state_median0.06939113617138384
sim_compute_sim_state_min0.06926011530558268
sim_render-ego0_max0.009954540888468423
sim_render-ego0_mean0.00991589848883069
sim_render-ego0_median0.00991589848883069
sim_render-ego0_min0.009877256089192958
simulation-passed1
step_physics_max0.18077129173278808
step_physics_mean0.16829543433745214
step_physics_median0.16829543433745214
step_physics_min0.1558195769421162
survival_time_max24.40000000000021
survival_time_mean21.55000000000017
survival_time_min18.70000000000013
No reset possible
7608215187Victor Guerra 🇫🇷template-rosmooc-modconsimabortednononame0:04:22
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 219, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7608115185Victor Guerra 🇫🇷template-rosmooc-modconsimsuccessnononame0:21:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median18.050000000000143
deviation-center-line_median0.34274842684016377
driven_lanedir_consec_median0.4423648229275595
survival_time_median21.650000000000173


other stats
agent_compute-ego0_max0.03256014926438399
agent_compute-ego0_mean0.03179991010429893
agent_compute-ego0_median0.03179991010429893
agent_compute-ego0_min0.03103967094421387
complete-iteration_max0.5194940636952718
complete-iteration_mean0.4936051938067908
complete-iteration_median0.4936051938067908
complete-iteration_min0.4677163239183097
deviation-center-line_max0.463779054707491
deviation-center-line_mean0.34274842684016377
deviation-center-line_min0.22171779897283656
deviation-heading_max1.7261474158523042
deviation-heading_mean1.6619040917324837
deviation-heading_median1.6619040917324837
deviation-heading_min1.5976607676126633
distance-from-start_max3.021950204205904
distance-from-start_mean2.7334977697231677
distance-from-start_median2.7334977697231677
distance-from-start_min2.4450453352404313
driven_any_max3.27882223218952
driven_any_mean2.8735127905096576
driven_any_median2.8735127905096576
driven_any_min2.4682033488297948
driven_lanedir_consec_max0.6411998953631695
driven_lanedir_consec_mean0.4423648229275595
driven_lanedir_consec_min0.2435297504919496
driven_lanedir_max0.6411998953631695
driven_lanedir_mean0.4423648229275595
driven_lanedir_median0.4423648229275595
driven_lanedir_min0.2435297504919496
get_duckie_state_max3.376548720663508e-06
get_duckie_state_mean3.366423265767952e-06
get_duckie_state_median3.366423265767952e-06
get_duckie_state_min3.356297810872396e-06
get_robot_state_max0.011588905970255534
get_robot_state_mean0.01138597148201448
get_robot_state_median0.01138597148201448
get_robot_state_min0.011183036993773423
get_state_dump_max0.0167930056254069
get_state_dump_mean0.014801075574270043
get_state_dump_median0.014801075574270043
get_state_dump_min0.01280914552313319
get_ui_image_max0.164683198928833
get_ui_image_mean0.16381788452063323
get_ui_image_median0.16381788452063323
get_ui_image_min0.16295257011243344
in-drivable-lane_max22.25000000000018
in-drivable-lane_mean18.050000000000143
in-drivable-lane_min13.850000000000117
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 2.4682033488297948, "get_ui_image": 0.164683198928833, "step_physics": 0.20179657427469888, "survival_time": 18.70000000000013, "driven_lanedir": 0.6411998953631695, "get_state_dump": 0.0167930056254069, "get_robot_state": 0.011588905970255534, "sim_render-ego0": 0.01096340560913086, "get_duckie_state": 3.356297810872396e-06, "in-drivable-lane": 13.850000000000117, "deviation-heading": 1.5976607676126633, "agent_compute-ego0": 0.03103967094421387, "complete-iteration": 0.5194940636952718, "set_robot_commands": 0.007478010813395182, "distance-from-start": 2.4450453352404313, "deviation-center-line": 0.463779054707491, "driven_lanedir_consec": 0.6411998953631695, "sim_compute_sim_state": 0.06891174507141114, "sim_compute_performance-ego0": 0.006026457468668619}, "LF-full-loop-001-ego0": {"driven_any": 3.27882223218952, "get_ui_image": 0.16295257011243344, "step_physics": 0.15582898905988157, "survival_time": 24.600000000000215, "driven_lanedir": 0.2435297504919496, "get_state_dump": 0.01280914552313319, "get_robot_state": 0.011183036993773423, "sim_render-ego0": 0.010559540007709247, "get_duckie_state": 3.376548720663508e-06, "in-drivable-lane": 22.25000000000018, "deviation-heading": 1.7261474158523042, "agent_compute-ego0": 0.03256014926438399, "complete-iteration": 0.4677163239183097, "set_robot_commands": 0.006783607765337033, "distance-from-start": 3.021950204205904, "deviation-center-line": 0.22171779897283656, "driven_lanedir_consec": 0.2435297504919496, "sim_compute_sim_state": 0.06878410681749696, "sim_compute_performance-ego0": 0.0060447505231319525}}
set_robot_commands_max0.007478010813395182
set_robot_commands_mean0.007130809289366108
set_robot_commands_median0.007130809289366108
set_robot_commands_min0.006783607765337033
sim_compute_performance-ego0_max0.0060447505231319525
sim_compute_performance-ego0_mean0.006035603995900286
sim_compute_performance-ego0_median0.006035603995900286
sim_compute_performance-ego0_min0.006026457468668619
sim_compute_sim_state_max0.06891174507141114
sim_compute_sim_state_mean0.06884792594445405
sim_compute_sim_state_median0.06884792594445405
sim_compute_sim_state_min0.06878410681749696
sim_render-ego0_max0.01096340560913086
sim_render-ego0_mean0.010761472808420054
sim_render-ego0_median0.010761472808420054
sim_render-ego0_min0.010559540007709247
simulation-passed1
step_physics_max0.20179657427469888
step_physics_mean0.1788127816672902
step_physics_median0.1788127816672902
step_physics_min0.15582898905988157
survival_time_max24.600000000000215
survival_time_mean21.650000000000173
survival_time_min18.70000000000013
No reset possible
7608015185Victor Guerra 🇫🇷template-rosmooc-modconsimabortednononame0:04:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 219, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7607715177Victor Guerra 🇫🇷template-rosmooc-modconsimsuccessnononame0:21:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median18.450000000000152
deviation-center-line_median0.31357923743534505
driven_lanedir_consec_median0.3962596638854816
survival_time_median21.750000000000178


other stats
agent_compute-ego0_max0.04928550859345049
agent_compute-ego0_mean0.04037308786579916
agent_compute-ego0_median0.04037308786579916
agent_compute-ego0_min0.03146066713814784
complete-iteration_max0.5428697531672309
complete-iteration_mean0.5042383641204986
complete-iteration_median0.5042383641204986
complete-iteration_min0.46560697507376625
deviation-center-line_max0.4168655539980713
deviation-center-line_mean0.31357923743534505
deviation-center-line_min0.21029292087261883
deviation-heading_max1.72355206032134
deviation-heading_mean1.6685305964217203
deviation-heading_median1.6685305964217203
deviation-heading_min1.6135091325221014
distance-from-start_max2.998645082743574
distance-from-start_mean2.7210458166870377
distance-from-start_median2.7210458166870377
distance-from-start_min2.4434465506305014
driven_any_max3.292797465606292
driven_any_mean2.8874883300556977
driven_any_median2.8874883300556977
driven_any_min2.482179194505103
driven_lanedir_consec_max0.5662097185751351
driven_lanedir_consec_mean0.3962596638854816
driven_lanedir_consec_min0.2263096091958281
driven_lanedir_max0.5662097185751351
driven_lanedir_mean0.3962596638854816
driven_lanedir_median0.3962596638854816
driven_lanedir_min0.2263096091958281
get_duckie_state_max4.393984847739141e-06
get_duckie_state_mean4.325901756453219e-06
get_duckie_state_median4.325901756453219e-06
get_duckie_state_min4.257818665167298e-06
get_robot_state_max0.011071348696235637
get_robot_state_mean0.01103572316853636
get_robot_state_median0.01103572316853636
get_robot_state_min0.011000097640837082
get_state_dump_max0.01770647767367983
get_state_dump_mean0.01519876208345092
get_state_dump_median0.01519876208345092
get_state_dump_min0.012691046493222016
get_ui_image_max0.16467520159814972
get_ui_image_mean0.16358090846180753
get_ui_image_median0.16358090846180753
get_ui_image_min0.16248661532546535
in-drivable-lane_max22.450000000000184
in-drivable-lane_mean18.450000000000152
in-drivable-lane_min14.45000000000012
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 2.482179194505103, "get_ui_image": 0.16467520159814972, "step_physics": 0.20779929173719977, "survival_time": 18.800000000000132, "driven_lanedir": 0.5662097185751351, "get_state_dump": 0.01770647767367983, "get_robot_state": 0.011071348696235637, "sim_render-ego0": 0.010525220268917336, "get_duckie_state": 4.393984847739141e-06, "in-drivable-lane": 14.45000000000012, "deviation-heading": 1.6135091325221014, "agent_compute-ego0": 0.04928550859345049, "complete-iteration": 0.5428697531672309, "set_robot_commands": 0.007196875402718703, "distance-from-start": 2.4434465506305014, "deviation-center-line": 0.4168655539980713, "driven_lanedir_consec": 0.5662097185751351, "sim_compute_sim_state": 0.06840851072923575, "sim_compute_performance-ego0": 0.005985391551050647}, "LF-full-loop-001-ego0": {"driven_any": 3.292797465606292, "get_ui_image": 0.16248661532546535, "step_physics": 0.15586000741130174, "survival_time": 24.700000000000216, "driven_lanedir": 0.2263096091958281, "get_state_dump": 0.012691046493222016, "get_robot_state": 0.011000097640837082, "sim_render-ego0": 0.010385375071053552, "get_duckie_state": 4.257818665167298e-06, "in-drivable-lane": 22.450000000000184, "deviation-heading": 1.72355206032134, "agent_compute-ego0": 0.03146066713814784, "complete-iteration": 0.46560697507376625, "set_robot_commands": 0.006709314115119703, "distance-from-start": 2.998645082743574, "deviation-center-line": 0.21029292087261883, "driven_lanedir_consec": 0.2263096091958281, "sim_compute_sim_state": 0.06880426214198873, "sim_compute_performance-ego0": 0.006002429037383109}}
set_robot_commands_max0.007196875402718703
set_robot_commands_mean0.0069530947589192035
set_robot_commands_median0.0069530947589192035
set_robot_commands_min0.006709314115119703
sim_compute_performance-ego0_max0.006002429037383109
sim_compute_performance-ego0_mean0.005993910294216878
sim_compute_performance-ego0_median0.005993910294216878
sim_compute_performance-ego0_min0.005985391551050647
sim_compute_sim_state_max0.06880426214198873
sim_compute_sim_state_mean0.06860638643561223
sim_compute_sim_state_median0.06860638643561223
sim_compute_sim_state_min0.06840851072923575
sim_render-ego0_max0.010525220268917336
sim_render-ego0_mean0.010455297669985444
sim_render-ego0_median0.010455297669985444
sim_render-ego0_min0.010385375071053552
simulation-passed1
step_physics_max0.20779929173719977
step_physics_mean0.1818296495742507
step_physics_median0.1818296495742507
step_physics_min0.15586000741130174
survival_time_max24.700000000000216
survival_time_mean21.750000000000178
survival_time_min18.800000000000132
No reset possible
7607615177Victor Guerra 🇫🇷template-rosmooc-modconsimabortednononame0:04:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 219, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7607515171Victor Guerra 🇫🇷template-rosmooc-modconsimsuccessnononame0:29:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median24.17500000000024
deviation-center-line_median0.5205995726507195
driven_lanedir_consec_median0.44327921253937697
survival_time_median30.675000000000303


other stats
agent_compute-ego0_max0.03359614587143848
agent_compute-ego0_mean0.03238456468788918
agent_compute-ego0_median0.03238456468788918
agent_compute-ego0_min0.031172983504339884
complete-iteration_max0.49007563660110254
complete-iteration_mean0.47644633081443977
complete-iteration_median0.47644633081443977
complete-iteration_min0.462817025027777
deviation-center-line_max0.5805451592454764
deviation-center-line_mean0.5205995726507195
deviation-center-line_min0.4606539860559627
deviation-heading_max6.039142903593873
deviation-heading_mean5.876479868658561
deviation-heading_median5.876479868658561
deviation-heading_min5.713816833723249
distance-from-start_max1.0649219235378369
distance-from-start_mean1.0491831087758148
distance-from-start_median1.0491831087758148
distance-from-start_min1.0334442940137931
driven_any_max4.187093820686834
driven_any_mean4.134708829392865
driven_any_median4.134708829392865
driven_any_min4.082323838098897
driven_lanedir_consec_max0.5540685249992114
driven_lanedir_consec_mean0.44327921253937697
driven_lanedir_consec_min0.3324899000795425
driven_lanedir_max0.6802510368652988
driven_lanedir_mean0.5063704684724206
driven_lanedir_median0.5063704684724206
driven_lanedir_min0.3324899000795425
get_duckie_state_max3.4135423208537853e-06
get_duckie_state_mean3.3985448622159994e-06
get_duckie_state_median3.3985448622159994e-06
get_duckie_state_min3.383547403578213e-06
get_robot_state_max0.01128350119841726
get_robot_state_mean0.01087398817856662
get_robot_state_median0.01087398817856662
get_robot_state_min0.010464475158715975
get_state_dump_max0.015163382470319812
get_state_dump_mean0.013914656704833966
get_state_dump_median0.013914656704833966
get_state_dump_min0.01266593093934812
get_ui_image_max0.16645181466991774
get_ui_image_mean0.16502817550438703
get_ui_image_median0.16502817550438703
get_ui_image_min0.16360453633885635
in-drivable-lane_max24.900000000000247
in-drivable-lane_mean24.17500000000024
in-drivable-lane_min23.45000000000023
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 4.187093820686834, "get_ui_image": 0.16645181466991774, "step_physics": 0.17732819266941235, "survival_time": 31.000000000000306, "driven_lanedir": 0.6802510368652988, "get_state_dump": 0.015163382470319812, "get_robot_state": 0.010464475158715975, "sim_render-ego0": 0.01028010580274794, "get_duckie_state": 3.383547403578213e-06, "in-drivable-lane": 23.45000000000023, "deviation-heading": 6.039142903593873, "agent_compute-ego0": 0.031172983504339884, "complete-iteration": 0.49007563660110254, "set_robot_commands": 0.006986332400409496, "distance-from-start": 1.0334442940137931, "deviation-center-line": 0.5805451592454764, "driven_lanedir_consec": 0.5540685249992114, "sim_compute_sim_state": 0.06618697171049993, "sim_compute_performance-ego0": 0.005835160733037141}, "LF-full-loop-001-ego0": {"driven_any": 4.082323838098897, "get_ui_image": 0.16360453633885635, "step_physics": 0.1500584812540757, "survival_time": 30.350000000000296, "driven_lanedir": 0.3324899000795425, "get_state_dump": 0.01266593093934812, "get_robot_state": 0.01128350119841726, "sim_render-ego0": 0.010396374291495272, "get_duckie_state": 3.4135423208537853e-06, "in-drivable-lane": 24.900000000000247, "deviation-heading": 5.713816833723249, "agent_compute-ego0": 0.03359614587143848, "complete-iteration": 0.462817025027777, "set_robot_commands": 0.007024756779796199, "distance-from-start": 1.0649219235378369, "deviation-center-line": 0.4606539860559627, "driven_lanedir_consec": 0.3324899000795425, "sim_compute_sim_state": 0.06798963680079109, "sim_compute_performance-ego0": 0.005992500797698372}}
set_robot_commands_max0.007024756779796199
set_robot_commands_mean0.0070055445901028475
set_robot_commands_median0.0070055445901028475
set_robot_commands_min0.006986332400409496
sim_compute_performance-ego0_max0.005992500797698372
sim_compute_performance-ego0_mean0.005913830765367757
sim_compute_performance-ego0_median0.005913830765367757
sim_compute_performance-ego0_min0.005835160733037141
sim_compute_sim_state_max0.06798963680079109
sim_compute_sim_state_mean0.06708830425564552
sim_compute_sim_state_median0.06708830425564552
sim_compute_sim_state_min0.06618697171049993
sim_render-ego0_max0.010396374291495272
sim_render-ego0_mean0.010338240047121606
sim_render-ego0_median0.010338240047121606
sim_render-ego0_min0.01028010580274794
simulation-passed1
step_physics_max0.17732819266941235
step_physics_mean0.16369333696174404
step_physics_median0.16369333696174404
step_physics_min0.1500584812540757
survival_time_max31.000000000000306
survival_time_mean30.675000000000303
survival_time_min30.350000000000296
No reset possible