Duckietown Challenges Home Challenges Submissions

Evaluator 648

ID648
evaluatoridsc-rudolf-5273
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-5273
versiond-c:4.0.14;d-c-r:4.0.19;d-s:4.0.15
first heard
last heard
statusinactive
# evaluating
# success5 17633
# timeout
# failed
# error2 17630
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
176982472Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationsuccessnoidsc-rudolf-52730:07:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2342705027983982
survival_time_median1.7500000000000009
deviation-center-line_median0.10801953665034704
in-drivable-lane_median0.7000000000000004


other stats
agent_compute-ego_max0.15458314380948507
agent_compute-ego_mean0.1474813164623081
agent_compute-ego_median0.1492214395153907
agent_compute-ego_min0.1397402627127511
deviation-center-line_max0.17768774509810673
deviation-center-line_mean0.08758489727910898
deviation-center-line_min0.019005533143064354
deviation-heading_max0.759385645220147
deviation-heading_mean0.3195081252333424
deviation-heading_median0.1806788823983304
deviation-heading_min0.118601117425238
driven_any_max2.812198352312563
driven_any_mean1.6891781761410722
driven_any_median1.608242001486626
driven_any_min0.3130680825984642
driven_lanedir_consec_max1.7389031534183392
driven_lanedir_consec_mean0.9694700664283822
driven_lanedir_consec_min0.28316071129320397
driven_lanedir_max1.7389031534183392
driven_lanedir_mean0.9694700664283822
driven_lanedir_median1.2342705027983982
driven_lanedir_min0.28316071129320397
in-drivable-lane_max1.5999999999999988
in-drivable-lane_mean0.7299999999999995
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.956358012875939, "sim_physics": 0.022066551706065304, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32939421125240065, "sim_render-ego": 0.06597000619639522, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.1511635573013969, "deviation-heading": 0.118601117425238, "set_robot_commands": 0.08085031094758408, "deviation-center-line": 0.02280708605632212, "driven_lanedir_consec": 0.32939421125240065, "sim_compute_sim_state": 0.037760506505551544, "sim_compute_performance-ego": 0.06741897956184718, "sim_compute_robot_state-ego": 0.06460934099943741, "sim_compute_robot_state-npc0": 0.07121830401213272, "sim_compute_robot_state-npc1": 0.06741377581720767, "sim_compute_robot_state-npc2": 0.06545380924058997, "sim_compute_robot_state-npc3": 0.06562235044396442}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.756024431431769, "sim_physics": 0.025623217705757387, "survival_time": 3.099999999999997, "driven_lanedir": 1.2342705027983982, "sim_render-ego": 0.06927861705903084, "in-drivable-lane": 1.5999999999999988, "agent_compute-ego": 0.1492214395153907, "deviation-heading": 0.4185133321358317, "set_robot_commands": 0.07923246583630962, "deviation-center-line": 0.11040458544770476, "driven_lanedir_consec": 1.2342705027983982, "sim_compute_sim_state": 0.038904086236030824, "sim_compute_performance-ego": 0.06506652985849688, "sim_compute_robot_state-ego": 0.06834133209720734, "sim_compute_robot_state-npc0": 0.07791018486022949, "sim_compute_robot_state-npc1": 0.07068922058228523, "sim_compute_robot_state-npc2": 0.06982595305288991, "sim_compute_robot_state-npc3": 0.06952761834667574}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3130680825984642, "sim_physics": 0.021763767514910017, "survival_time": 0.35, "driven_lanedir": 0.28316071129320397, "sim_render-ego": 0.06647692407880511, "in-drivable-lane": 0, "agent_compute-ego": 0.1397402627127511, "deviation-heading": 0.1203616489871648, "set_robot_commands": 0.07705552237374443, "deviation-center-line": 0.019005533143064354, "driven_lanedir_consec": 0.28316071129320397, "sim_compute_sim_state": 0.032084839684622626, "sim_compute_performance-ego": 0.06793318475995745, "sim_compute_robot_state-ego": 0.06102330344063895, "sim_compute_robot_state-npc0": 0.06757443291800362, "sim_compute_robot_state-npc1": 0.06279941967555455, "sim_compute_robot_state-npc2": 0.06358647346496582, "sim_compute_robot_state-npc3": 0.06760634694780622}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.608242001486626, "sim_physics": 0.019866234915597095, "survival_time": 1.7500000000000009, "driven_lanedir": 1.2616217533795693, "sim_render-ego": 0.06388860430036272, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.14269817897251674, "deviation-heading": 0.1806788823983304, "set_robot_commands": 0.0750913415636335, "deviation-center-line": 0.10801953665034704, "driven_lanedir_consec": 1.2616217533795693, "sim_compute_sim_state": 0.03341398239135742, "sim_compute_performance-ego": 0.06388042994907923, "sim_compute_robot_state-ego": 0.06014683587210519, "sim_compute_robot_state-npc0": 0.06857145173209055, "sim_compute_robot_state-npc1": 0.06206052643912179, "sim_compute_robot_state-npc2": 0.06057391166687011, "sim_compute_robot_state-npc3": 0.06103043556213379}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.812198352312563, "sim_physics": 0.022985829247368708, "survival_time": 3.149999999999997, "driven_lanedir": 1.7389031534183392, "sim_render-ego": 0.06419143979511564, "in-drivable-lane": 0.9999999999999982, "agent_compute-ego": 0.15458314380948507, "deviation-heading": 0.759385645220147, "set_robot_commands": 0.07670965270390587, "deviation-center-line": 0.17768774509810673, "driven_lanedir_consec": 1.7389031534183392, "sim_compute_sim_state": 0.03616122972397577, "sim_compute_performance-ego": 0.06167402343144492, "sim_compute_robot_state-ego": 0.06219046834915403, "sim_compute_robot_state-npc0": 0.06890339321560329, "sim_compute_robot_state-npc1": 0.06516928899855841, "sim_compute_robot_state-npc2": 0.06380109181479802, "sim_compute_robot_state-npc3": 0.0641281869676378}}
set_robot_commands_max0.08085031094758408
set_robot_commands_mean0.0777878586850355
set_robot_commands_median0.07705552237374443
set_robot_commands_min0.0750913415636335
sim_compute_performance-ego_max0.06793318475995745
sim_compute_performance-ego_mean0.06519462951216512
sim_compute_performance-ego_median0.06506652985849688
sim_compute_performance-ego_min0.06167402343144492
sim_compute_robot_state-ego_max0.06834133209720734
sim_compute_robot_state-ego_mean0.06326225615170858
sim_compute_robot_state-ego_median0.06219046834915403
sim_compute_robot_state-ego_min0.06014683587210519
sim_compute_robot_state-npc0_max0.07791018486022949
sim_compute_robot_state-npc0_mean0.07083555334761193
sim_compute_robot_state-npc0_median0.06890339321560329
sim_compute_robot_state-npc0_min0.06757443291800362
sim_compute_robot_state-npc1_max0.07068922058228523
sim_compute_robot_state-npc1_mean0.06562644630254552
sim_compute_robot_state-npc1_median0.06516928899855841
sim_compute_robot_state-npc1_min0.06206052643912179
sim_compute_robot_state-npc2_max0.06982595305288991
sim_compute_robot_state-npc2_mean0.06464824784802277
sim_compute_robot_state-npc2_median0.06380109181479802
sim_compute_robot_state-npc2_min0.06057391166687011
sim_compute_robot_state-npc3_max0.06952761834667574
sim_compute_robot_state-npc3_mean0.06558298765364359
sim_compute_robot_state-npc3_median0.06562235044396442
sim_compute_robot_state-npc3_min0.06103043556213379
sim_compute_sim_state_max0.038904086236030824
sim_compute_sim_state_mean0.035664928908307636
sim_compute_sim_state_median0.03616122972397577
sim_compute_sim_state_min0.032084839684622626
sim_physics_max0.025623217705757387
sim_physics_mean0.022461120217939706
sim_physics_median0.022066551706065304
sim_physics_min0.019866234915597095
sim_render-ego_max0.06927861705903084
sim_render-ego_mean0.06596111828594191
sim_render-ego_median0.06597000619639522
sim_render-ego_min0.06388860430036272
simulation-passed1
survival_time_max3.149999999999997
survival_time_mean1.899999999999999
survival_time_min0.35
No reset possible
176932503Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-52730:00:52
The container "solut [...]
The container "solution" exited with code 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
176882492Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-52730:03:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.06511710947982641
survival_time_median0.49999999999999994
deviation-center-line_median0.010474968192446667
in-drivable-lane_median0.19999999999999996


other stats
agent_compute-ego_max0.3758583068847656
agent_compute-ego_mean0.22419095006856052
agent_compute-ego_median0.1859044551849365
agent_compute-ego_min0.1782719872214577
deviation-center-line_max0.02149669693667203
deviation-center-line_mean0.012650184825964042
deviation-center-line_min0.008492928729301748
deviation-heading_max0.31609615727382545
deviation-heading_mean0.2454402989433969
deviation-heading_median0.23513504167032595
deviation-heading_min0.18992260558640253
driven_any_max0.17721552760965914
driven_any_mean0.1491279513805916
driven_any_median0.14410425075043257
driven_any_min0.12157195489253668
driven_lanedir_consec_max0.07723581612425923
driven_lanedir_consec_mean0.058188330992395086
driven_lanedir_consec_min0.02927680249756026
driven_lanedir_max0.07723581612425923
driven_lanedir_mean0.058188330992395086
driven_lanedir_median0.06511710947982641
driven_lanedir_min0.02927680249756026
in-drivable-lane_max0.24999999999999992
in-drivable-lane_mean0.15999999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.12157195489253668, "sim_physics": 0.010338783264160156, "survival_time": 0.45, "driven_lanedir": 0.02927680249756026, "sim_render-ego": 0.05281294716729058, "in-drivable-lane": 0.14999999999999997, "agent_compute-ego": 0.3758583068847656, "deviation-heading": 0.25453255654257884, "set_robot_commands": 0.07768877347310384, "deviation-center-line": 0.01026699193816584, "driven_lanedir_consec": 0.02927680249756026, "sim_compute_sim_state": 0.0338075425889757, "sim_compute_performance-ego": 0.05226781633165148, "sim_compute_robot_state-ego": 0.0535727341969808}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.168027540532255, "sim_physics": 0.011501529000022194, "survival_time": 0.5499999999999999, "driven_lanedir": 0.07723581612425923, "sim_render-ego": 0.06931109861894087, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.18247435309670187, "deviation-heading": 0.2315151336438515, "set_robot_commands": 0.07632912289012563, "deviation-center-line": 0.012519338333233931, "driven_lanedir_consec": 0.07723581612425923, "sim_compute_sim_state": 0.04004426435990767, "sim_compute_performance-ego": 0.06367046182805841, "sim_compute_robot_state-ego": 0.06312671574679288}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.17721552760965914, "sim_physics": 0.01342134042219682, "survival_time": 0.5499999999999999, "driven_lanedir": 0.06511710947982641, "sim_render-ego": 0.06352979486638849, "in-drivable-lane": 0.24999999999999992, "agent_compute-ego": 0.1782719872214577, "deviation-heading": 0.18992260558640253, "set_robot_commands": 0.07430217482826927, "deviation-center-line": 0.008492928729301748, "driven_lanedir_consec": 0.06511710947982641, "sim_compute_sim_state": 0.04168278520757502, "sim_compute_performance-ego": 0.06242429126392712, "sim_compute_robot_state-ego": 0.06439770351756703}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.13472048311807464, "sim_physics": 0.015970301628112794, "survival_time": 0.49999999999999994, "driven_lanedir": 0.04314363603598936, "sim_render-ego": 0.06535284519195557, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.1859044551849365, "deviation-heading": 0.23513504167032595, "set_robot_commands": 0.07712485790252685, "deviation-center-line": 0.010474968192446667, "driven_lanedir_consec": 0.04314363603598936, "sim_compute_sim_state": 0.04559845924377441, "sim_compute_performance-ego": 0.06569550037384034, "sim_compute_robot_state-ego": 0.0675461769104004}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14410425075043257, "sim_physics": 0.012917160987854004, "survival_time": 0.4, "driven_lanedir": 0.07616829082434018, "sim_render-ego": 0.05124622583389282, "in-drivable-lane": 0, "agent_compute-ego": 0.1984456479549408, "deviation-heading": 0.31609615727382545, "set_robot_commands": 0.08699497580528259, "deviation-center-line": 0.02149669693667203, "driven_lanedir_consec": 0.07616829082434018, "sim_compute_sim_state": 0.03094002604484558, "sim_compute_performance-ego": 0.05217623710632324, "sim_compute_robot_state-ego": 0.051021695137023926}}
set_robot_commands_max0.08699497580528259
set_robot_commands_mean0.07848798097986162
set_robot_commands_median0.07712485790252685
set_robot_commands_min0.07430217482826927
sim_compute_performance-ego_max0.06569550037384034
sim_compute_performance-ego_mean0.05924686138076011
sim_compute_performance-ego_median0.06242429126392712
sim_compute_performance-ego_min0.05217623710632324
sim_compute_robot_state-ego_max0.0675461769104004
sim_compute_robot_state-ego_mean0.059933005101753
sim_compute_robot_state-ego_median0.06312671574679288
sim_compute_robot_state-ego_min0.051021695137023926
sim_compute_sim_state_max0.04559845924377441
sim_compute_sim_state_mean0.03841461548901568
sim_compute_sim_state_median0.04004426435990767
sim_compute_sim_state_min0.03094002604484558
sim_physics_max0.015970301628112794
sim_physics_mean0.012829823060469196
sim_physics_median0.012917160987854004
sim_physics_min0.010338783264160156
sim_render-ego_max0.06931109861894087
sim_render-ego_mean0.06045058233569367
sim_render-ego_median0.06352979486638849
sim_render-ego_min0.05124622583389282
simulation-passed1
survival_time_max0.5499999999999999
survival_time_mean0.48999999999999994
survival_time_min0.4
No reset possible
176512492Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-52730:16:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7000421904280025
survival_time_median14.950000000000076
deviation-center-line_median0.4888052745656562
in-drivable-lane_median7.1500000000000385


other stats
agent_compute-ego_max0.2441649079322815
agent_compute-ego_mean0.21365359720816984
agent_compute-ego_median0.221190881729126
agent_compute-ego_min0.18268952051798504
deviation-center-line_max0.7031921062837532
deviation-center-line_mean0.36627441121743665
deviation-center-line_min0.00579754026426414
deviation-heading_max6.096931970669526
deviation-heading_mean3.217821132112307
deviation-heading_median4.148565937796967
deviation-heading_min0.1694023183492176
driven_any_max4.0995955713657075
driven_any_mean2.554339682696738
driven_any_median3.7546005333439463
driven_any_min0.13779069127086602
driven_lanedir_consec_max1.4603314949471908
driven_lanedir_consec_mean0.6455724584249227
driven_lanedir_consec_min0.038297521508193544
driven_lanedir_max1.4603314949471908
driven_lanedir_mean0.6495217368888351
driven_lanedir_median0.7000421904280025
driven_lanedir_min0.038297521508193544
in-drivable-lane_max10.350000000000062
in-drivable-lane_mean5.8400000000000345
in-drivable-lane_min0.24999999999999992
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.918965449271982, "sim_physics": 0.013040138085683188, "survival_time": 14.950000000000076, "driven_lanedir": 0.7000421904280025, "sim_render-ego": 0.06456591288248698, "in-drivable-lane": 10.350000000000062, "agent_compute-ego": 0.2441649079322815, "deviation-heading": 4.207032482727741, "set_robot_commands": 0.07550999164581298, "deviation-center-line": 0.553753709974235, "driven_lanedir_consec": 0.7000421904280025, "sim_compute_sim_state": 0.03930026133855184, "sim_compute_performance-ego": 0.06277724981307983, "sim_compute_robot_state-ego": 0.06328572750091553}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.13779069127086602, "sim_physics": 0.013369274139404298, "survival_time": 0.49999999999999994, "driven_lanedir": 0.038297521508193544, "sim_render-ego": 0.06351537704467773, "in-drivable-lane": 0.24999999999999992, "agent_compute-ego": 0.221190881729126, "deviation-heading": 0.1694023183492176, "set_robot_commands": 0.07397651672363281, "deviation-center-line": 0.00579754026426414, "driven_lanedir_consec": 0.038297521508193544, "sim_compute_sim_state": 0.043869519233703615, "sim_compute_performance-ego": 0.06131935119628906, "sim_compute_robot_state-ego": 0.06935760974884034}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.0995955713657075, "sim_physics": 0.012137959003448488, "survival_time": 14.950000000000076, "driven_lanedir": 1.4603314949471908, "sim_render-ego": 0.06473609209060668, "in-drivable-lane": 7.1500000000000385, "agent_compute-ego": 0.2320682938893636, "deviation-heading": 6.096931970669526, "set_robot_commands": 0.07755525906880696, "deviation-center-line": 0.7031921062837532, "driven_lanedir_consec": 1.4603314949471908, "sim_compute_sim_state": 0.040003526210784915, "sim_compute_performance-ego": 0.0640863839785258, "sim_compute_robot_state-ego": 0.06333584864934286}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.8607461682311877, "sim_physics": 0.015029437725360577, "survival_time": 3.2499999999999964, "driven_lanedir": 0.29895524963755893, "sim_render-ego": 0.06816695653475248, "in-drivable-lane": 1.399999999999999, "agent_compute-ego": 0.1881543819720929, "deviation-heading": 1.4671729510180878, "set_robot_commands": 0.07873611450195313, "deviation-center-line": 0.07982342499927458, "driven_lanedir_consec": 0.29895524963755893, "sim_compute_sim_state": 0.042367803133451024, "sim_compute_performance-ego": 0.06806240815382737, "sim_compute_robot_state-ego": 0.06625711000882663}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.7546005333439463, "sim_physics": 0.013255417346954346, "survival_time": 14.950000000000076, "driven_lanedir": 0.7499822279232293, "sim_render-ego": 0.07213759501775106, "in-drivable-lane": 10.050000000000075, "agent_compute-ego": 0.18268952051798504, "deviation-heading": 4.148565937796967, "set_robot_commands": 0.07963988939921061, "deviation-center-line": 0.4888052745656562, "driven_lanedir_consec": 0.730235835603668, "sim_compute_sim_state": 0.044387923876444496, "sim_compute_performance-ego": 0.07070133368174235, "sim_compute_robot_state-ego": 0.0690612498919169}}
set_robot_commands_max0.07963988939921061
set_robot_commands_mean0.0770835542678833
set_robot_commands_median0.07755525906880696
set_robot_commands_min0.07397651672363281
sim_compute_performance-ego_max0.07070133368174235
sim_compute_performance-ego_mean0.06538934536469289
sim_compute_performance-ego_median0.0640863839785258
sim_compute_performance-ego_min0.06131935119628906
sim_compute_robot_state-ego_max0.06935760974884034
sim_compute_robot_state-ego_mean0.06625950915996845
sim_compute_robot_state-ego_median0.06625711000882663
sim_compute_robot_state-ego_min0.06328572750091553
sim_compute_sim_state_max0.044387923876444496
sim_compute_sim_state_mean0.04198580675858718
sim_compute_sim_state_median0.042367803133451024
sim_compute_sim_state_min0.03930026133855184
sim_physics_max0.015029437725360577
sim_physics_mean0.013366445260170178
sim_physics_median0.013255417346954346
sim_physics_min0.012137959003448488
sim_render-ego_max0.07213759501775106
sim_render-ego_mean0.06662438671405499
sim_render-ego_median0.06473609209060668
sim_render-ego_min0.06351537704467773
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.720000000000043
survival_time_min0.49999999999999994
No reset possible
176382500Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LFVI-sim-validationstep1-simulationsuccessnoidsc-rudolf-52730:05:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.04569806947422883
survival_time_median0.5499999999999999
deviation-center-line_median0.01068117095309315
in-drivable-lane_median0.19999999999999996


other stats
agent_compute-ego_max0.19247496128082275
agent_compute-ego_mean0.1816766255861753
agent_compute-ego_median0.1781003475189209
agent_compute-ego_min0.17172039638866077
deviation-center-line_max0.016578360457573313
deviation-center-line_mean0.011370650425567234
deviation-center-line_min0.007483644744706354
deviation-heading_max0.30568795695024376
deviation-heading_mean0.2728634820764829
deviation-heading_median0.283919860882794
deviation-heading_min0.23706960458965864
driven_any_max0.19123987567068296
driven_any_mean0.15587712731540604
driven_any_median0.15003085962139673
driven_any_min0.14099825710212713
driven_lanedir_consec_max0.09316543079246475
driven_lanedir_consec_mean0.054963381210385354
driven_lanedir_consec_min0.031834110454417974
driven_lanedir_max0.09316543079246475
driven_lanedir_mean0.054963381210385354
driven_lanedir_median0.04569806947422883
driven_lanedir_min0.031834110454417974
in-drivable-lane_max0.2500000000000001
in-drivable-lane_mean0.2
in-drivable-lane_min0.09999999999999998
per-episodes
details{"udem1-0-0": {"driven_any": 0.15061915464317285, "sim_physics": 0.02307638255032626, "survival_time": 0.5499999999999999, "driven_lanedir": 0.031834110454417974, "sim_render-ego": 0.06744967807422984, "in-drivable-lane": 0.24999999999999992, "agent_compute-ego": 0.1781003475189209, "deviation-heading": 0.23706960458965864, "set_robot_commands": 0.07891030745072798, "deviation-center-line": 0.007483644744706354, "driven_lanedir_consec": 0.031834110454417974, "sim_compute_sim_state": 0.03814376484264027, "sim_compute_performance-ego": 0.06448979811234908, "sim_compute_robot_state-ego": 0.06516432762145996, "sim_compute_robot_state-npc0": 0.0738336823203347, "sim_compute_robot_state-npc1": 0.0643711740320379, "sim_compute_robot_state-npc2": 0.062225081703879616, "sim_compute_robot_state-npc3": 0.06437745961275967}, "udem1-1-0": {"driven_any": 0.19123987567068296, "sim_physics": 0.02812417915889195, "survival_time": 0.7000000000000001, "driven_lanedir": 0.09316543079246475, "sim_render-ego": 0.07595343249184745, "in-drivable-lane": 0.2500000000000001, "agent_compute-ego": 0.17659097058432444, "deviation-heading": 0.24031653232283545, "set_robot_commands": 0.07901762213025774, "deviation-center-line": 0.008657847018668103, "driven_lanedir_consec": 0.09316543079246475, "sim_compute_sim_state": 0.04025350298200335, "sim_compute_performance-ego": 0.07113119534083776, "sim_compute_robot_state-ego": 0.06701908792768206, "sim_compute_robot_state-npc0": 0.0793534517288208, "sim_compute_robot_state-npc1": 0.07311296463012695, "sim_compute_robot_state-npc2": 0.0685739346912929, "sim_compute_robot_state-npc3": 0.07061915738242013}, "udem1-2-0": {"driven_any": 0.15003085962139673, "sim_physics": 0.027988758954134853, "survival_time": 0.5499999999999999, "driven_lanedir": 0.04569806947422883, "sim_render-ego": 0.07541649991815741, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.17172039638866077, "deviation-heading": 0.283919860882794, "set_robot_commands": 0.07769339734857733, "deviation-center-line": 0.01068117095309315, "driven_lanedir_consec": 0.04569806947422883, "sim_compute_sim_state": 0.03963190859014338, "sim_compute_performance-ego": 0.07210410724986684, "sim_compute_robot_state-ego": 0.0708517378026789, "sim_compute_robot_state-npc0": 0.07484050230546431, "sim_compute_robot_state-npc1": 0.07900571823120117, "sim_compute_robot_state-npc2": 0.0769441778009588, "sim_compute_robot_state-npc3": 0.07162850553339178}, "udem1-3-0": {"driven_any": 0.14099825710212713, "sim_physics": 0.026886571537364613, "survival_time": 0.5499999999999999, "driven_lanedir": 0.03850945773321701, "sim_render-ego": 0.07768477093089711, "in-drivable-lane": 0.19999999999999996, "agent_compute-ego": 0.18949645215814764, "deviation-heading": 0.30568795695024376, "set_robot_commands": 0.0811158527027477, "deviation-center-line": 0.013452228953795244, "driven_lanedir_consec": 0.03850945773321701, "sim_compute_sim_state": 0.03911930864507502, "sim_compute_performance-ego": 0.07060261206193404, "sim_compute_robot_state-ego": 0.06698053533380682, "sim_compute_robot_state-npc0": 0.07646469636396928, "sim_compute_robot_state-npc1": 0.07195680791681464, "sim_compute_robot_state-npc2": 0.07146668434143066, "sim_compute_robot_state-npc3": 0.07197033275257457}, "udem1-4-0": {"driven_any": 0.14649748953965053, "sim_physics": 0.025358176231384276, "survival_time": 0.49999999999999994, "driven_lanedir": 0.0656098375975982, "sim_render-ego": 0.07348134517669677, "in-drivable-lane": 0.09999999999999998, "agent_compute-ego": 0.19247496128082275, "deviation-heading": 0.2973234556368826, "set_robot_commands": 0.08105905055999756, "deviation-center-line": 0.016578360457573313, "driven_lanedir_consec": 0.0656098375975982, "sim_compute_sim_state": 0.03773386478424072, "sim_compute_performance-ego": 0.0755922794342041, "sim_compute_robot_state-ego": 0.06808066368103027, "sim_compute_robot_state-npc0": 0.07854638099670411, "sim_compute_robot_state-npc1": 0.07551732063293456, "sim_compute_robot_state-npc2": 0.079268479347229, "sim_compute_robot_state-npc3": 0.07347867488861085}}
set_robot_commands_max0.0811158527027477
set_robot_commands_mean0.07955924603846166
set_robot_commands_median0.07901762213025774
set_robot_commands_min0.07769339734857733
sim_compute_performance-ego_max0.0755922794342041
sim_compute_performance-ego_mean0.07078399843983836
sim_compute_performance-ego_median0.07113119534083776
sim_compute_performance-ego_min0.06448979811234908
sim_compute_robot_state-ego_max0.0708517378026789
sim_compute_robot_state-ego_mean0.0676192704733316
sim_compute_robot_state-ego_median0.06701908792768206
sim_compute_robot_state-ego_min0.06516432762145996
sim_compute_robot_state-npc0_max0.0793534517288208
sim_compute_robot_state-npc0_mean0.07660774274305863
sim_compute_robot_state-npc0_median0.07646469636396928
sim_compute_robot_state-npc0_min0.0738336823203347
sim_compute_robot_state-npc1_max0.07900571823120117
sim_compute_robot_state-npc1_mean0.07279279708862305
sim_compute_robot_state-npc1_median0.07311296463012695
sim_compute_robot_state-npc1_min0.0643711740320379
sim_compute_robot_state-npc2_max0.079268479347229
sim_compute_robot_state-npc2_mean0.07169567157695819
sim_compute_robot_state-npc2_median0.07146668434143066
sim_compute_robot_state-npc2_min0.062225081703879616
sim_compute_robot_state-npc3_max0.07347867488861085
sim_compute_robot_state-npc3_mean0.0704148260339514
sim_compute_robot_state-npc3_median0.07162850553339178
sim_compute_robot_state-npc3_min0.06437745961275967
sim_compute_sim_state_max0.04025350298200335
sim_compute_sim_state_mean0.03897646996882055
sim_compute_sim_state_median0.03911930864507502
sim_compute_sim_state_min0.03773386478424072
sim_physics_max0.02812417915889195
sim_physics_mean0.026286813686420392
sim_physics_median0.026886571537364613
sim_physics_min0.02307638255032626
sim_render-ego_max0.07768477093089711
sim_render-ego_mean0.07399714531836572
sim_render-ego_median0.07541649991815741
sim_render-ego_min0.06744967807422984
simulation-passed1
survival_time_max0.7000000000000001
survival_time_mean0.57
survival_time_min0.49999999999999994
No reset possible
176332452Liam Paull 🇨🇦Baseline solution using ROSaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-52730:09:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0881755056478766
survival_time_median3.7999999999999945
deviation-center-line_median0.2779415290885845
in-drivable-lane_median0.05000000000000071


other stats
agent_compute-ego_max0.15604773545876527
agent_compute-ego_mean0.14697241923757667
agent_compute-ego_median0.1462540019642223
agent_compute-ego_min0.1420262236344187
deviation-center-line_max0.8839409636129564
deviation-center-line_mean0.4319276957638902
deviation-center-line_min0.13035042950886708
deviation-heading_max2.690730926883028
deviation-heading_mean1.3621765987123102
deviation-heading_median0.9224219828674391
deviation-heading_min0.436035615130682
driven_any_max3.179154596489252
driven_any_mean1.727839162692516
driven_any_median1.2205912674451602
driven_any_min0.6100624357706335
driven_lanedir_consec_max2.9308757856267937
driven_lanedir_consec_mean1.5984458560134294
driven_lanedir_consec_min0.5137608136767255
driven_lanedir_max2.9308757856267937
driven_lanedir_mean1.5984458560134294
driven_lanedir_median1.0881755056478766
driven_lanedir_min0.5137608136767255
in-drivable-lane_max0.20000000000000015
in-drivable-lane_mean0.08000000000000007
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6100624357706335, "sim_physics": 0.012331259556305714, "survival_time": 1.950000000000001, "driven_lanedir": 0.5137608136767255, "sim_render-ego": 0.060730585685143106, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.15604773545876527, "deviation-heading": 0.436035615130682, "set_robot_commands": 0.07623693881890713, "deviation-center-line": 0.13035042950886708, "driven_lanedir_consec": 0.5137608136767255, "sim_compute_sim_state": 0.03678747323843149, "sim_compute_performance-ego": 0.062007543368217274, "sim_compute_robot_state-ego": 0.06122318903605143}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.745813280728231, "sim_physics": 0.012874307688216718, "survival_time": 8.549999999999986, "driven_lanedir": 2.5920574285273097, "sim_render-ego": 0.059759275257936, "in-drivable-lane": 0, "agent_compute-ego": 0.1427007167660005, "deviation-heading": 2.299601904732192, "set_robot_commands": 0.07996385139331483, "deviation-center-line": 0.6096877020853836, "driven_lanedir_consec": 2.5920574285273097, "sim_compute_sim_state": 0.038625382540518775, "sim_compute_performance-ego": 0.06158603004544799, "sim_compute_robot_state-ego": 0.06263802483765005}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.179154596489252, "sim_physics": 0.012470929309575244, "survival_time": 9.900000000000006, "driven_lanedir": 2.9308757856267937, "sim_render-ego": 0.06201332626920758, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.1478334183644767, "deviation-heading": 2.690730926883028, "set_robot_commands": 0.07933466723470976, "deviation-center-line": 0.8839409636129564, "driven_lanedir_consec": 2.9308757856267937, "sim_compute_sim_state": 0.037746093489907005, "sim_compute_performance-ego": 0.062325797899804934, "sim_compute_robot_state-ego": 0.06304371116137264}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.8835742330293035, "sim_physics": 0.013186415758999911, "survival_time": 2.7499999999999982, "driven_lanedir": 0.8673597465884404, "sim_render-ego": 0.061252750049937854, "in-drivable-lane": 0, "agent_compute-ego": 0.1462540019642223, "deviation-heading": 0.46209256394821, "set_robot_commands": 0.079022047736428, "deviation-center-line": 0.25771785452365953, "driven_lanedir_consec": 0.8673597465884404, "sim_compute_sim_state": 0.038231338154185904, "sim_compute_performance-ego": 0.06177995855158026, "sim_compute_robot_state-ego": 0.06377911134199662}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2205912674451602, "sim_physics": 0.013520855652658564, "survival_time": 3.7999999999999945, "driven_lanedir": 1.0881755056478766, "sim_render-ego": 0.060242759554009685, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.1420262236344187, "deviation-heading": 0.9224219828674391, "set_robot_commands": 0.08030618491925691, "deviation-center-line": 0.2779415290885845, "driven_lanedir_consec": 1.0881755056478766, "sim_compute_sim_state": 0.03666764811465615, "sim_compute_performance-ego": 0.06158632981149774, "sim_compute_robot_state-ego": 0.06153532705808941}}
set_robot_commands_max0.08030618491925691
set_robot_commands_mean0.07897273802052332
set_robot_commands_median0.07933466723470976
set_robot_commands_min0.07623693881890713
sim_compute_performance-ego_max0.062325797899804934
sim_compute_performance-ego_mean0.06185713193530964
sim_compute_performance-ego_median0.06177995855158026
sim_compute_performance-ego_min0.06158603004544799
sim_compute_robot_state-ego_max0.06377911134199662
sim_compute_robot_state-ego_mean0.06244387268703202
sim_compute_robot_state-ego_median0.06263802483765005
sim_compute_robot_state-ego_min0.06122318903605143
sim_compute_sim_state_max0.038625382540518775
sim_compute_sim_state_mean0.03761158710753986
sim_compute_sim_state_median0.037746093489907005
sim_compute_sim_state_min0.03666764811465615
sim_physics_max0.013520855652658564
sim_physics_mean0.01287675359315123
sim_physics_median0.012874307688216718
sim_physics_min0.012331259556305714
sim_render-ego_max0.06201332626920758
sim_render-ego_mean0.060799739363246855
sim_render-ego_median0.060730585685143106
sim_render-ego_min0.059759275257936
simulation-passed1
survival_time_max9.900000000000006
survival_time_mean5.389999999999997
survival_time_min1.950000000000001
No reset possible
176302446Nicky EichmannBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationerrornoidsc-rudolf-52730:21:09
Waited 1202 seconds [...]
Waited 1202 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible