AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 1212

evaluator1212
ownerI don't have one 😀
machineip-172-31-38-104
processip-172-31-38-104-2553
versiond-c:4.0.30;d-c-r:4.0.44;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success14
# timeout
# failed3
# error16
# aborted
# host-error1
arm0
x86_641
Mac0
gpu available1
Number of processors4
Processor frequency (MHz)2.9 GHz
Free % of processors90%
RAM total (MB)60.0 GB
RAM free (MB)55.9 GB
Disk (MB)96.9 GB
Disk available (MB)51.5 GB
Docker Hub
P11
P2
PI Camera0
# Duckiebots0
Map 3x3 avaiable
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
230773557AmaurXRunning the real lane following -- without challenge containeraido2-LFVI-sim-validationstep1-simulationerroryes12120:06:28
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
230242373Liam Paullminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationerroryes12120:36:03
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
230152383Andrea CensiBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationsuccessyes12120:11:08(hidden)
driven_lanedir_consec_median0.10428059192253292
survival_time_median1.2500000000000004
deviation-center-line_median0.07936613466003808
in-drivable-lane_median0


other stats
agent_compute-ego_max0.2084336280822754
agent_compute-ego_mean0.17403381717035848
agent_compute-ego_median0.17540610920299182
agent_compute-ego_min0.14380937576293945
deviation-center-line_max0.10272703984964908
deviation-center-line_mean0.0792710389609472
deviation-center-line_min0.05372540869577151
deviation-heading_max0.983790537404761
deviation-heading_mean0.6994363325894107
deviation-heading_median0.6989035152482008
deviation-heading_min0.4016956275046296
driven_any_max0.20010989224548495
driven_any_mean0.16588125117382843
driven_any_median0.17265714657329273
driven_any_min0.1171955527663396
driven_lanedir_consec_max0.14940053167912604
driven_lanedir_consec_mean0.10933807262861252
driven_lanedir_consec_min0.08839989225246858
driven_lanedir_max0.14940053167912604
driven_lanedir_mean0.10933807262861252
driven_lanedir_median0.10428059192253292
driven_lanedir_min0.08839989225246858
in-drivable-lane_max0.20000000000000015
in-drivable-lane_mean0.03333333333333336
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.20010989224548495, "sim_physics": 0.1213270902633667, "survival_time": 1.5000000000000009, "driven_lanedir": 0.10285229315714116, "sim_render-ego": 0.06052885055541992, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.16552804311116537, "deviation-heading": 0.9140550333307552, "set_robot_commands": 0.08969301382700602, "deviation-center-line": 0.08168360296955735, "driven_lanedir_consec": 0.10285229315714116, "sim_compute_sim_state": 0.03798608779907227, "sim_compute_performance-ego": 0.06797352631886801, "sim_compute_robot_state-ego": 0.07578190167744954}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.18107806636163273, "sim_physics": 0.11607463019234794, "survival_time": 1.4000000000000006, "driven_lanedir": 0.12043800905791736, "sim_render-ego": 0.06863565955843244, "in-drivable-lane": 0, "agent_compute-ego": 0.1982824206352234, "deviation-heading": 0.7712487918448322, "set_robot_commands": 0.10303521156311037, "deviation-center-line": 0.059131317015691534, "driven_lanedir_consec": 0.12043800905791736, "sim_compute_sim_state": 0.038783175604684014, "sim_compute_performance-ego": 0.07451236248016357, "sim_compute_robot_state-ego": 0.08344787359237671}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.13184971417811384, "sim_physics": 0.1254598617553711, "survival_time": 1.0000000000000002, "driven_lanedir": 0.09895993350908672, "sim_render-ego": 0.06232643127441406, "in-drivable-lane": 0, "agent_compute-ego": 0.17477222681045532, "deviation-heading": 0.531740237614201, "set_robot_commands": 0.09790593385696413, "deviation-center-line": 0.0940141159731376, "driven_lanedir_consec": 0.09895993350908672, "sim_compute_sim_state": 0.038166260719299315, "sim_compute_performance-ego": 0.0676892876625061, "sim_compute_robot_state-ego": 0.07170462608337402}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1812404310541112, "sim_physics": 0.12357416519751915, "survival_time": 1.3000000000000005, "driven_lanedir": 0.09809484417718028, "sim_render-ego": 0.06446795280163105, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16133971397693342, "deviation-heading": 0.965703276389937, "set_robot_commands": 0.09112234298999491, "deviation-center-line": 0.07334630883709879, "driven_lanedir_consec": 0.09809484417718028, "sim_compute_sim_state": 0.04019729907696064, "sim_compute_performance-ego": 0.06565613013047439, "sim_compute_robot_state-ego": 0.07225200763115516}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1925477082987218, "sim_physics": 0.1280030647913615, "survival_time": 1.5000000000000009, "driven_lanedir": 0.1013348986127922, "sim_render-ego": 0.06170070966084798, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.176191242535909, "deviation-heading": 0.7701779526212525, "set_robot_commands": 0.09572083155314128, "deviation-center-line": 0.05372540869577151, "driven_lanedir_consec": 0.1013348986127922, "sim_compute_sim_state": 0.037685585021972653, "sim_compute_performance-ego": 0.06886503696441651, "sim_compute_robot_state-ego": 0.0765953779220581}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.18823857404839703, "sim_physics": 0.1221635525043194, "survival_time": 1.3000000000000005, "driven_lanedir": 0.09477198322773184, "sim_render-ego": 0.05697897764352652, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1575079972927387, "deviation-heading": 0.983790537404761, "set_robot_commands": 0.08843066142155574, "deviation-center-line": 0.07936613466003808, "driven_lanedir_consec": 0.09477198322773184, "sim_compute_sim_state": 0.037076170627887435, "sim_compute_performance-ego": 0.06435611614814171, "sim_compute_robot_state-ego": 0.0692282456618089}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.18850139133140711, "sim_physics": 0.11551053183419364, "survival_time": 1.4000000000000006, "driven_lanedir": 0.14940053167912604, "sim_render-ego": 0.06412480558667864, "in-drivable-lane": 0, "agent_compute-ego": 0.18608662060328893, "deviation-heading": 0.6133669738911504, "set_robot_commands": 0.09424963167735508, "deviation-center-line": 0.09392024924656872, "driven_lanedir_consec": 0.14940053167912604, "sim_compute_sim_state": 0.043315589427948, "sim_compute_performance-ego": 0.06994354724884033, "sim_compute_robot_state-ego": 0.07387912273406982}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.13922272595685353, "sim_physics": 0.09016345796130952, "survival_time": 1.0500000000000005, "driven_lanedir": 0.10805874158674732, "sim_render-ego": 0.05619093350001744, "in-drivable-lane": 0, "agent_compute-ego": 0.1497732457660493, "deviation-heading": 0.5385473244988048, "set_robot_commands": 0.08005879038856142, "deviation-center-line": 0.09639142741423322, "driven_lanedir_consec": 0.10805874158674732, "sim_compute_sim_state": 0.0380602791195824, "sim_compute_performance-ego": 0.05934420086088635, "sim_compute_robot_state-ego": 0.07919289952232725}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.1634866702962657, "sim_physics": 0.1176256275177002, "survival_time": 1.2500000000000004, "driven_lanedir": 0.10428059192253292, "sim_render-ego": 0.05840845108032226, "in-drivable-lane": 0, "agent_compute-ego": 0.14380937576293945, "deviation-heading": 0.7774702391892943, "set_robot_commands": 0.0866249942779541, "deviation-center-line": 0.05921288522601169, "driven_lanedir_consec": 0.10428059192253292, "sim_compute_sim_state": 0.03625892639160156, "sim_compute_performance-ego": 0.06280597686767578, "sim_compute_robot_state-ego": 0.06793434143066407}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.17265714657329273, "sim_physics": 0.140498046875, "survival_time": 1.2500000000000004, "driven_lanedir": 0.13978711509620378, "sim_render-ego": 0.06597917556762695, "in-drivable-lane": 0, "agent_compute-ego": 0.1915570068359375, "deviation-heading": 0.5317335369151952, "set_robot_commands": 0.10791648864746094, "deviation-center-line": 0.08949622033015553, "driven_lanedir_consec": 0.13978711509620378, "sim_compute_sim_state": 0.04253448486328125, "sim_compute_performance-ego": 0.07227548599243164, "sim_compute_robot_state-ego": 0.0877345085144043}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.1221312044915672, "sim_physics": 0.13069139827381482, "survival_time": 1.1000000000000003, "driven_lanedir": 0.08839989225246858, "sim_render-ego": 0.06570257923819801, "in-drivable-lane": 0, "agent_compute-ego": 0.17540610920299182, "deviation-heading": 0.4938467230351188, "set_robot_commands": 0.10857991738752884, "deviation-center-line": 0.09589338449845664, "driven_lanedir_consec": 0.08839989225246858, "sim_compute_sim_state": 0.03962951356714422, "sim_compute_performance-ego": 0.06452368606220592, "sim_compute_robot_state-ego": 0.0752433104948564}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.14536883052622163, "sim_physics": 0.1329802533854609, "survival_time": 1.1500000000000004, "driven_lanedir": 0.1072577868586363, "sim_render-ego": 0.06298124271890392, "in-drivable-lane": 0, "agent_compute-ego": 0.1679181016009787, "deviation-heading": 0.614485932546386, "set_robot_commands": 0.1005407830943232, "deviation-center-line": 0.07445796346870431, "driven_lanedir_consec": 0.1072577868586363, "sim_compute_sim_state": 0.042998738910840904, "sim_compute_performance-ego": 0.06821710130442744, "sim_compute_robot_state-ego": 0.0723615314649499}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.19241161419966885, "sim_physics": 0.13629868112761398, "survival_time": 1.4500000000000006, "driven_lanedir": 0.11012864520571564, "sim_render-ego": 0.0720277161433779, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.2084336280822754, "deviation-heading": 0.884779286806642, "set_robot_commands": 0.11107226897930277, "deviation-center-line": 0.07386237622438972, "driven_lanedir_consec": 0.11012864520571564, "sim_compute_sim_state": 0.04149693456189386, "sim_compute_performance-ego": 0.07879477533800848, "sim_compute_robot_state-ego": 0.09638748497798524}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.17217924527934886, "sim_physics": 0.1257315774758657, "survival_time": 1.2000000000000004, "driven_lanedir": 0.12338416081967508, "sim_render-ego": 0.06523178021113078, "in-drivable-lane": 0, "agent_compute-ego": 0.17765655120213827, "deviation-heading": 0.6989035152482008, "set_robot_commands": 0.10077303647994997, "deviation-center-line": 0.06183715000474417, "driven_lanedir_consec": 0.12338416081967508, "sim_compute_sim_state": 0.03932098547617594, "sim_compute_performance-ego": 0.07522523403167725, "sim_compute_robot_state-ego": 0.07768439253171285}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.1171955527663396, "sim_physics": 0.11690206754775274, "survival_time": 1.0500000000000005, "driven_lanedir": 0.092921662266233, "sim_render-ego": 0.06224464234851655, "in-drivable-lane": 0, "agent_compute-ego": 0.17624497413635254, "deviation-heading": 0.4016956275046296, "set_robot_commands": 0.10098350615728469, "deviation-center-line": 0.10272703984964908, "driven_lanedir_consec": 0.092921662266233, "sim_compute_sim_state": 0.043930610020955406, "sim_compute_performance-ego": 0.06546643802097865, "sim_compute_robot_state-ego": 0.13983358655657088}}
set_robot_commands_max0.11107226897930277
set_robot_commands_mean0.09711382748676624
set_robot_commands_median0.09790593385696413
set_robot_commands_min0.08005879038856142
sim_compute_performance-ego_max0.07879477533800848
sim_compute_performance-ego_mean0.06837659369544681
sim_compute_performance-ego_median0.06797352631886801
sim_compute_performance-ego_min0.05934420086088635
sim_compute_robot_state-ego_max0.13983358655657088
sim_compute_robot_state-ego_mean0.08128408071971756
sim_compute_robot_state-ego_median0.07578190167744954
sim_compute_robot_state-ego_min0.06793434143066407
sim_compute_sim_state_max0.043930610020955406
sim_compute_sim_state_mean0.03982937607928665
sim_compute_sim_state_median0.03932098547617594
sim_compute_sim_state_min0.03625892639160156
sim_physics_max0.140498046875
sim_physics_mean0.1228669337801998
sim_physics_median0.12357416519751915
sim_physics_min0.09016345796130952
sim_render-ego_max0.0720277161433779
sim_render-ego_mean0.0631686605259363
sim_render-ego_median0.06298124271890392
sim_render-ego_min0.05619093350001744
simulation-passed1
survival_time_max1.5000000000000009
survival_time_mean1.2600000000000002
survival_time_min1.0000000000000002
230002402vguerraBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationsuccessyes12120:12:11(hidden)
driven_lanedir_consec_median0.07384245539307666
survival_time_median1.2500000000000004
deviation-center-line_median0.06129629209937979
in-drivable-lane_median0.10000000000000007


other stats
agent_compute-ego_max0.21473743604577103
agent_compute-ego_mean0.17403849545673902
agent_compute-ego_median0.17396066405556418
agent_compute-ego_min0.14278680086135864
deviation-center-line_max0.10463452649389111
deviation-center-line_mean0.06631176724701839
deviation-center-line_min0.02899641206291264
deviation-heading_max0.8421154151785527
deviation-heading_mean0.6651653308514553
deviation-heading_median0.6516655724600262
deviation-heading_min0.43800008900597226
driven_any_max0.20933027334969964
driven_any_mean0.15402345072704293
driven_any_median0.140177465042392
driven_any_min0.11001307896499384
driven_lanedir_consec_max0.10558253794669704
driven_lanedir_consec_mean0.07636009981704275
driven_lanedir_consec_min0.06208407563927665
driven_lanedir_max0.10558253794669704
driven_lanedir_mean0.07636009981704275
driven_lanedir_median0.07384245539307666
driven_lanedir_min0.06208407563927665
in-drivable-lane_max0.7000000000000006
in-drivable-lane_mean0.23666666666666689
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.20933027334969964, "sim_physics": 0.13321546827043806, "survival_time": 1.7500000000000009, "driven_lanedir": 0.0656903175899064, "sim_render-ego": 0.06772597857883998, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.1839298725128174, "deviation-heading": 0.7113627300300794, "set_robot_commands": 0.10345631326947892, "deviation-center-line": 0.06129629209937979, "driven_lanedir_consec": 0.0656903175899064, "sim_compute_sim_state": 0.042230081558227536, "sim_compute_performance-ego": 0.0728480202811105, "sim_compute_robot_state-ego": 0.08382556097848075}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1836751411645134, "sim_physics": 0.11917195175633286, "survival_time": 1.6500000000000008, "driven_lanedir": 0.07012978252520352, "sim_render-ego": 0.06432937853264087, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.17832115924719608, "deviation-heading": 0.6133815271377522, "set_robot_commands": 0.09649127902406636, "deviation-center-line": 0.02899641206291264, "driven_lanedir_consec": 0.07012978252520352, "sim_compute_sim_state": 0.04093242414069898, "sim_compute_performance-ego": 0.0710708372520678, "sim_compute_robot_state-ego": 0.080594489068696}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.11001307896499384, "sim_physics": 0.11718635559082032, "survival_time": 1.0000000000000002, "driven_lanedir": 0.07326677982026553, "sim_render-ego": 0.0629226803779602, "in-drivable-lane": 0, "agent_compute-ego": 0.17000824213027954, "deviation-heading": 0.593150384274204, "set_robot_commands": 0.09721889495849607, "deviation-center-line": 0.09034092845987364, "driven_lanedir_consec": 0.07326677982026553, "sim_compute_sim_state": 0.04045249223709106, "sim_compute_performance-ego": 0.07060298919677735, "sim_compute_robot_state-ego": 0.07143460512161255}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19918706130799696, "sim_physics": 0.124966202360211, "survival_time": 1.6500000000000008, "driven_lanedir": 0.07406890404771538, "sim_render-ego": 0.06533323634754527, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.17396066405556418, "deviation-heading": 0.8365736883208287, "set_robot_commands": 0.09572404803651752, "deviation-center-line": 0.05025707064245247, "driven_lanedir_consec": 0.07406890404771538, "sim_compute_sim_state": 0.039091247500795304, "sim_compute_performance-ego": 0.06820206931143095, "sim_compute_robot_state-ego": 0.07652029124173251}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.17895382527015097, "sim_physics": 0.10891495810614692, "survival_time": 1.800000000000001, "driven_lanedir": 0.06208407563927665, "sim_render-ego": 0.0586788190735711, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.1577324801021152, "deviation-heading": 0.6013700121647094, "set_robot_commands": 0.08959182765748766, "deviation-center-line": 0.033361912152579366, "driven_lanedir_consec": 0.06208407563927665, "sim_compute_sim_state": 0.03532114956114027, "sim_compute_performance-ego": 0.06516983111699422, "sim_compute_robot_state-ego": 0.06754748026529948}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.2079586789460103, "sim_physics": 0.1248425543308258, "survival_time": 1.6000000000000008, "driven_lanedir": 0.07066389004287732, "sim_render-ego": 0.06271616369485855, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.17941241711378098, "deviation-heading": 0.8421154151785527, "set_robot_commands": 0.09629464149475098, "deviation-center-line": 0.05855086020867172, "driven_lanedir_consec": 0.07066389004287732, "sim_compute_sim_state": 0.039028242230415344, "sim_compute_performance-ego": 0.07172425836324692, "sim_compute_robot_state-ego": 0.08450758457183838}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.140177465042392, "sim_physics": 0.1230799961090088, "survival_time": 1.2500000000000004, "driven_lanedir": 0.10558253794669704, "sim_render-ego": 0.06282269477844238, "in-drivable-lane": 0, "agent_compute-ego": 0.16885199546813964, "deviation-heading": 0.6107285462056107, "set_robot_commands": 0.09278315544128418, "deviation-center-line": 0.09201336979199956, "driven_lanedir_consec": 0.10558253794669704, "sim_compute_sim_state": 0.040288867950439455, "sim_compute_performance-ego": 0.07127076148986816, "sim_compute_robot_state-ego": 0.0857319164276123}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.12263577080685471, "sim_physics": 0.10157159566879272, "survival_time": 1.0000000000000002, "driven_lanedir": 0.08793450037576012, "sim_render-ego": 0.06342839002609253, "in-drivable-lane": 0, "agent_compute-ego": 0.15928304195404053, "deviation-heading": 0.5594777005777292, "set_robot_commands": 0.09211653470993042, "deviation-center-line": 0.08889676352749161, "driven_lanedir_consec": 0.08793450037576012, "sim_compute_sim_state": 0.03716362714767456, "sim_compute_performance-ego": 0.06515786647796631, "sim_compute_robot_state-ego": 0.07421598434448243}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.13836945619654736, "sim_physics": 0.0986503263314565, "survival_time": 1.2000000000000004, "driven_lanedir": 0.07464022856388075, "sim_render-ego": 0.05200392007827759, "in-drivable-lane": 0, "agent_compute-ego": 0.14278680086135864, "deviation-heading": 0.8211368328934245, "set_robot_commands": 0.08161914348602295, "deviation-center-line": 0.05403791885042908, "driven_lanedir_consec": 0.07464022856388075, "sim_compute_sim_state": 0.033071041107177734, "sim_compute_performance-ego": 0.056772579749425255, "sim_compute_robot_state-ego": 0.06229841709136963}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.12557273984910214, "sim_physics": 0.15592581292857294, "survival_time": 1.1500000000000004, "driven_lanedir": 0.07744915322449808, "sim_render-ego": 0.06751986171888269, "in-drivable-lane": 0, "agent_compute-ego": 0.21473743604577103, "deviation-heading": 0.6516655724600262, "set_robot_commands": 0.11061701567276663, "deviation-center-line": 0.08051928829336927, "driven_lanedir_consec": 0.07744915322449808, "sim_compute_sim_state": 0.039433406746905784, "sim_compute_performance-ego": 0.07069663379503333, "sim_compute_robot_state-ego": 0.09304376270460046}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.1174625666632272, "sim_physics": 0.12574004043232312, "survival_time": 1.1000000000000003, "driven_lanedir": 0.08587516092241176, "sim_render-ego": 0.06334490125829523, "in-drivable-lane": 0, "agent_compute-ego": 0.17636982961134476, "deviation-heading": 0.512956857957348, "set_robot_commands": 0.09638529474085028, "deviation-center-line": 0.09571401954632656, "driven_lanedir_consec": 0.08587516092241176, "sim_compute_sim_state": 0.03776762702248313, "sim_compute_performance-ego": 0.08299802650104869, "sim_compute_robot_state-ego": 0.08091053095730869}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.13095550729922498, "sim_physics": 0.14112178802490236, "survival_time": 1.2500000000000004, "driven_lanedir": 0.07384245539307666, "sim_render-ego": 0.0651930046081543, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.1876980781555176, "deviation-heading": 0.7175110092196466, "set_robot_commands": 0.10604693412780762, "deviation-center-line": 0.06717329332760248, "driven_lanedir_consec": 0.07384245539307666, "sim_compute_sim_state": 0.04110137939453125, "sim_compute_performance-ego": 0.07628146171569825, "sim_compute_robot_state-ego": 0.08425658226013183}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.1938183102535504, "sim_physics": 0.11268091201782228, "survival_time": 1.7000000000000008, "driven_lanedir": 0.06982655427380668, "sim_render-ego": 0.06122004284578211, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.16698809932259953, "deviation-heading": 0.6680181287359052, "set_robot_commands": 0.09298755842096663, "deviation-center-line": 0.04265143483271798, "driven_lanedir_consec": 0.06982655427380668, "sim_compute_sim_state": 0.038813450757194966, "sim_compute_performance-ego": 0.07103823914247401, "sim_compute_robot_state-ego": 0.0762264798669254}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.14170526005938627, "sim_physics": 0.12602609634399414, "survival_time": 1.2500000000000004, "driven_lanedir": 0.06925645603926789, "sim_render-ego": 0.0637918758392334, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.17721717834472656, "deviation-heading": 0.8000314686100403, "set_robot_commands": 0.1010504150390625, "deviation-center-line": 0.046232418415578576, "driven_lanedir_consec": 0.06925645603926789, "sim_compute_sim_state": 0.04268485069274902, "sim_compute_performance-ego": 0.07204590797424316, "sim_compute_robot_state-ego": 0.08372940063476562}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.1105366257319934, "sim_physics": 0.11853709675016856, "survival_time": 1.0500000000000005, "driven_lanedir": 0.08509070085099735, "sim_render-ego": 0.06033188956124442, "in-drivable-lane": 0, "agent_compute-ego": 0.17328013692583358, "deviation-heading": 0.43800008900597226, "set_robot_commands": 0.09574048859732492, "deviation-center-line": 0.10463452649389111, "driven_lanedir_consec": 0.08509070085099735, "sim_compute_sim_state": 0.0419075261978876, "sim_compute_performance-ego": 0.06914990288870675, "sim_compute_robot_state-ego": 0.07323111806597028}}
set_robot_commands_max0.11061701567276663
set_robot_commands_mean0.09654156964512092
set_robot_commands_median0.09629464149475098
set_robot_commands_min0.08161914348602295
sim_compute_performance-ego_max0.08299802650104869
sim_compute_performance-ego_mean0.07033529235040611
sim_compute_performance-ego_median0.07103823914247401
sim_compute_performance-ego_min0.056772579749425255
sim_compute_robot_state-ego_max0.09304376270460046
sim_compute_robot_state-ego_mean0.07853828024005509
sim_compute_robot_state-ego_median0.080594489068696
sim_compute_robot_state-ego_min0.06229841709136963
sim_compute_sim_state_max0.04268485069274902
sim_compute_sim_state_mean0.039285827616360805
sim_compute_sim_state_median0.039433406746905784
sim_compute_sim_state_min0.033071041107177734
sim_physics_max0.15592581292857294
sim_physics_mean0.1221087436681211
sim_physics_median0.1230799961090088
sim_physics_min0.0986503263314565
sim_render-ego_max0.06772597857883998
sim_render-ego_mean0.06275752248798804
sim_render-ego_median0.06334490125829523
sim_render-ego_min0.05200392007827759
simulation-passed1
survival_time_max1.800000000000001
survival_time_mean1.3600000000000003
survival_time_min1.0000000000000002
229962441Jacopo Tanirandom_agentaido2-LFV-sim-testingstep1-simulationerroryes12120:07:37
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
229672449enickyBaseline solution using reinforcement learningaido2-LFV-sim-validationstep1-simulationsuccessyes12120:37:02(hidden)
driven_lanedir_consec_median-1.339793520141566
survival_time_median14.950000000000076
deviation-center-line_median1.002134440312669
in-drivable-lane_median4.050000000000024


other stats
agent_compute-ego_max0.17760818878809612
agent_compute-ego_mean0.16918409411112467
agent_compute-ego_median0.17543508927027385
agent_compute-ego_min0.1554436500867208
deviation-center-line_max1.5296442653166566
deviation-center-line_mean0.925371790854924
deviation-center-line_min0.28261955257418875
deviation-heading_max8.558153948461722
deviation-heading_mean7.098260242116498
deviation-heading_median7.090641611385013
deviation-heading_min5.695926383403844
driven_any_max4.378506444052824
driven_any_mean4.378506444052815
driven_any_median4.378506444052811
driven_any_min4.378506444052806
driven_lanedir_consec_max-1.2728379671211965
driven_lanedir_consec_mean-1.3313530019797526
driven_lanedir_consec_min-1.3670015115194478
driven_lanedir_max-1.3662544443440128
driven_lanedir_mean-2.078199826147362
driven_lanedir_median-2.260637650975249
driven_lanedir_min-2.7107548643537447
in-drivable-lane_max7.400000000000039
in-drivable-lane_mean4.620000000000026
in-drivable-lane_min2.150000000000011
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378506444052806, "sim_physics": 0.15930531660715738, "survival_time": 14.950000000000076, "driven_lanedir": -2.7107548643537447, "sim_render-ego": 0.0561204727490743, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.1554436500867208, "deviation-heading": 8.372894374860635, "set_robot_commands": 0.08831639687220255, "deviation-center-line": 1.5195321274570266, "driven_lanedir_consec": -1.3108775667725403, "sim_compute_sim_state": 0.036106116771698, "sim_compute_performance-ego": 0.06124304215113322, "sim_compute_robot_state-ego": 0.06772487799326579, "sim_compute_robot_state-npc0": 0.06329822937647502, "sim_compute_robot_state-npc1": 0.06375563144683838, "sim_compute_robot_state-npc2": 0.06250531435012817, "sim_compute_robot_state-npc3": 0.06361708323160807}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378506444052822, "sim_physics": 0.17631556351979574, "survival_time": 14.950000000000076, "driven_lanedir": -2.686350659544358, "sim_render-ego": 0.06452457745869955, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.17760818878809612, "deviation-heading": 8.558153948461722, "set_robot_commands": 0.10279776811599732, "deviation-center-line": 1.5296442653166566, "driven_lanedir_consec": -1.2728379671211965, "sim_compute_sim_state": 0.04044605493545532, "sim_compute_performance-ego": 0.07125105698903401, "sim_compute_robot_state-ego": 0.07680485963821411, "sim_compute_robot_state-npc0": 0.07230649868647257, "sim_compute_robot_state-npc1": 0.06985526402791341, "sim_compute_robot_state-npc2": 0.07138206720352173, "sim_compute_robot_state-npc3": 0.07116465012232463}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.378506444052811, "sim_physics": 0.15075119654337563, "survival_time": 14.950000000000076, "driven_lanedir": -1.3662544443440128, "sim_render-ego": 0.05544922351837158, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.16020708163579306, "deviation-heading": 5.773684892471282, "set_robot_commands": 0.08860307296117147, "deviation-center-line": 0.2929285686140787, "driven_lanedir_consec": -1.3662544443440128, "sim_compute_sim_state": 0.03490424950917562, "sim_compute_performance-ego": 0.06210956494013469, "sim_compute_robot_state-ego": 0.06950921138127644, "sim_compute_robot_state-npc0": 0.06372496922810872, "sim_compute_robot_state-npc1": 0.06258289337158203, "sim_compute_robot_state-npc2": 0.0655500070254008, "sim_compute_robot_state-npc3": 0.06291889031728108}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378506444052824, "sim_physics": 0.18114449739456176, "survival_time": 14.950000000000076, "driven_lanedir": -1.3670015115194478, "sim_render-ego": 0.06426085392634073, "in-drivable-lane": 7.400000000000039, "agent_compute-ego": 0.17722646077473958, "deviation-heading": 5.695926383403844, "set_robot_commands": 0.0997756584485372, "deviation-center-line": 0.28261955257418875, "driven_lanedir_consec": -1.3670015115194478, "sim_compute_sim_state": 0.04081124782562256, "sim_compute_performance-ego": 0.07019739548365275, "sim_compute_robot_state-ego": 0.07941562493642171, "sim_compute_robot_state-npc0": 0.07113632520039877, "sim_compute_robot_state-npc1": 0.07129664182662963, "sim_compute_robot_state-npc2": 0.07059564749399821, "sim_compute_robot_state-npc3": 0.07108986059824626}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.37850644405281, "sim_physics": 0.1868092370033264, "survival_time": 14.950000000000076, "driven_lanedir": -2.260637650975249, "sim_render-ego": 0.06470041513442994, "in-drivable-lane": 4.050000000000024, "agent_compute-ego": 0.17543508927027385, "deviation-heading": 7.090641611385013, "set_robot_commands": 0.10028167327245076, "deviation-center-line": 1.002134440312669, "driven_lanedir_consec": -1.339793520141566, "sim_compute_sim_state": 0.0403075385093689, "sim_compute_performance-ego": 0.07050856113433839, "sim_compute_robot_state-ego": 0.07613191286722819, "sim_compute_robot_state-npc0": 0.0727270221710205, "sim_compute_robot_state-npc1": 0.07174268563588461, "sim_compute_robot_state-npc2": 0.07130134423573811, "sim_compute_robot_state-npc3": 0.07214120308558146}}
set_robot_commands_max0.10279776811599732
set_robot_commands_mean0.09595491393407186
set_robot_commands_median0.0997756584485372
set_robot_commands_min0.08831639687220255
sim_compute_performance-ego_max0.07125105698903401
sim_compute_performance-ego_mean0.06706192413965863
sim_compute_performance-ego_median0.07019739548365275
sim_compute_performance-ego_min0.06124304215113322
sim_compute_robot_state-ego_max0.07941562493642171
sim_compute_robot_state-ego_mean0.07391729736328126
sim_compute_robot_state-ego_median0.07613191286722819
sim_compute_robot_state-ego_min0.06772487799326579
sim_compute_robot_state-npc0_max0.0727270221710205
sim_compute_robot_state-npc0_mean0.06863860893249511
sim_compute_robot_state-npc0_median0.07113632520039877
sim_compute_robot_state-npc0_min0.06329822937647502
sim_compute_robot_state-npc1_max0.07174268563588461
sim_compute_robot_state-npc1_mean0.06784662326176961
sim_compute_robot_state-npc1_median0.06985526402791341
sim_compute_robot_state-npc1_min0.06258289337158203
sim_compute_robot_state-npc2_max0.07138206720352173
sim_compute_robot_state-npc2_mean0.06826687606175741
sim_compute_robot_state-npc2_median0.07059564749399821
sim_compute_robot_state-npc2_min0.06250531435012817
sim_compute_robot_state-npc3_max0.07214120308558146
sim_compute_robot_state-npc3_mean0.0681863374710083
sim_compute_robot_state-npc3_median0.07108986059824626
sim_compute_robot_state-npc3_min0.06291889031728108
sim_compute_sim_state_max0.04081124782562256
sim_compute_sim_state_mean0.03851504151026408
sim_compute_sim_state_median0.0403075385093689
sim_compute_sim_state_min0.03490424950917562
sim_physics_max0.1868092370033264
sim_physics_mean0.1708651622136434
sim_physics_median0.17631556351979574
sim_physics_min0.15075119654337563
sim_render-ego_max0.06470041513442994
sim_render-ego_mean0.06101110855738322
sim_render-ego_median0.06426085392634073
sim_render-ego_min0.05544922351837158
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
229532468Liam Paullchallenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessyes12120:05:58(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.1570279598236084
agent_compute-ego_mean0.15260445708878195
agent_compute-ego_median0.15544038482859163
agent_compute-ego_min0.13959382562076345
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.12047180423030147, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06215539243486193, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.15603367487589517, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09759471151563856, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.0385628585462217, "sim_compute_performance-ego": 0.06907831297980414, "sim_compute_robot_state-ego": 0.07306526325367114}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.11494292464910769, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.0641476547016817, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15492644029505112, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.09578528591230805, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03816442863613952, "sim_compute_performance-ego": 0.06867548998664408, "sim_compute_robot_state-ego": 0.07797761524424833}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.14162836355321548, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.05889111406662885, "in-drivable-lane": 0, "agent_compute-ego": 0.13959382562076345, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.09761320843416102, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.04273867607116699, "sim_compute_performance-ego": 0.06678436784183278, "sim_compute_robot_state-ego": 0.07216238975524902}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.13000476837158204, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06034914970397949, "in-drivable-lane": 0, "agent_compute-ego": 0.1570279598236084, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.09556358337402344, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.04058761596679687, "sim_compute_performance-ego": 0.0654416561126709, "sim_compute_robot_state-ego": 0.06908664703369141}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.1170202750193922, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06339145008521745, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.15544038482859163, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.09794910044609746, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03860443151449856, "sim_compute_performance-ego": 0.06968527504160435, "sim_compute_robot_state-ego": 0.07554328894313378}}
set_robot_commands_max0.09794910044609746
set_robot_commands_mean0.0969011779364457
set_robot_commands_median0.09759471151563856
set_robot_commands_min0.09556358337402344
sim_compute_performance-ego_max0.06968527504160435
sim_compute_performance-ego_mean0.06793302039251126
sim_compute_performance-ego_median0.06867548998664408
sim_compute_performance-ego_min0.0654416561126709
sim_compute_robot_state-ego_max0.07797761524424833
sim_compute_robot_state-ego_mean0.07356704084599874
sim_compute_robot_state-ego_median0.07306526325367114
sim_compute_robot_state-ego_min0.06908664703369141
sim_compute_sim_state_max0.04273867607116699
sim_compute_sim_state_mean0.03973160214696473
sim_compute_sim_state_median0.03860443151449856
sim_compute_sim_state_min0.03816442863613952
sim_physics_max0.14162836355321548
sim_physics_mean0.12481362716471978
sim_physics_median0.12047180423030147
sim_physics_min0.11494292464910769
sim_render-ego_max0.0641476547016817
sim_render-ego_mean0.061786952198473875
sim_render-ego_median0.06215539243486193
sim_render-ego_min0.05889111406662885
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
229522479Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerroryes12120:00:45
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
229442487Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerroryes12120:00:59
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
229272510RamiNaimchallenge-aido_LF-template-rosaido2-LFV-sim-testingstep1-simulationerroryes12120:01:47
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
229082537Liam Paullbaseline-IL-sim-tensorflowaido2-LFVI-sim-validationstep1-simulationerroryes12120:04:00
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
229022544Liam Paullchallenge-aido_LF-template-rosaido2-LF-sim-testingstep1-simulationerroryes12120:03:48
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
228972556Andrea Censichallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-validationstep1-simulationsuccessyes12120:09:13(hidden)
driven_lanedir_consec_median0.4702323960536803
survival_time_median2.849999999999998
deviation-center-line_median0.13623952041905
in-drivable-lane_median0.7999999999999976


other stats
agent_compute-ego_max0.07947047551472981
agent_compute-ego_mean0.07670751847270899
agent_compute-ego_median0.07693704580649352
agent_compute-ego_min0.07438852700842433
deviation-center-line_max0.2701922695523504
deviation-center-line_mean0.16546426353561405
deviation-center-line_min0.07144385614371519
deviation-heading_max1.2111022380750738
deviation-heading_mean0.8262001110734373
deviation-heading_median0.7978002362162198
deviation-heading_min0.39989969254594865
driven_any_max1.093753441791869
driven_any_mean0.7182169120135662
driven_any_median0.8072381933001392
driven_any_min0.29795781475632777
driven_lanedir_consec_max0.6735785385729686
driven_lanedir_consec_mean0.4271077107010905
driven_lanedir_consec_min0.2312609677194346
driven_lanedir_max0.6758329617605024
driven_lanedir_mean0.4275585953385973
driven_lanedir_median0.4702323960536803
driven_lanedir_min0.2312609677194346
in-drivable-lane_max1.6499999999999957
in-drivable-lane_mean0.7199999999999979
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.093753441791869, "sim_physics": 0.2180842750043754, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.06498289108276367, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.07438852700842433, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.09960337144782744, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.04021551810115217, "sim_compute_performance-ego": 0.07071536420339561, "sim_compute_robot_state-ego": 0.07867743021034333, "sim_compute_robot_state-npc0": 0.06966453575226197, "sim_compute_robot_state-npc1": 0.07202037271246853, "sim_compute_robot_state-npc2": 0.07048561486853175, "sim_compute_robot_state-npc3": 0.07175633706242206}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.23419801394144693, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.07497431613780835, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07947047551472981, "deviation-heading": 0.6953408166028192, "set_robot_commands": 0.10322391545331036, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.04115447291621455, "sim_compute_performance-ego": 0.07563923023365161, "sim_compute_robot_state-ego": 0.0837210460945412, "sim_compute_robot_state-npc0": 0.07219280136956109, "sim_compute_robot_state-npc1": 0.07234955717016149, "sim_compute_robot_state-npc2": 0.07224317833229348, "sim_compute_robot_state-npc3": 0.07302203884831181}, "udem1-2-0": {"driven_any": 1.080947789080493, "sim_physics": 0.22693801537538183, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.06553276074238312, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.07693704580649352, "deviation-heading": 1.0268575719271242, "set_robot_commands": 0.10373496397947654, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.04136441609798334, "sim_compute_performance-ego": 0.07003900637993446, "sim_compute_robot_state-ego": 0.07681498160729042, "sim_compute_robot_state-npc0": 0.07362800378065842, "sim_compute_robot_state-npc1": 0.07094733531658466, "sim_compute_robot_state-npc2": 0.06934565458542262, "sim_compute_robot_state-npc3": 0.0729594933680999}, "udem1-3-0": {"driven_any": 0.8072381933001392, "sim_physics": 0.22432849699990792, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.0643339617210522, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.07553194698534514, "deviation-heading": 0.7978002362162198, "set_robot_commands": 0.09718615130374306, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.041646204496684824, "sim_compute_performance-ego": 0.07171636715269926, "sim_compute_robot_state-ego": 0.07853677816558302, "sim_compute_robot_state-npc0": 0.06986741434063828, "sim_compute_robot_state-npc1": 0.0708393883286861, "sim_compute_robot_state-npc2": 0.07449873706750702, "sim_compute_robot_state-npc3": 0.07430856269702577}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.2259759073672087, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.06827860293181046, "in-drivable-lane": 0, "agent_compute-ego": 0.07720959704855214, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.1183008629342784, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.041218809459520424, "sim_compute_performance-ego": 0.07497413262077, "sim_compute_robot_state-ego": 0.0810992199441661, "sim_compute_robot_state-npc0": 0.07212180676667587, "sim_compute_robot_state-npc1": 0.07123091946477475, "sim_compute_robot_state-npc2": 0.07385125367537788, "sim_compute_robot_state-npc3": 0.07290289712988812}}
set_robot_commands_max0.1183008629342784
set_robot_commands_mean0.10440985302372716
set_robot_commands_median0.10322391545331036
set_robot_commands_min0.09718615130374306
sim_compute_performance-ego_max0.07563923023365161
sim_compute_performance-ego_mean0.0726168201180902
sim_compute_performance-ego_median0.07171636715269926
sim_compute_performance-ego_min0.07003900637993446
sim_compute_robot_state-ego_max0.0837210460945412
sim_compute_robot_state-ego_mean0.07976989120438482
sim_compute_robot_state-ego_median0.07867743021034333
sim_compute_robot_state-ego_min0.07681498160729042
sim_compute_robot_state-npc0_max0.07362800378065842
sim_compute_robot_state-npc0_mean0.07149491240195913
sim_compute_robot_state-npc0_median0.07212180676667587
sim_compute_robot_state-npc0_min0.06966453575226197
sim_compute_robot_state-npc1_max0.07234955717016149
sim_compute_robot_state-npc1_mean0.0714775145985351
sim_compute_robot_state-npc1_median0.07123091946477475
sim_compute_robot_state-npc1_min0.0708393883286861
sim_compute_robot_state-npc2_max0.07449873706750702
sim_compute_robot_state-npc2_mean0.07208488770582655
sim_compute_robot_state-npc2_median0.07224317833229348
sim_compute_robot_state-npc2_min0.06934565458542262
sim_compute_robot_state-npc3_max0.07430856269702577
sim_compute_robot_state-npc3_mean0.07298986582114954
sim_compute_robot_state-npc3_median0.0729594933680999
sim_compute_robot_state-npc3_min0.07175633706242206
sim_compute_sim_state_max0.041646204496684824
sim_compute_sim_state_mean0.04111988421431106
sim_compute_sim_state_median0.041218809459520424
sim_compute_sim_state_min0.04021551810115217
sim_physics_max0.23419801394144693
sim_physics_mean0.22590494173766415
sim_physics_median0.2259759073672087
sim_physics_min0.2180842750043754
sim_render-ego_max0.07497431613780835
sim_render-ego_mean0.06762050652316356
sim_render-ego_median0.06553276074238312
sim_render-ego_min0.0643339617210522
simulation-passed1
survival_time_max4.149999999999993
survival_time_mean2.679999999999997
survival_time_min1.1500000000000004
228772591Julian Zillybaseline-IL-logs-tensorflowaido2-LFV-sim-validationstep1-simulationsuccessyes12120:15:40(hidden)
driven_lanedir_consec_median0.2716987056833706
survival_time_median5.549999999999988
deviation-center-line_median0.3825070516652597
in-drivable-lane_median0


other stats
agent_compute-ego_max0.25023627512663316
agent_compute-ego_mean0.2376359821553382
agent_compute-ego_median0.2456103863923446
agent_compute-ego_min0.20340194071040435
deviation-center-line_max0.4816531256795156
deviation-center-line_mean0.3805850415107731
deviation-center-line_min0.2369383924787904
deviation-heading_max3.023647190428616
deviation-heading_mean2.154979094098645
deviation-heading_median2.051768785026961
deviation-heading_min1.3552476241138214
driven_any_max0.33368102835532826
driven_any_mean0.28966190228764976
driven_any_median0.3129605979752506
driven_any_min0.18772401300848413
driven_lanedir_consec_max0.2849993772364474
driven_lanedir_consec_mean0.24876042203899495
driven_lanedir_consec_min0.14610094523670614
driven_lanedir_max0.2849993772364474
driven_lanedir_mean0.24876042203899495
driven_lanedir_median0.2716987056833706
driven_lanedir_min0.14610094523670614
in-drivable-lane_max0.14999999999999947
in-drivable-lane_mean0.04999999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.33368102835532826, "sim_physics": 0.1898908389834907, "survival_time": 6.349999999999985, "driven_lanedir": 0.27842869636457834, "sim_render-ego": 0.06543387202765998, "in-drivable-lane": 0, "agent_compute-ego": 0.2432498143413874, "deviation-heading": 3.023647190428616, "set_robot_commands": 0.09883700956509808, "deviation-center-line": 0.3825070516652597, "driven_lanedir_consec": 0.27842869636457834, "sim_compute_sim_state": 0.03991235710504487, "sim_compute_performance-ego": 0.07188717774518831, "sim_compute_robot_state-ego": 0.0773239116969071, "sim_compute_robot_state-npc0": 0.07258654579402894, "sim_compute_robot_state-npc1": 0.07065843409440649, "sim_compute_robot_state-npc2": 0.07024664766206516, "sim_compute_robot_state-npc3": 0.07015184717854177}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3234989464631947, "sim_physics": 0.1944331044736116, "survival_time": 5.749999999999988, "driven_lanedir": 0.2716987056833706, "sim_render-ego": 0.06403819374416185, "in-drivable-lane": 0, "agent_compute-ego": 0.2456103863923446, "deviation-heading": 2.9516979608490947, "set_robot_commands": 0.10243547895680304, "deviation-center-line": 0.36952628179764974, "driven_lanedir_consec": 0.2716987056833706, "sim_compute_sim_state": 0.03993908633356509, "sim_compute_performance-ego": 0.07160118973773459, "sim_compute_robot_state-ego": 0.08010525288789169, "sim_compute_robot_state-npc0": 0.07195747624272886, "sim_compute_robot_state-npc1": 0.07151248351387356, "sim_compute_robot_state-npc2": 0.0718862886014192, "sim_compute_robot_state-npc3": 0.07050861068393872}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3129605979752506, "sim_physics": 0.20230487660244775, "survival_time": 5.549999999999988, "driven_lanedir": 0.2849993772364474, "sim_render-ego": 0.06597895880003234, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.2456814942059216, "deviation-heading": 1.3552476241138214, "set_robot_commands": 0.10041196926220045, "deviation-center-line": 0.4816531256795156, "driven_lanedir_consec": 0.2849993772364474, "sim_compute_sim_state": 0.044136247119388065, "sim_compute_performance-ego": 0.07298279452968288, "sim_compute_robot_state-ego": 0.0794684006287171, "sim_compute_robot_state-npc0": 0.07133124970101021, "sim_compute_robot_state-npc1": 0.07287371910370148, "sim_compute_robot_state-npc2": 0.07186140455641188, "sim_compute_robot_state-npc3": 0.07545925905038645}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2904449256359914, "sim_physics": 0.19410169008866096, "survival_time": 5.14999999999999, "driven_lanedir": 0.26257438567387226, "sim_render-ego": 0.06604429124628455, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.25023627512663316, "deviation-heading": 1.3925339100747296, "set_robot_commands": 0.1019030033963398, "deviation-center-line": 0.4323003559326501, "driven_lanedir_consec": 0.26257438567387226, "sim_compute_sim_state": 0.0417030204847021, "sim_compute_performance-ego": 0.07193489908014686, "sim_compute_robot_state-ego": 0.07621604493520792, "sim_compute_robot_state-npc0": 0.07245466315630571, "sim_compute_robot_state-npc1": 0.07080532509146385, "sim_compute_robot_state-npc2": 0.07229428846859237, "sim_compute_robot_state-npc3": 0.07282901967613442}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.18772401300848413, "sim_physics": 0.15728559914757223, "survival_time": 3.399999999999996, "driven_lanedir": 0.14610094523670614, "sim_render-ego": 0.05499461468528299, "in-drivable-lane": 0, "agent_compute-ego": 0.20340194071040435, "deviation-heading": 2.051768785026961, "set_robot_commands": 0.10447345761691824, "deviation-center-line": 0.2369383924787904, "driven_lanedir_consec": 0.14610094523670614, "sim_compute_sim_state": 0.034772452186135686, "sim_compute_performance-ego": 0.059914659051334154, "sim_compute_robot_state-ego": 0.06630083392648135, "sim_compute_robot_state-npc0": 0.061277561327990365, "sim_compute_robot_state-npc1": 0.059757688466240376, "sim_compute_robot_state-npc2": 0.05914246685364667, "sim_compute_robot_state-npc3": 0.08332260566599228}}
set_robot_commands_max0.10447345761691824
set_robot_commands_mean0.1016121837594719
set_robot_commands_median0.1019030033963398
set_robot_commands_min0.09883700956509808
sim_compute_performance-ego_max0.07298279452968288
sim_compute_performance-ego_mean0.06966414402881736
sim_compute_performance-ego_median0.07188717774518831
sim_compute_performance-ego_min0.059914659051334154
sim_compute_robot_state-ego_max0.08010525288789169
sim_compute_robot_state-ego_mean0.07588288881504103
sim_compute_robot_state-ego_median0.0773239116969071
sim_compute_robot_state-ego_min0.06630083392648135
sim_compute_robot_state-npc0_max0.07258654579402894
sim_compute_robot_state-npc0_mean0.06992149924441282
sim_compute_robot_state-npc0_median0.07195747624272886
sim_compute_robot_state-npc0_min0.061277561327990365
sim_compute_robot_state-npc1_max0.07287371910370148
sim_compute_robot_state-npc1_mean0.06912153005393715
sim_compute_robot_state-npc1_median0.07080532509146385
sim_compute_robot_state-npc1_min0.059757688466240376
sim_compute_robot_state-npc2_max0.07229428846859237
sim_compute_robot_state-npc2_mean0.06908621922842706
sim_compute_robot_state-npc2_median0.07186140455641188
sim_compute_robot_state-npc2_min0.05914246685364667
sim_compute_robot_state-npc3_max0.08332260566599228
sim_compute_robot_state-npc3_mean0.07445426845099871
sim_compute_robot_state-npc3_median0.07282901967613442
sim_compute_robot_state-npc3_min0.07015184717854177
sim_compute_sim_state_max0.044136247119388065
sim_compute_sim_state_mean0.04009263264576716
sim_compute_sim_state_median0.03993908633356509
sim_compute_sim_state_min0.034772452186135686
sim_physics_max0.20230487660244775
sim_physics_mean0.18760322185915665
sim_physics_median0.19410169008866096
sim_physics_min0.15728559914757223
sim_render-ego_max0.06604429124628455
sim_render-ego_mean0.06329798610068434
sim_render-ego_median0.06543387202765998
sim_render-ego_min0.05499461468528299
simulation-passed1
survival_time_max6.349999999999985
survival_time_mean5.2399999999999896
survival_time_min3.399999999999996
228573545MYFtestaido2-LF-sim-validationstep1-simulationsuccessyes12120:21:44(hidden)
driven_lanedir_consec_median3.0052202182071666
survival_time_median14.950000000000076
deviation-center-line_median0.7414558758082337
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1718784467379252
agent_compute-ego_mean0.16601531662914035
agent_compute-ego_median0.1638468631108602
agent_compute-ego_min0.16144777218500772
deviation-center-line_max0.9279996756537554
deviation-center-line_mean0.6177392559881539
deviation-center-line_min0.2153861588676305
deviation-heading_max2.5063174546082108
deviation-heading_mean1.7203132438004751
deviation-heading_median1.900056984307934
deviation-heading_min0.7766631760452164
driven_any_max3.4140768506553543
driven_any_mean2.6684903275050127
driven_any_median3.069559776329662
driven_any_min0.5746353847318589
driven_lanedir_consec_max3.400084363534463
driven_lanedir_consec_mean2.626256715390884
driven_lanedir_consec_min0.5465844479731508
driven_lanedir_max3.400084363534463
driven_lanedir_mean2.626256715390884
driven_lanedir_median3.0052202182071666
driven_lanedir_min0.5465844479731508
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5746353847318589, "sim_physics": 0.1363207566536079, "survival_time": 2.9499999999999975, "driven_lanedir": 0.5465844479731508, "sim_render-ego": 0.06679500563670013, "in-drivable-lane": 0, "agent_compute-ego": 0.17102331630254197, "deviation-heading": 0.7766631760452164, "set_robot_commands": 0.10417094473111428, "deviation-center-line": 0.2153861588676305, "driven_lanedir_consec": 0.5465844479731508, "sim_compute_sim_state": 0.04271188428846456, "sim_compute_performance-ego": 0.07558435908818649, "sim_compute_robot_state-ego": 0.08617521544634285}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.4140768506553543, "sim_physics": 0.11608511209487916, "survival_time": 14.950000000000076, "driven_lanedir": 3.400084363534463, "sim_render-ego": 0.06203450123469035, "in-drivable-lane": 0, "agent_compute-ego": 0.1638468631108602, "deviation-heading": 0.9231899677667084, "set_robot_commands": 0.09747806708017984, "deviation-center-line": 0.4444918816021941, "driven_lanedir_consec": 3.400084363534463, "sim_compute_sim_state": 0.03966408491134644, "sim_compute_performance-ego": 0.07101794242858887, "sim_compute_robot_state-ego": 0.07655898888905843}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.226014665040336, "sim_physics": 0.1135930879910787, "survival_time": 14.950000000000076, "driven_lanedir": 3.181628412694986, "sim_render-ego": 0.06395241181055705, "in-drivable-lane": 0, "agent_compute-ego": 0.16188018480936686, "deviation-heading": 1.900056984307934, "set_robot_commands": 0.09963079373041787, "deviation-center-line": 0.7414558758082337, "driven_lanedir_consec": 3.181628412694986, "sim_compute_sim_state": 0.03924352407455444, "sim_compute_performance-ego": 0.07078989267349244, "sim_compute_robot_state-ego": 0.07672710259755453}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.0581649607678525, "sim_physics": 0.1210203242301941, "survival_time": 14.950000000000076, "driven_lanedir": 2.9977661345446527, "sim_render-ego": 0.06466678619384765, "in-drivable-lane": 0, "agent_compute-ego": 0.1718784467379252, "deviation-heading": 2.5063174546082108, "set_robot_commands": 0.10123417854309082, "deviation-center-line": 0.9279996756537554, "driven_lanedir_consec": 2.9977661345446527, "sim_compute_sim_state": 0.040228111743927, "sim_compute_performance-ego": 0.07090488115946451, "sim_compute_robot_state-ego": 0.07676643610000611}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.069559776329662, "sim_physics": 0.10988730510075886, "survival_time": 14.950000000000076, "driven_lanedir": 3.0052202182071666, "sim_render-ego": 0.0612392274538676, "in-drivable-lane": 0, "agent_compute-ego": 0.16144777218500772, "deviation-heading": 2.495338636274308, "set_robot_commands": 0.09840897719065347, "deviation-center-line": 0.7593626880089561, "driven_lanedir_consec": 3.0052202182071666, "sim_compute_sim_state": 0.03872402747472127, "sim_compute_performance-ego": 0.06977233568827311, "sim_compute_robot_state-ego": 0.07653978506724039}}
set_robot_commands_max0.10417094473111428
set_robot_commands_mean0.10018459225509128
set_robot_commands_median0.09963079373041787
set_robot_commands_min0.09747806708017984
sim_compute_performance-ego_max0.07558435908818649
sim_compute_performance-ego_mean0.07161388220760109
sim_compute_performance-ego_median0.07090488115946451
sim_compute_performance-ego_min0.06977233568827311
sim_compute_robot_state-ego_max0.08617521544634285
sim_compute_robot_state-ego_mean0.07855350562004046
sim_compute_robot_state-ego_median0.07672710259755453
sim_compute_robot_state-ego_min0.07653978506724039
sim_compute_sim_state_max0.04271188428846456
sim_compute_sim_state_mean0.040114326498602734
sim_compute_sim_state_median0.03966408491134644
sim_compute_sim_state_min0.03872402747472127
sim_physics_max0.1363207566536079
sim_physics_mean0.11938131721410376
sim_physics_median0.11608511209487916
sim_physics_min0.10988730510075886
sim_render-ego_max0.06679500563670013
sim_render-ego_mean0.06373758646593256
sim_render-ego_median0.06395241181055705
sim_render-ego_min0.0612392274538676
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.55000000000006
survival_time_min2.9499999999999975
228482629Andrea Censichallenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessyes12120:06:20(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.18766229292925665
agent_compute-ego_mean0.16317689608173125
agent_compute-ego_median0.1705010555408619
agent_compute-ego_min0.12883242906308642
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.14331129303684942, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06838876671261257, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1705010555408619, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10793493853674994, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.044860239382143376, "sim_compute_performance-ego": 0.07827019249951397, "sim_compute_robot_state-ego": 0.08567876727492721}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.08812790290982116, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.05095531426224054, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.12883242906308642, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.0776521084355373, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03218628378475413, "sim_compute_performance-ego": 0.056440905028698495, "sim_compute_robot_state-ego": 0.05984825713961732}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.1572107006521786, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.07058393253999598, "in-drivable-lane": 0, "agent_compute-ego": 0.18766229292925665, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.11619165364433735, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.04470755072200999, "sim_compute_performance-ego": 0.07834801954381607, "sim_compute_robot_state-ego": 0.08632225148818072}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.13496453285217286, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06836645126342773, "in-drivable-lane": 0, "agent_compute-ego": 0.1715410327911377, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.10499053955078123, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.04240708351135254, "sim_compute_performance-ego": 0.07340540885925292, "sim_compute_robot_state-ego": 0.08164941787719726}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.11228391188609448, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06396482262430311, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.1573476700843135, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.09747114664391626, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03971879391730586, "sim_compute_performance-ego": 0.06936446322670466, "sim_compute_robot_state-ego": 0.07422382016725178}}
set_robot_commands_max0.11619165364433735
set_robot_commands_mean0.10084807736226442
set_robot_commands_median0.10499053955078123
set_robot_commands_min0.0776521084355373
sim_compute_performance-ego_max0.07834801954381607
sim_compute_performance-ego_mean0.07116579783159722
sim_compute_performance-ego_median0.07340540885925292
sim_compute_performance-ego_min0.056440905028698495
sim_compute_robot_state-ego_max0.08632225148818072
sim_compute_robot_state-ego_mean0.07754450278943485
sim_compute_robot_state-ego_median0.08164941787719726
sim_compute_robot_state-ego_min0.05984825713961732
sim_compute_sim_state_max0.044860239382143376
sim_compute_sim_state_mean0.04077599026351318
sim_compute_sim_state_median0.04240708351135254
sim_compute_sim_state_min0.03218628378475413
sim_physics_max0.1572107006521786
sim_physics_mean0.12717966826742333
sim_physics_median0.13496453285217286
sim_physics_min0.08812790290982116
sim_render-ego_max0.07058393253999598
sim_render-ego_mean0.06445185748051599
sim_render-ego_median0.06836645126342773
sim_render-ego_min0.05095531426224054
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
228422652zamatorychallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerroryes12120:08:01
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
228212699Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationsuccessyes12120:43:18(hidden)
driven_lanedir_consec_median1.0347969139267192
survival_time_median14.950000000000076
deviation-center-line_median0.9676323197502408
in-drivable-lane_median1.200000000000017


other stats
agent_compute-ego_max0.10827308471756752
agent_compute-ego_mean0.0969117461358658
agent_compute-ego_median0.09586040655771892
agent_compute-ego_min0.08798396507898966
deviation-center-line_max1.2240417562286885
deviation-center-line_mean0.9131416404756024
deviation-center-line_min0.5195348861362664
deviation-heading_max6.447969447458883
deviation-heading_mean4.316404508740158
deviation-heading_median4.601007580117526
deviation-heading_min0.9557359651027842
driven_any_max2.3489080444331454
driven_any_mean2.024058297512674
driven_any_median2.348749456605972
driven_any_min0.7418762410934892
driven_lanedir_consec_max1.7432461876358945
driven_lanedir_consec_mean1.0966423673120018
driven_lanedir_consec_min0.7204901231503708
driven_lanedir_max1.917103263831786
driven_lanedir_mean1.601899068018648
driven_lanedir_median1.8306268470857805
driven_lanedir_min0.7204901231503708
in-drivable-lane_max3.000000000000022
in-drivable-lane_mean1.370000000000014
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.331866813655183, "sim_physics": 0.26676341613133747, "survival_time": 14.950000000000076, "driven_lanedir": 1.8306268470857805, "sim_render-ego": 0.07671574751536052, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.09586040655771892, "deviation-heading": 5.824270353639917, "set_robot_commands": 0.12172087669372558, "deviation-center-line": 0.9690935954952266, "driven_lanedir_consec": 1.0347969139267192, "sim_compute_sim_state": 0.04665467023849487, "sim_compute_performance-ego": 0.08336400032043458, "sim_compute_robot_state-ego": 0.0960922646522522, "sim_compute_robot_state-npc0": 0.08152446508407593, "sim_compute_robot_state-npc1": 0.0810825753211975, "sim_compute_robot_state-npc2": 0.08256057818730672, "sim_compute_robot_state-npc3": 0.08302874247233073}, "udem1-1-0": {"driven_any": 2.348749456605972, "sim_physics": 0.2631913352012634, "survival_time": 14.950000000000076, "driven_lanedir": 1.917103263831786, "sim_render-ego": 0.07485801617304484, "in-drivable-lane": 0.700000000000002, "agent_compute-ego": 0.09463926076889038, "deviation-heading": 6.447969447458883, "set_robot_commands": 0.12308108965555828, "deviation-center-line": 0.9676323197502408, "driven_lanedir_consec": 0.8998459935507921, "sim_compute_sim_state": 0.046121726830800375, "sim_compute_performance-ego": 0.0837237517038981, "sim_compute_robot_state-ego": 0.09732165177663168, "sim_compute_robot_state-npc0": 0.08102134784062703, "sim_compute_robot_state-npc1": 0.0820860767364502, "sim_compute_robot_state-npc2": 0.08225205421447754, "sim_compute_robot_state-npc3": 0.08444050391515096}, "udem1-2-0": {"driven_any": 0.7418762410934892, "sim_physics": 0.31012982310670795, "survival_time": 4.94999999999999, "driven_lanedir": 0.7204901231503708, "sim_render-ego": 0.08006368261395079, "in-drivable-lane": 0, "agent_compute-ego": 0.10827308471756752, "deviation-heading": 0.9557359651027842, "set_robot_commands": 0.12727364385970916, "deviation-center-line": 0.5195348861362664, "driven_lanedir_consec": 0.7204901231503708, "sim_compute_sim_state": 0.0490942940567479, "sim_compute_performance-ego": 0.08673587230720906, "sim_compute_robot_state-ego": 0.10060247507962314, "sim_compute_robot_state-npc0": 0.08321278986304698, "sim_compute_robot_state-npc1": 0.08332214933453184, "sim_compute_robot_state-npc2": 0.08568280393427069, "sim_compute_robot_state-npc3": 0.08641268267776027}, "udem1-3-0": {"driven_any": 2.348890931775583, "sim_physics": 0.2563531017303467, "survival_time": 14.950000000000076, "driven_lanedir": 1.6516868417096475, "sim_render-ego": 0.07521909236907959, "in-drivable-lane": 3.000000000000022, "agent_compute-ego": 0.09780201355616253, "deviation-heading": 4.601007580117526, "set_robot_commands": 0.1228886079788208, "deviation-center-line": 1.2240417562286885, "driven_lanedir_consec": 1.0848326182962318, "sim_compute_sim_state": 0.04639856338500976, "sim_compute_performance-ego": 0.0826255997021993, "sim_compute_robot_state-ego": 0.09627878824869791, "sim_compute_robot_state-npc0": 0.08280357917149862, "sim_compute_robot_state-npc1": 0.08241352717081706, "sim_compute_robot_state-npc2": 0.0818927009900411, "sim_compute_robot_state-npc3": 0.08269699335098267}, "udem1-4-0": {"driven_any": 2.3489080444331454, "sim_physics": 0.2369021201133728, "survival_time": 14.950000000000076, "driven_lanedir": 1.889588264315656, "sim_render-ego": 0.06839807748794556, "in-drivable-lane": 1.9500000000000275, "agent_compute-ego": 0.08798396507898966, "deviation-heading": 3.7530391973816783, "set_robot_commands": 0.11188069502512614, "deviation-center-line": 0.88540564476759, "driven_lanedir_consec": 1.7432461876358945, "sim_compute_sim_state": 0.0406018861134847, "sim_compute_performance-ego": 0.07452790578206381, "sim_compute_robot_state-ego": 0.0840007495880127, "sim_compute_robot_state-npc0": 0.07453361511230469, "sim_compute_robot_state-npc1": 0.07475243330001831, "sim_compute_robot_state-npc2": 0.07556800285975139, "sim_compute_robot_state-npc3": 0.0743675176302592}}
set_robot_commands_max0.12727364385970916
set_robot_commands_mean0.121368982642588
set_robot_commands_median0.1228886079788208
set_robot_commands_min0.11188069502512614
sim_compute_performance-ego_max0.08673587230720906
sim_compute_performance-ego_mean0.08219542596316096
sim_compute_performance-ego_median0.08336400032043458
sim_compute_performance-ego_min0.07452790578206381
sim_compute_robot_state-ego_max0.10060247507962314
sim_compute_robot_state-ego_mean0.09485918586904352
sim_compute_robot_state-ego_median0.09627878824869791
sim_compute_robot_state-ego_min0.0840007495880127
sim_compute_robot_state-npc0_max0.08321278986304698
sim_compute_robot_state-npc0_mean0.08061915941431066
sim_compute_robot_state-npc0_median0.08152446508407593
sim_compute_robot_state-npc0_min0.07453361511230469
sim_compute_robot_state-npc1_max0.08332214933453184
sim_compute_robot_state-npc1_mean0.08073135237260298
sim_compute_robot_state-npc1_median0.0820860767364502
sim_compute_robot_state-npc1_min0.07475243330001831
sim_compute_robot_state-npc2_max0.08568280393427069
sim_compute_robot_state-npc2_mean0.08159122803716949
sim_compute_robot_state-npc2_median0.08225205421447754
sim_compute_robot_state-npc2_min0.07556800285975139
sim_compute_robot_state-npc3_max0.08641268267776027
sim_compute_robot_state-npc3_mean0.08218928800929677
sim_compute_robot_state-npc3_median0.08302874247233073
sim_compute_robot_state-npc3_min0.0743675176302592
sim_compute_sim_state_max0.0490942940567479
sim_compute_sim_state_mean0.04577422812490752
sim_compute_sim_state_median0.04639856338500976
sim_compute_sim_state_min0.0406018861134847
sim_physics_max0.31012982310670795
sim_physics_mean0.26666795925660564
sim_physics_median0.2631913352012634
sim_physics_min0.2369021201133728
sim_render-ego_max0.08006368261395079
sim_render-ego_mean0.07505092323187626
sim_render-ego_median0.07521909236907959
sim_render-ego_min0.06839807748794556
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.95000000000006
survival_time_min4.94999999999999
228122715jp18813100494test for ppoaido2-LF-sim-testingstep1-simulationerroryes12120:01:41
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
228012734Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-testingstep1-simulationfailedyes12120:01:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
227932746RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationfailedyes12120:02:11
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
227842767Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationerroryes12120:06:34
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
227802779RamiNaimchallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validationstep1-simulationerroryes12120:00:37
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
227732782RamiNaimchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-testingstep1-simulationerroryes12120:00:36
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
227682796RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationfailedyes12120:02:06
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
227612813Andrea Censichallenge-aido_LF-template-random - random_agentaido2-LFVI-sim-validationstep1-simulationsuccessyes12120:10:42(hidden)
driven_lanedir_consec_median0.493517638549009
survival_time_median2.3999999999999995
deviation-center-line_median0.09791133281082
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.17503543745113326
agent_compute-ego_mean0.16925188659300677
agent_compute-ego_median0.17016725029264176
agent_compute-ego_min0.15971388135637557
deviation-center-line_max0.2348196785686717
deviation-center-line_mean0.13547481992266058
deviation-center-line_min0.06216029860587694
deviation-heading_max0.8115272458314897
deviation-heading_mean0.49959867397150787
deviation-heading_median0.46504862964833654
deviation-heading_min0.30044835691402494
driven_any_max2.1864003300000694
driven_any_mean1.1068208197848532
driven_any_median0.9410513078477724
driven_any_min0.34749292376309954
driven_lanedir_consec_max1.826231945363564
driven_lanedir_consec_mean0.804744013449103
driven_lanedir_consec_min0.3325249708009643
driven_lanedir_max1.826231945363564
driven_lanedir_mean0.804828147320482
driven_lanedir_median0.493517638549009
driven_lanedir_min0.3325249708009643
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.5599999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.23346554176716863, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06831821308860296, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.17503543745113326, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.10882862308357336, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.04269554343404649, "sim_compute_performance-ego": 0.07650764079033574, "sim_compute_robot_state-ego": 0.08743897269043742, "sim_compute_robot_state-npc0": 0.0766801049437704, "sim_compute_robot_state-npc1": 0.0782563233677345, "sim_compute_robot_state-npc2": 0.07581536377532573, "sim_compute_robot_state-npc3": 0.07747029050996032}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.23737158945628575, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06860918658120292, "in-drivable-lane": 0, "agent_compute-ego": 0.17016725029264176, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.10384397847311835, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.043559023312159946, "sim_compute_performance-ego": 0.08032421554837908, "sim_compute_robot_state-ego": 0.08741664034979683, "sim_compute_robot_state-npc0": 0.07739345516477313, "sim_compute_robot_state-npc1": 0.07921137980052403, "sim_compute_robot_state-npc2": 0.07650480951581683, "sim_compute_robot_state-npc3": 0.07716562066759382}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.20929255994778231, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06765698923647982, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.16658728562512445, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.10475697795164238, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.04242072985010239, "sim_compute_performance-ego": 0.07503091478810726, "sim_compute_robot_state-ego": 0.08068662939719784, "sim_compute_robot_state-npc0": 0.07256521761996075, "sim_compute_robot_state-npc1": 0.07359055639470666, "sim_compute_robot_state-npc2": 0.07505804126702466, "sim_compute_robot_state-npc3": 0.07658671638340626}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.24898182849089304, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06807517508665721, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.17475557823975882, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.10867620011170703, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.042710656921068825, "sim_compute_performance-ego": 0.07916600008805592, "sim_compute_robot_state-ego": 0.08555899063746135, "sim_compute_robot_state-npc0": 0.07829954226811726, "sim_compute_robot_state-npc1": 0.07708316047986348, "sim_compute_robot_state-npc2": 0.07712213198343913, "sim_compute_robot_state-npc3": 0.07934217651685078}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.2412259238106864, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06532481738499232, "in-drivable-lane": 0, "agent_compute-ego": 0.15971388135637557, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.10132336616516112, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.04384403001694452, "sim_compute_performance-ego": 0.07661843299865723, "sim_compute_robot_state-ego": 0.08610464277721587, "sim_compute_robot_state-npc0": 0.07588458061218262, "sim_compute_robot_state-npc1": 0.07950488726298015, "sim_compute_robot_state-npc2": 0.07789494877769834, "sim_compute_robot_state-npc3": 0.08363442193894159}}
set_robot_commands_max0.10882862308357336
set_robot_commands_mean0.10548582915704044
set_robot_commands_median0.10475697795164238
set_robot_commands_min0.10132336616516112
sim_compute_performance-ego_max0.08032421554837908
sim_compute_performance-ego_mean0.07752944084270705
sim_compute_performance-ego_median0.07661843299865723
sim_compute_performance-ego_min0.07503091478810726
sim_compute_robot_state-ego_max0.08743897269043742
sim_compute_robot_state-ego_mean0.08544117517042185
sim_compute_robot_state-ego_median0.08610464277721587
sim_compute_robot_state-ego_min0.08068662939719784
sim_compute_robot_state-npc0_max0.07829954226811726
sim_compute_robot_state-npc0_mean0.07616458012176083
sim_compute_robot_state-npc0_median0.0766801049437704
sim_compute_robot_state-npc0_min0.07256521761996075
sim_compute_robot_state-npc1_max0.07950488726298015
sim_compute_robot_state-npc1_mean0.07752926146116176
sim_compute_robot_state-npc1_median0.0782563233677345
sim_compute_robot_state-npc1_min0.07359055639470666
sim_compute_robot_state-npc2_max0.07789494877769834
sim_compute_robot_state-npc2_mean0.07647905906386095
sim_compute_robot_state-npc2_median0.07650480951581683
sim_compute_robot_state-npc2_min0.07505804126702466
sim_compute_robot_state-npc3_max0.08363442193894159
sim_compute_robot_state-npc3_mean0.07883984520335055
sim_compute_robot_state-npc3_median0.07747029050996032
sim_compute_robot_state-npc3_min0.07658671638340626
sim_compute_sim_state_max0.04384403001694452
sim_compute_sim_state_mean0.04304599670686443
sim_compute_sim_state_median0.042710656921068825
sim_compute_sim_state_min0.04242072985010239
sim_physics_max0.24898182849089304
sim_physics_mean0.2340674886945632
sim_physics_median0.23737158945628575
sim_physics_min0.20929255994778231
sim_render-ego_max0.06860918658120292
sim_render-ego_mean0.06759687627558705
sim_render-ego_median0.06807517508665721
sim_render-ego_min0.06532481738499232
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.789999999999997
survival_time_min1.0500000000000005
227142899Julian ZillyBaseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationsuccessyes12120:36:26(hidden)
driven_lanedir_consec_median0.6549380919829523
survival_time_median5.999999999999987
deviation-center-line_median0.2500615736512529
in-drivable-lane_median0.8500000000000121


other stats
agent_compute-ego_max0.28403556220074916
agent_compute-ego_mean0.25249015374045247
agent_compute-ego_median0.25465900301933286
agent_compute-ego_min0.20970675964985996
deviation-center-line_max0.6241758860684284
deviation-center-line_mean0.30605179601445237
deviation-center-line_min0.19028534371277703
deviation-heading_max1.8317126683483456
deviation-heading_mean0.9449064506103224
deviation-heading_median0.8945710427524652
deviation-heading_min0.44874065602003615
driven_any_max2.160393263975218
driven_any_mean0.9275729243547832
driven_any_median0.9898831336164802
driven_any_min0.2648710459225631
driven_lanedir_consec_max1.9719663351310144
driven_lanedir_consec_mean0.7345999499039054
driven_lanedir_consec_min0.2569246953277573
driven_lanedir_max1.9719663351310144
driven_lanedir_mean0.7345999499039054
driven_lanedir_median0.6549380919829523
driven_lanedir_min0.2569246953277573
in-drivable-lane_max2.549999999999991
in-drivable-lane_mean0.9133333333333342
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9986182835992308, "sim_physics": 0.09853663129254804, "survival_time": 6.0499999999999865, "driven_lanedir": 0.6700583579405008, "sim_render-ego": 0.05886435114647731, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.20970675964985996, "deviation-heading": 0.9584632163764666, "set_robot_commands": 0.10479097523965128, "deviation-center-line": 0.229184896196581, "driven_lanedir_consec": 0.6700583579405008, "sim_compute_sim_state": 0.03531865443079925, "sim_compute_performance-ego": 0.06420528987222467, "sim_compute_robot_state-ego": 0.07089802450384976}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0073534343051809, "sim_physics": 0.11787494870482898, "survival_time": 6.099999999999986, "driven_lanedir": 0.8666043062033748, "sim_render-ego": 0.065985912182292, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.24508369359813753, "deviation-heading": 1.7089382302492009, "set_robot_commands": 0.09955732744248189, "deviation-center-line": 0.48682172653539846, "driven_lanedir_consec": 0.8666043062033748, "sim_compute_sim_state": 0.04137452508582443, "sim_compute_performance-ego": 0.07190720956833636, "sim_compute_robot_state-ego": 0.0766351692012099}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2648710459225631, "sim_physics": 0.12494561478898332, "survival_time": 1.850000000000001, "driven_lanedir": 0.2569246953277573, "sim_render-ego": 0.07041947906081741, "in-drivable-lane": 0, "agent_compute-ego": 0.2334173498926936, "deviation-heading": 0.4523071711606882, "set_robot_commands": 0.10201356862042402, "deviation-center-line": 0.19028534371277703, "driven_lanedir_consec": 0.2569246953277573, "sim_compute_sim_state": 0.041408184412363415, "sim_compute_performance-ego": 0.07245605700724833, "sim_compute_robot_state-ego": 0.07956372724997031}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.44830384407782126, "sim_physics": 0.1404003274851832, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4266216174587392, "sim_render-ego": 0.06632915036431675, "in-drivable-lane": 0, "agent_compute-ego": 0.26718758303543616, "deviation-heading": 0.9042996768410582, "set_robot_commands": 0.10319770204609838, "deviation-center-line": 0.2000654842364332, "driven_lanedir_consec": 0.4266216174587392, "sim_compute_sim_state": 0.0432934884367318, "sim_compute_performance-ego": 0.07488818415280046, "sim_compute_robot_state-ego": 0.08192533871223187}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.575138194527954, "sim_physics": 0.12062863742603976, "survival_time": 9.349999999999998, "driven_lanedir": 1.1899106948505498, "sim_render-ego": 0.06398261549638555, "in-drivable-lane": 2.1500000000000155, "agent_compute-ego": 0.24257162420507425, "deviation-heading": 0.5495116766932356, "set_robot_commands": 0.10132985574038908, "deviation-center-line": 0.6241758860684284, "driven_lanedir_consec": 1.1899106948505498, "sim_compute_sim_state": 0.04080750725486062, "sim_compute_performance-ego": 0.07403210650153338, "sim_compute_robot_state-ego": 0.07905945165909548}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.4483038440408249, "sim_physics": 0.117691812844112, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4227993213164738, "sim_render-ego": 0.06488101646817963, "in-drivable-lane": 0, "agent_compute-ego": 0.2508700551657841, "deviation-heading": 0.9813994973397404, "set_robot_commands": 0.1042681233636264, "deviation-center-line": 0.20796815436762567, "driven_lanedir_consec": 0.4227993213164738, "sim_compute_sim_state": 0.041984266248242606, "sim_compute_performance-ego": 0.07208191526347194, "sim_compute_robot_state-ego": 0.07774497722757273}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0160885841428031, "sim_physics": 0.13040574391682944, "survival_time": 6.149999999999986, "driven_lanedir": 0.5516827739079271, "sim_render-ego": 0.06627839367564131, "in-drivable-lane": 2.549999999999991, "agent_compute-ego": 0.2580156365061194, "deviation-heading": 0.8945710427524652, "set_robot_commands": 0.10594457533301375, "deviation-center-line": 0.2500615736512529, "driven_lanedir_consec": 0.5516827739079271, "sim_compute_sim_state": 0.04165796341934824, "sim_compute_performance-ego": 0.07580975788395579, "sim_compute_robot_state-ego": 0.08868732491159827}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.29107361377454816, "sim_physics": 0.12067381739616394, "survival_time": 2.000000000000001, "driven_lanedir": 0.28374525761121827, "sim_render-ego": 0.06356636881828308, "in-drivable-lane": 0, "agent_compute-ego": 0.25980121493339536, "deviation-heading": 0.44874065602003615, "set_robot_commands": 0.10138930678367616, "deviation-center-line": 0.1987065435306638, "driven_lanedir_consec": 0.28374525761121827, "sim_compute_sim_state": 0.04088294506072998, "sim_compute_performance-ego": 0.07287419438362122, "sim_compute_robot_state-ego": 0.0787412941455841}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.6666825735996985, "sim_physics": 0.10915907319769802, "survival_time": 4.149999999999993, "driven_lanedir": 0.6596948906802429, "sim_render-ego": 0.05944540414465479, "in-drivable-lane": 0, "agent_compute-ego": 0.2321209189403488, "deviation-heading": 0.5977744380513031, "set_robot_commands": 0.09797859191894533, "deviation-center-line": 0.2884395853961925, "driven_lanedir_consec": 0.6596948906802429, "sim_compute_sim_state": 0.039208478238209186, "sim_compute_performance-ego": 0.07308682188930282, "sim_compute_robot_state-ego": 0.07717905561608004}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9898831324391452, "sim_physics": 0.12525303761164347, "survival_time": 5.999999999999987, "driven_lanedir": 0.6549380919829523, "sim_render-ego": 0.06862846811612447, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.25465900301933286, "deviation-heading": 1.187734297181029, "set_robot_commands": 0.10448911190032958, "deviation-center-line": 0.26939309530143185, "driven_lanedir_consec": 0.6549380919829523, "sim_compute_sim_state": 0.041304385662078856, "sim_compute_performance-ego": 0.07674826582272848, "sim_compute_robot_state-ego": 0.07885154883066813}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.583873349121392, "sim_physics": 0.13708373079908656, "survival_time": 9.4, "driven_lanedir": 1.2124192541954315, "sim_render-ego": 0.06995996769438399, "in-drivable-lane": 2.000000000000017, "agent_compute-ego": 0.28403556220074916, "deviation-heading": 0.8897962420686931, "set_robot_commands": 0.10940023939660257, "deviation-center-line": 0.3289840744115673, "driven_lanedir_consec": 1.2124192541954315, "sim_compute_sim_state": 0.04188554844957717, "sim_compute_performance-ego": 0.07866054266057115, "sim_compute_robot_state-ego": 0.08902912063801542}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0073534335940946, "sim_physics": 0.1348396969623253, "survival_time": 6.099999999999986, "driven_lanedir": 0.6366060707539863, "sim_render-ego": 0.06895234350298272, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.2645627416548182, "deviation-heading": 1.8317126683483456, "set_robot_commands": 0.10720309859416524, "deviation-center-line": 0.3820267414968929, "driven_lanedir_consec": 0.6366060707539863, "sim_compute_sim_state": 0.04166852059911509, "sim_compute_performance-ego": 0.07637714167110256, "sim_compute_robot_state-ego": 0.08470343957181836}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.9898831336164802, "sim_physics": 0.1129702866077423, "survival_time": 5.999999999999987, "driven_lanedir": 0.7597756905309283, "sim_render-ego": 0.06581691900889079, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.2455985148747762, "deviation-heading": 0.8027896576519975, "set_robot_commands": 0.0999188999334971, "deviation-center-line": 0.22885738160556524, "driven_lanedir_consec": 0.7597756905309283, "sim_compute_sim_state": 0.039995755751927695, "sim_compute_performance-ego": 0.07225418289502462, "sim_compute_robot_state-ego": 0.08488326072692871}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.4657741345847929, "sim_physics": 0.12991583347320557, "survival_time": 2.9999999999999973, "driven_lanedir": 0.4552518906674847, "sim_render-ego": 0.0680710752805074, "in-drivable-lane": 0, "agent_compute-ego": 0.2796384930610657, "deviation-heading": 0.6376789682385315, "set_robot_commands": 0.11238406896591188, "deviation-center-line": 0.2142140825594132, "driven_lanedir_consec": 0.4552518906674847, "sim_compute_sim_state": 0.0434118906656901, "sim_compute_performance-ego": 0.07759089867273966, "sim_compute_robot_state-ego": 0.08976452350616455}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.160393263975218, "sim_physics": 0.1301100976823822, "survival_time": 12.700000000000044, "driven_lanedir": 1.9719663351310144, "sim_render-ego": 0.06748773263195368, "in-drivable-lane": 0.8500000000000121, "agent_compute-ego": 0.2600831553691954, "deviation-heading": 1.3278793201820436, "set_robot_commands": 0.106496635384447, "deviation-center-line": 0.4915923711465623, "driven_lanedir_consec": 1.9719663351310144, "sim_compute_sim_state": 0.041988091205987406, "sim_compute_performance-ego": 0.07540837329203688, "sim_compute_robot_state-ego": 0.08431660941266637}}
set_robot_commands_max0.11238406896591188
set_robot_commands_mean0.10402413871088396
set_robot_commands_median0.1042681233636264
set_robot_commands_min0.09797859191894533
sim_compute_performance-ego_max0.07866054266057115
sim_compute_performance-ego_mean0.07389206276911324
sim_compute_performance-ego_median0.07403210650153338
sim_compute_performance-ego_min0.06420528987222467
sim_compute_robot_state-ego_max0.08976452350616455
sim_compute_robot_state-ego_mean0.08146552439423026
sim_compute_robot_state-ego_median0.07956372724997031
sim_compute_robot_state-ego_min0.07089802450384976
sim_compute_sim_state_max0.0434118906656901
sim_compute_sim_state_mean0.04107934699476572
sim_compute_sim_state_median0.041408184412363415
sim_compute_sim_state_min0.03531865443079925
sim_physics_max0.1404003274851832
sim_physics_mean0.12336595267925148
sim_physics_median0.12494561478898332
sim_physics_min0.09853663129254804
sim_render-ego_max0.07041947906081741
sim_render-ego_mean0.0659112798394594
sim_render-ego_median0.06627839367564131
sim_render-ego_min0.05886435114647731
simulation-passed1
survival_time_max12.700000000000044
survival_time_mean5.64333333333333
survival_time_min1.850000000000001
226363058Andrea Censirotationaido2-LFV-sim-testingstep1-simulationerroryes12120:59:40
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
226163101awoo424HKU Duckietown Projectaido2-LFV-sim-validationstep1-simulationerroryes12120:26:40
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
225933126RamiNaim[0.27;0.75]aido2-LF-sim-validationstep1-simulationsuccessyes12120:26:28(hidden)
driven_lanedir_consec_median2.52704957135005
survival_time_median14.950000000000076
deviation-center-line_median1.1837467477087331
in-drivable-lane_median0


other stats
agent_compute-ego_max0.16293227593104043
agent_compute-ego_mean0.1532480611910765
agent_compute-ego_median0.15913609504699708
agent_compute-ego_min0.14084962526957193
deviation-center-line_max1.4503169468836845
deviation-center-line_mean1.040886226280616
deviation-center-line_min0.20069940057969884
deviation-heading_max2.6888900490674037
deviation-heading_mean2.000082089080597
deviation-heading_median1.9457601790857144
deviation-heading_min0.8340957612187905
driven_any_max2.7577165661073884
driven_any_mean2.3011775189361527
driven_any_median2.7576610757744473
driven_any_min0.4841623546045137
driven_lanedir_consec_max2.717006161010834
driven_lanedir_consec_mean2.170840563780437
driven_lanedir_consec_min0.4631609731616342
driven_lanedir_max2.717006161010834
driven_lanedir_mean2.170840563780437
driven_lanedir_median2.52704957135005
driven_lanedir_min0.4631609731616342
in-drivable-lane_max1.2999999999999972
in-drivable-lane_mean0.4200000000000017
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.7486488307943393, "sim_physics": 0.14763400236765545, "survival_time": 14.950000000000076, "driven_lanedir": 2.52704957135005, "sim_render-ego": 0.07286841789881389, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.15913609504699708, "deviation-heading": 2.6013588954331675, "set_robot_commands": 0.1169973866144816, "deviation-center-line": 1.1375144144863911, "driven_lanedir_consec": 2.52704957135005, "sim_compute_sim_state": 0.04479247411092122, "sim_compute_performance-ego": 0.08160048246383667, "sim_compute_robot_state-ego": 0.09228695313135785}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.7576987674000755, "sim_physics": 0.15056438684463502, "survival_time": 14.950000000000076, "driven_lanedir": 2.6920614985589717, "sim_render-ego": 0.07275659084320069, "in-drivable-lane": 0, "agent_compute-ego": 0.1441075253486633, "deviation-heading": 2.6888900490674037, "set_robot_commands": 0.11862891912460329, "deviation-center-line": 1.1837467477087331, "driven_lanedir_consec": 2.6920614985589717, "sim_compute_sim_state": 0.04605876684188843, "sim_compute_performance-ego": 0.08314026753107706, "sim_compute_robot_state-ego": 0.094779687722524}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.7577165661073884, "sim_physics": 0.14840990622838338, "survival_time": 14.950000000000076, "driven_lanedir": 2.4549246148206967, "sim_render-ego": 0.07380793809890747, "in-drivable-lane": 1.2999999999999972, "agent_compute-ego": 0.16293227593104043, "deviation-heading": 1.9457601790857144, "set_robot_commands": 0.12021348476409913, "deviation-center-line": 1.4503169468836845, "driven_lanedir_consec": 2.4549246148206967, "sim_compute_sim_state": 0.04596478780110677, "sim_compute_performance-ego": 0.08225913127263387, "sim_compute_robot_state-ego": 0.09450051148732504}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4841623546045137, "sim_physics": 0.1652154223672275, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4631609731616342, "sim_render-ego": 0.08144224101099475, "in-drivable-lane": 0, "agent_compute-ego": 0.15921478435910982, "deviation-heading": 0.8340957612187905, "set_robot_commands": 0.11465135113946325, "deviation-center-line": 0.20069940057969884, "driven_lanedir_consec": 0.4631609731616342, "sim_compute_sim_state": 0.04651460976436221, "sim_compute_performance-ego": 0.08399782509639345, "sim_compute_robot_state-ego": 0.0952213797075995}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.7576610757744473, "sim_physics": 0.12119553963343302, "survival_time": 14.950000000000076, "driven_lanedir": 2.717006161010834, "sim_render-ego": 0.06266595125198364, "in-drivable-lane": 0, "agent_compute-ego": 0.14084962526957193, "deviation-heading": 1.930305560597908, "set_robot_commands": 0.1012347706158956, "deviation-center-line": 1.232153621744573, "driven_lanedir_consec": 2.717006161010834, "sim_compute_sim_state": 0.039297475814819335, "sim_compute_performance-ego": 0.06843873023986817, "sim_compute_robot_state-ego": 0.07805796066919962}}
set_robot_commands_max0.12021348476409913
set_robot_commands_mean0.11434518245170858
set_robot_commands_median0.1169973866144816
set_robot_commands_min0.1012347706158956
sim_compute_performance-ego_max0.08399782509639345
sim_compute_performance-ego_mean0.07988728732076185
sim_compute_performance-ego_median0.08225913127263387
sim_compute_performance-ego_min0.06843873023986817
sim_compute_robot_state-ego_max0.0952213797075995
sim_compute_robot_state-ego_mean0.0909692985436012
sim_compute_robot_state-ego_median0.09450051148732504
sim_compute_robot_state-ego_min0.07805796066919962
sim_compute_sim_state_max0.04651460976436221
sim_compute_sim_state_mean0.04452562286661958
sim_compute_sim_state_median0.04596478780110677
sim_compute_sim_state_min0.039297475814819335
sim_physics_max0.1652154223672275
sim_physics_mean0.14660385148826688
sim_physics_median0.14840990622838338
sim_physics_min0.12119553963343302
sim_render-ego_max0.08144224101099475
sim_render-ego_mean0.07270822782078008
sim_render-ego_median0.07286841789881389
sim_render-ego_min0.06266595125198364
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.540000000000065
survival_time_min2.8999999999999977
225813138AmaurXchallenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessyes12120:06:06(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.17048062553888635
agent_compute-ego_mean0.1474101082250907
agent_compute-ego_median0.13507676124572754
agent_compute-ego_min0.12897795789382038
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.10139943935253004, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.0543806376280608, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.13505340064013446, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08582089565418384, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03645882341596815, "sim_compute_performance-ego": 0.06320402357313368, "sim_compute_robot_state-ego": 0.06546010794462981}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.0984653678594851, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.05139619228886623, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.12897795789382038, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.07733060331905589, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03190155590281767, "sim_compute_performance-ego": 0.057512979881436214, "sim_compute_robot_state-ego": 0.05999171967599906}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.11788317736457377, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.0595393040600945, "in-drivable-lane": 0, "agent_compute-ego": 0.13507676124572754, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.0871419766369988, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.036165686214671415, "sim_compute_performance-ego": 0.06098752863266889, "sim_compute_robot_state-ego": 0.06391631855684168}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.1524586009979248, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06733570098876954, "in-drivable-lane": 0, "agent_compute-ego": 0.16746179580688478, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.10292929649353028, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.04309316635131836, "sim_compute_performance-ego": 0.08309941291809082, "sim_compute_robot_state-ego": 0.07628225326538086}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.13530708566496644, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06913551801367651, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.17048062553888635, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.10492769675918771, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.04231666915024383, "sim_compute_performance-ego": 0.07433714444124245, "sim_compute_robot_state-ego": 0.0847863607768771}}
set_robot_commands_max0.10492769675918771
set_robot_commands_mean0.0916300937725913
set_robot_commands_median0.0871419766369988
set_robot_commands_min0.07733060331905589
sim_compute_performance-ego_max0.08309941291809082
sim_compute_performance-ego_mean0.06782821788931441
sim_compute_performance-ego_median0.06320402357313368
sim_compute_performance-ego_min0.057512979881436214
sim_compute_robot_state-ego_max0.0847863607768771
sim_compute_robot_state-ego_mean0.0700873520439457
sim_compute_robot_state-ego_median0.06546010794462981
sim_compute_robot_state-ego_min0.05999171967599906
sim_compute_sim_state_max0.04309316635131836
sim_compute_sim_state_mean0.03798718020700389
sim_compute_sim_state_median0.03645882341596815
sim_compute_sim_state_min0.03190155590281767
sim_physics_max0.1524586009979248
sim_physics_mean0.12110273424789604
sim_physics_median0.11788317736457377
sim_physics_min0.0984653678594851
sim_render-ego_max0.06913551801367651
sim_render-ego_mean0.06035747059589351
sim_render-ego_median0.0595393040600945
sim_render-ego_min0.05139619228886623
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
225663158awoo424Roasted duckaido2-LF-sim-validationstep1-simulationhost-erroryes12120:15:33
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 544, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1123, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1358, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1405, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission3158/step1-simulation-ip-172-31-38-104-2553-job22566/tmp/tmpvjw9cucr/episodes/ETHZ_autolab_technical_track-0-0/drawing.html']' returned non-zero exit status 1.
(hidden)
225603174leohsu870325challenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessyes12120:06:03(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.16949484825134278
agent_compute-ego_mean0.1624513287457854
agent_compute-ego_median0.16387193810706044
agent_compute-ego_min0.1532816132412681
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.12578735969684743, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06575346876073766, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.15651861826578775, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09709229734208848, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03971276901386402, "sim_compute_performance-ego": 0.07336563975722701, "sim_compute_robot_state-ego": 0.07725495320779306}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.12035095457937205, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06960177421569824, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.16387193810706044, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.1063852777668074, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.04230789109772327, "sim_compute_performance-ego": 0.07489299306682512, "sim_compute_robot_state-ego": 0.08106566410438687}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.1322781338411219, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.06732386701247271, "in-drivable-lane": 0, "agent_compute-ego": 0.16908962586346796, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.10044306867262896, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.043311175178079045, "sim_compute_performance-ego": 0.07356774105745204, "sim_compute_robot_state-ego": 0.07930789274327896}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.14239834785461425, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06759527206420898, "in-drivable-lane": 0, "agent_compute-ego": 0.16949484825134278, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.10703473091125489, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.04400422096252441, "sim_compute_performance-ego": 0.07881162643432617, "sim_compute_robot_state-ego": 0.09141051292419432}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.11600844165946864, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06417218944694422, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.1532816132412681, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.09824956821489936, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03867932512790342, "sim_compute_performance-ego": 0.06952754153481013, "sim_compute_robot_state-ego": 0.07997568951377386}}
set_robot_commands_max0.10703473091125489
set_robot_commands_mean0.10184098858153584
set_robot_commands_median0.10044306867262896
set_robot_commands_min0.09709229734208848
sim_compute_performance-ego_max0.07881162643432617
sim_compute_performance-ego_mean0.07403310837012808
sim_compute_performance-ego_median0.07356774105745204
sim_compute_performance-ego_min0.06952754153481013
sim_compute_robot_state-ego_max0.09141051292419432
sim_compute_robot_state-ego_mean0.08180294249868543
sim_compute_robot_state-ego_median0.07997568951377386
sim_compute_robot_state-ego_min0.07725495320779306
sim_compute_sim_state_max0.04400422096252441
sim_compute_sim_state_mean0.04160307627601883
sim_compute_sim_state_median0.04230789109772327
sim_compute_sim_state_min0.03867932512790342
sim_physics_max0.14239834785461425
sim_physics_mean0.12736464752628485
sim_physics_median0.12578735969684743
sim_physics_min0.11600844165946864
sim_render-ego_max0.06960177421569824
sim_render-ego_mean0.06688931430001237
sim_render-ego_median0.06732386701247271
sim_render-ego_min0.06417218944694422
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
225553182jp18813100494First test - THaido2-LF-sim-testingstep1-simulationerroryes12120:02:37
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)