AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 1212

evaluator1212
ownerI don't have one 😀
machineip-172-31-38-104
processip-172-31-38-104-2553
versiond-c:4.0.30;d-c-r:4.0.44;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success14
# timeout
# failed3
# error16
# aborted
# host-error1
arm0
x86_641
Mac0
gpu available1
Number of processors4
Processor frequency (MHz)2.9 GHz
Free % of processors90%
RAM total (MB)60.0 GB
RAM free (MB)55.9 GB
Disk (MB)96.9 GB
Disk available (MB)51.5 GB
Docker Hub
P11
P2
Cloud simulations
PI Camera0
# Duckiebots0
Map 3x3 avaiable
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
230773557AmaurXRunning the real lane following -- without challenge containeraido2-LFVI-sim-validationstep1-simulationerroryes12120:06:28
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
230242373Liam Paullminimal_agent (Python 3)aido2-LFVI-sim-testingstep1-simulationerroryes12120:36:03
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
230152383Andrea CensiBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationsuccessyes12120:11:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.10428059192253292
survival_time_median1.2500000000000004
deviation-center-line_median0.07936613466003808
in-drivable-lane_median0


other stats
agent_compute-ego_max0.2084336280822754
agent_compute-ego_mean0.17403381717035848
agent_compute-ego_median0.17540610920299182
agent_compute-ego_min0.14380937576293945
deviation-center-line_max0.10272703984964908
deviation-center-line_mean0.0792710389609472
deviation-center-line_min0.05372540869577151
deviation-heading_max0.983790537404761
deviation-heading_mean0.6994363325894107
deviation-heading_median0.6989035152482008
deviation-heading_min0.4016956275046296
driven_any_max0.20010989224548495
driven_any_mean0.16588125117382843
driven_any_median0.17265714657329273
driven_any_min0.1171955527663396
driven_lanedir_consec_max0.14940053167912604
driven_lanedir_consec_mean0.10933807262861252
driven_lanedir_consec_min0.08839989225246858
driven_lanedir_max0.14940053167912604
driven_lanedir_mean0.10933807262861252
driven_lanedir_median0.10428059192253292
driven_lanedir_min0.08839989225246858
in-drivable-lane_max0.20000000000000015
in-drivable-lane_mean0.03333333333333336
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.20010989224548495, "sim_physics": 0.1213270902633667, "survival_time": 1.5000000000000009, "driven_lanedir": 0.10285229315714116, "sim_render-ego": 0.06052885055541992, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.16552804311116537, "deviation-heading": 0.9140550333307552, "set_robot_commands": 0.08969301382700602, "deviation-center-line": 0.08168360296955735, "driven_lanedir_consec": 0.10285229315714116, "sim_compute_sim_state": 0.03798608779907227, "sim_compute_performance-ego": 0.06797352631886801, "sim_compute_robot_state-ego": 0.07578190167744954}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.18107806636163273, "sim_physics": 0.11607463019234794, "survival_time": 1.4000000000000006, "driven_lanedir": 0.12043800905791736, "sim_render-ego": 0.06863565955843244, "in-drivable-lane": 0, "agent_compute-ego": 0.1982824206352234, "deviation-heading": 0.7712487918448322, "set_robot_commands": 0.10303521156311037, "deviation-center-line": 0.059131317015691534, "driven_lanedir_consec": 0.12043800905791736, "sim_compute_sim_state": 0.038783175604684014, "sim_compute_performance-ego": 0.07451236248016357, "sim_compute_robot_state-ego": 0.08344787359237671}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.13184971417811384, "sim_physics": 0.1254598617553711, "survival_time": 1.0000000000000002, "driven_lanedir": 0.09895993350908672, "sim_render-ego": 0.06232643127441406, "in-drivable-lane": 0, "agent_compute-ego": 0.17477222681045532, "deviation-heading": 0.531740237614201, "set_robot_commands": 0.09790593385696413, "deviation-center-line": 0.0940141159731376, "driven_lanedir_consec": 0.09895993350908672, "sim_compute_sim_state": 0.038166260719299315, "sim_compute_performance-ego": 0.0676892876625061, "sim_compute_robot_state-ego": 0.07170462608337402}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1812404310541112, "sim_physics": 0.12357416519751915, "survival_time": 1.3000000000000005, "driven_lanedir": 0.09809484417718028, "sim_render-ego": 0.06446795280163105, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16133971397693342, "deviation-heading": 0.965703276389937, "set_robot_commands": 0.09112234298999491, "deviation-center-line": 0.07334630883709879, "driven_lanedir_consec": 0.09809484417718028, "sim_compute_sim_state": 0.04019729907696064, "sim_compute_performance-ego": 0.06565613013047439, "sim_compute_robot_state-ego": 0.07225200763115516}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1925477082987218, "sim_physics": 0.1280030647913615, "survival_time": 1.5000000000000009, "driven_lanedir": 0.1013348986127922, "sim_render-ego": 0.06170070966084798, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.176191242535909, "deviation-heading": 0.7701779526212525, "set_robot_commands": 0.09572083155314128, "deviation-center-line": 0.05372540869577151, "driven_lanedir_consec": 0.1013348986127922, "sim_compute_sim_state": 0.037685585021972653, "sim_compute_performance-ego": 0.06886503696441651, "sim_compute_robot_state-ego": 0.0765953779220581}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.18823857404839703, "sim_physics": 0.1221635525043194, "survival_time": 1.3000000000000005, "driven_lanedir": 0.09477198322773184, "sim_render-ego": 0.05697897764352652, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1575079972927387, "deviation-heading": 0.983790537404761, "set_robot_commands": 0.08843066142155574, "deviation-center-line": 0.07936613466003808, "driven_lanedir_consec": 0.09477198322773184, "sim_compute_sim_state": 0.037076170627887435, "sim_compute_performance-ego": 0.06435611614814171, "sim_compute_robot_state-ego": 0.0692282456618089}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.18850139133140711, "sim_physics": 0.11551053183419364, "survival_time": 1.4000000000000006, "driven_lanedir": 0.14940053167912604, "sim_render-ego": 0.06412480558667864, "in-drivable-lane": 0, "agent_compute-ego": 0.18608662060328893, "deviation-heading": 0.6133669738911504, "set_robot_commands": 0.09424963167735508, "deviation-center-line": 0.09392024924656872, "driven_lanedir_consec": 0.14940053167912604, "sim_compute_sim_state": 0.043315589427948, "sim_compute_performance-ego": 0.06994354724884033, "sim_compute_robot_state-ego": 0.07387912273406982}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.13922272595685353, "sim_physics": 0.09016345796130952, "survival_time": 1.0500000000000005, "driven_lanedir": 0.10805874158674732, "sim_render-ego": 0.05619093350001744, "in-drivable-lane": 0, "agent_compute-ego": 0.1497732457660493, "deviation-heading": 0.5385473244988048, "set_robot_commands": 0.08005879038856142, "deviation-center-line": 0.09639142741423322, "driven_lanedir_consec": 0.10805874158674732, "sim_compute_sim_state": 0.0380602791195824, "sim_compute_performance-ego": 0.05934420086088635, "sim_compute_robot_state-ego": 0.07919289952232725}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.1634866702962657, "sim_physics": 0.1176256275177002, "survival_time": 1.2500000000000004, "driven_lanedir": 0.10428059192253292, "sim_render-ego": 0.05840845108032226, "in-drivable-lane": 0, "agent_compute-ego": 0.14380937576293945, "deviation-heading": 0.7774702391892943, "set_robot_commands": 0.0866249942779541, "deviation-center-line": 0.05921288522601169, "driven_lanedir_consec": 0.10428059192253292, "sim_compute_sim_state": 0.03625892639160156, "sim_compute_performance-ego": 0.06280597686767578, "sim_compute_robot_state-ego": 0.06793434143066407}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.17265714657329273, "sim_physics": 0.140498046875, "survival_time": 1.2500000000000004, "driven_lanedir": 0.13978711509620378, "sim_render-ego": 0.06597917556762695, "in-drivable-lane": 0, "agent_compute-ego": 0.1915570068359375, "deviation-heading": 0.5317335369151952, "set_robot_commands": 0.10791648864746094, "deviation-center-line": 0.08949622033015553, "driven_lanedir_consec": 0.13978711509620378, "sim_compute_sim_state": 0.04253448486328125, "sim_compute_performance-ego": 0.07227548599243164, "sim_compute_robot_state-ego": 0.0877345085144043}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.1221312044915672, "sim_physics": 0.13069139827381482, "survival_time": 1.1000000000000003, "driven_lanedir": 0.08839989225246858, "sim_render-ego": 0.06570257923819801, "in-drivable-lane": 0, "agent_compute-ego": 0.17540610920299182, "deviation-heading": 0.4938467230351188, "set_robot_commands": 0.10857991738752884, "deviation-center-line": 0.09589338449845664, "driven_lanedir_consec": 0.08839989225246858, "sim_compute_sim_state": 0.03962951356714422, "sim_compute_performance-ego": 0.06452368606220592, "sim_compute_robot_state-ego": 0.0752433104948564}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.14536883052622163, "sim_physics": 0.1329802533854609, "survival_time": 1.1500000000000004, "driven_lanedir": 0.1072577868586363, "sim_render-ego": 0.06298124271890392, "in-drivable-lane": 0, "agent_compute-ego": 0.1679181016009787, "deviation-heading": 0.614485932546386, "set_robot_commands": 0.1005407830943232, "deviation-center-line": 0.07445796346870431, "driven_lanedir_consec": 0.1072577868586363, "sim_compute_sim_state": 0.042998738910840904, "sim_compute_performance-ego": 0.06821710130442744, "sim_compute_robot_state-ego": 0.0723615314649499}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.19241161419966885, "sim_physics": 0.13629868112761398, "survival_time": 1.4500000000000006, "driven_lanedir": 0.11012864520571564, "sim_render-ego": 0.0720277161433779, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.2084336280822754, "deviation-heading": 0.884779286806642, "set_robot_commands": 0.11107226897930277, "deviation-center-line": 0.07386237622438972, "driven_lanedir_consec": 0.11012864520571564, "sim_compute_sim_state": 0.04149693456189386, "sim_compute_performance-ego": 0.07879477533800848, "sim_compute_robot_state-ego": 0.09638748497798524}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.17217924527934886, "sim_physics": 0.1257315774758657, "survival_time": 1.2000000000000004, "driven_lanedir": 0.12338416081967508, "sim_render-ego": 0.06523178021113078, "in-drivable-lane": 0, "agent_compute-ego": 0.17765655120213827, "deviation-heading": 0.6989035152482008, "set_robot_commands": 0.10077303647994997, "deviation-center-line": 0.06183715000474417, "driven_lanedir_consec": 0.12338416081967508, "sim_compute_sim_state": 0.03932098547617594, "sim_compute_performance-ego": 0.07522523403167725, "sim_compute_robot_state-ego": 0.07768439253171285}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.1171955527663396, "sim_physics": 0.11690206754775274, "survival_time": 1.0500000000000005, "driven_lanedir": 0.092921662266233, "sim_render-ego": 0.06224464234851655, "in-drivable-lane": 0, "agent_compute-ego": 0.17624497413635254, "deviation-heading": 0.4016956275046296, "set_robot_commands": 0.10098350615728469, "deviation-center-line": 0.10272703984964908, "driven_lanedir_consec": 0.092921662266233, "sim_compute_sim_state": 0.043930610020955406, "sim_compute_performance-ego": 0.06546643802097865, "sim_compute_robot_state-ego": 0.13983358655657088}}
set_robot_commands_max0.11107226897930277
set_robot_commands_mean0.09711382748676624
set_robot_commands_median0.09790593385696413
set_robot_commands_min0.08005879038856142
sim_compute_performance-ego_max0.07879477533800848
sim_compute_performance-ego_mean0.06837659369544681
sim_compute_performance-ego_median0.06797352631886801
sim_compute_performance-ego_min0.05934420086088635
sim_compute_robot_state-ego_max0.13983358655657088
sim_compute_robot_state-ego_mean0.08128408071971756
sim_compute_robot_state-ego_median0.07578190167744954
sim_compute_robot_state-ego_min0.06793434143066407
sim_compute_sim_state_max0.043930610020955406
sim_compute_sim_state_mean0.03982937607928665
sim_compute_sim_state_median0.03932098547617594
sim_compute_sim_state_min0.03625892639160156
sim_physics_max0.140498046875
sim_physics_mean0.1228669337801998
sim_physics_median0.12357416519751915
sim_physics_min0.09016345796130952
sim_render-ego_max0.0720277161433779
sim_render-ego_mean0.0631686605259363
sim_render-ego_median0.06298124271890392
sim_render-ego_min0.05619093350001744
simulation-passed1
survival_time_max1.5000000000000009
survival_time_mean1.2600000000000002
survival_time_min1.0000000000000002
230002402vguerraBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationsuccessyes12120:12:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07384245539307666
survival_time_median1.2500000000000004
deviation-center-line_median0.06129629209937979
in-drivable-lane_median0.10000000000000007


other stats
agent_compute-ego_max0.21473743604577103
agent_compute-ego_mean0.17403849545673902
agent_compute-ego_median0.17396066405556418
agent_compute-ego_min0.14278680086135864
deviation-center-line_max0.10463452649389111
deviation-center-line_mean0.06631176724701839
deviation-center-line_min0.02899641206291264
deviation-heading_max0.8421154151785527
deviation-heading_mean0.6651653308514553
deviation-heading_median0.6516655724600262
deviation-heading_min0.43800008900597226
driven_any_max0.20933027334969964
driven_any_mean0.15402345072704293
driven_any_median0.140177465042392
driven_any_min0.11001307896499384
driven_lanedir_consec_max0.10558253794669704
driven_lanedir_consec_mean0.07636009981704275
driven_lanedir_consec_min0.06208407563927665
driven_lanedir_max0.10558253794669704
driven_lanedir_mean0.07636009981704275
driven_lanedir_median0.07384245539307666
driven_lanedir_min0.06208407563927665
in-drivable-lane_max0.7000000000000006
in-drivable-lane_mean0.23666666666666689
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.20933027334969964, "sim_physics": 0.13321546827043806, "survival_time": 1.7500000000000009, "driven_lanedir": 0.0656903175899064, "sim_render-ego": 0.06772597857883998, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.1839298725128174, "deviation-heading": 0.7113627300300794, "set_robot_commands": 0.10345631326947892, "deviation-center-line": 0.06129629209937979, "driven_lanedir_consec": 0.0656903175899064, "sim_compute_sim_state": 0.042230081558227536, "sim_compute_performance-ego": 0.0728480202811105, "sim_compute_robot_state-ego": 0.08382556097848075}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1836751411645134, "sim_physics": 0.11917195175633286, "survival_time": 1.6500000000000008, "driven_lanedir": 0.07012978252520352, "sim_render-ego": 0.06432937853264087, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.17832115924719608, "deviation-heading": 0.6133815271377522, "set_robot_commands": 0.09649127902406636, "deviation-center-line": 0.02899641206291264, "driven_lanedir_consec": 0.07012978252520352, "sim_compute_sim_state": 0.04093242414069898, "sim_compute_performance-ego": 0.0710708372520678, "sim_compute_robot_state-ego": 0.080594489068696}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.11001307896499384, "sim_physics": 0.11718635559082032, "survival_time": 1.0000000000000002, "driven_lanedir": 0.07326677982026553, "sim_render-ego": 0.0629226803779602, "in-drivable-lane": 0, "agent_compute-ego": 0.17000824213027954, "deviation-heading": 0.593150384274204, "set_robot_commands": 0.09721889495849607, "deviation-center-line": 0.09034092845987364, "driven_lanedir_consec": 0.07326677982026553, "sim_compute_sim_state": 0.04045249223709106, "sim_compute_performance-ego": 0.07060298919677735, "sim_compute_robot_state-ego": 0.07143460512161255}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19918706130799696, "sim_physics": 0.124966202360211, "survival_time": 1.6500000000000008, "driven_lanedir": 0.07406890404771538, "sim_render-ego": 0.06533323634754527, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.17396066405556418, "deviation-heading": 0.8365736883208287, "set_robot_commands": 0.09572404803651752, "deviation-center-line": 0.05025707064245247, "driven_lanedir_consec": 0.07406890404771538, "sim_compute_sim_state": 0.039091247500795304, "sim_compute_performance-ego": 0.06820206931143095, "sim_compute_robot_state-ego": 0.07652029124173251}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.17895382527015097, "sim_physics": 0.10891495810614692, "survival_time": 1.800000000000001, "driven_lanedir": 0.06208407563927665, "sim_render-ego": 0.0586788190735711, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.1577324801021152, "deviation-heading": 0.6013700121647094, "set_robot_commands": 0.08959182765748766, "deviation-center-line": 0.033361912152579366, "driven_lanedir_consec": 0.06208407563927665, "sim_compute_sim_state": 0.03532114956114027, "sim_compute_performance-ego": 0.06516983111699422, "sim_compute_robot_state-ego": 0.06754748026529948}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.2079586789460103, "sim_physics": 0.1248425543308258, "survival_time": 1.6000000000000008, "driven_lanedir": 0.07066389004287732, "sim_render-ego": 0.06271616369485855, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.17941241711378098, "deviation-heading": 0.8421154151785527, "set_robot_commands": 0.09629464149475098, "deviation-center-line": 0.05855086020867172, "driven_lanedir_consec": 0.07066389004287732, "sim_compute_sim_state": 0.039028242230415344, "sim_compute_performance-ego": 0.07172425836324692, "sim_compute_robot_state-ego": 0.08450758457183838}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.140177465042392, "sim_physics": 0.1230799961090088, "survival_time": 1.2500000000000004, "driven_lanedir": 0.10558253794669704, "sim_render-ego": 0.06282269477844238, "in-drivable-lane": 0, "agent_compute-ego": 0.16885199546813964, "deviation-heading": 0.6107285462056107, "set_robot_commands": 0.09278315544128418, "deviation-center-line": 0.09201336979199956, "driven_lanedir_consec": 0.10558253794669704, "sim_compute_sim_state": 0.040288867950439455, "sim_compute_performance-ego": 0.07127076148986816, "sim_compute_robot_state-ego": 0.0857319164276123}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.12263577080685471, "sim_physics": 0.10157159566879272, "survival_time": 1.0000000000000002, "driven_lanedir": 0.08793450037576012, "sim_render-ego": 0.06342839002609253, "in-drivable-lane": 0, "agent_compute-ego": 0.15928304195404053, "deviation-heading": 0.5594777005777292, "set_robot_commands": 0.09211653470993042, "deviation-center-line": 0.08889676352749161, "driven_lanedir_consec": 0.08793450037576012, "sim_compute_sim_state": 0.03716362714767456, "sim_compute_performance-ego": 0.06515786647796631, "sim_compute_robot_state-ego": 0.07421598434448243}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.13836945619654736, "sim_physics": 0.0986503263314565, "survival_time": 1.2000000000000004, "driven_lanedir": 0.07464022856388075, "sim_render-ego": 0.05200392007827759, "in-drivable-lane": 0, "agent_compute-ego": 0.14278680086135864, "deviation-heading": 0.8211368328934245, "set_robot_commands": 0.08161914348602295, "deviation-center-line": 0.05403791885042908, "driven_lanedir_consec": 0.07464022856388075, "sim_compute_sim_state": 0.033071041107177734, "sim_compute_performance-ego": 0.056772579749425255, "sim_compute_robot_state-ego": 0.06229841709136963}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.12557273984910214, "sim_physics": 0.15592581292857294, "survival_time": 1.1500000000000004, "driven_lanedir": 0.07744915322449808, "sim_render-ego": 0.06751986171888269, "in-drivable-lane": 0, "agent_compute-ego": 0.21473743604577103, "deviation-heading": 0.6516655724600262, "set_robot_commands": 0.11061701567276663, "deviation-center-line": 0.08051928829336927, "driven_lanedir_consec": 0.07744915322449808, "sim_compute_sim_state": 0.039433406746905784, "sim_compute_performance-ego": 0.07069663379503333, "sim_compute_robot_state-ego": 0.09304376270460046}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.1174625666632272, "sim_physics": 0.12574004043232312, "survival_time": 1.1000000000000003, "driven_lanedir": 0.08587516092241176, "sim_render-ego": 0.06334490125829523, "in-drivable-lane": 0, "agent_compute-ego": 0.17636982961134476, "deviation-heading": 0.512956857957348, "set_robot_commands": 0.09638529474085028, "deviation-center-line": 0.09571401954632656, "driven_lanedir_consec": 0.08587516092241176, "sim_compute_sim_state": 0.03776762702248313, "sim_compute_performance-ego": 0.08299802650104869, "sim_compute_robot_state-ego": 0.08091053095730869}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.13095550729922498, "sim_physics": 0.14112178802490236, "survival_time": 1.2500000000000004, "driven_lanedir": 0.07384245539307666, "sim_render-ego": 0.0651930046081543, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.1876980781555176, "deviation-heading": 0.7175110092196466, "set_robot_commands": 0.10604693412780762, "deviation-center-line": 0.06717329332760248, "driven_lanedir_consec": 0.07384245539307666, "sim_compute_sim_state": 0.04110137939453125, "sim_compute_performance-ego": 0.07628146171569825, "sim_compute_robot_state-ego": 0.08425658226013183}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.1938183102535504, "sim_physics": 0.11268091201782228, "survival_time": 1.7000000000000008, "driven_lanedir": 0.06982655427380668, "sim_render-ego": 0.06122004284578211, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.16698809932259953, "deviation-heading": 0.6680181287359052, "set_robot_commands": 0.09298755842096663, "deviation-center-line": 0.04265143483271798, "driven_lanedir_consec": 0.06982655427380668, "sim_compute_sim_state": 0.038813450757194966, "sim_compute_performance-ego": 0.07103823914247401, "sim_compute_robot_state-ego": 0.0762264798669254}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.14170526005938627, "sim_physics": 0.12602609634399414, "survival_time": 1.2500000000000004, "driven_lanedir": 0.06925645603926789, "sim_render-ego": 0.0637918758392334, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.17721717834472656, "deviation-heading": 0.8000314686100403, "set_robot_commands": 0.1010504150390625, "deviation-center-line": 0.046232418415578576, "driven_lanedir_consec": 0.06925645603926789, "sim_compute_sim_state": 0.04268485069274902, "sim_compute_performance-ego": 0.07204590797424316, "sim_compute_robot_state-ego": 0.08372940063476562}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.1105366257319934, "sim_physics": 0.11853709675016856, "survival_time": 1.0500000000000005, "driven_lanedir": 0.08509070085099735, "sim_render-ego": 0.06033188956124442, "in-drivable-lane": 0, "agent_compute-ego": 0.17328013692583358, "deviation-heading": 0.43800008900597226, "set_robot_commands": 0.09574048859732492, "deviation-center-line": 0.10463452649389111, "driven_lanedir_consec": 0.08509070085099735, "sim_compute_sim_state": 0.0419075261978876, "sim_compute_performance-ego": 0.06914990288870675, "sim_compute_robot_state-ego": 0.07323111806597028}}
set_robot_commands_max0.11061701567276663
set_robot_commands_mean0.09654156964512092
set_robot_commands_median0.09629464149475098
set_robot_commands_min0.08161914348602295
sim_compute_performance-ego_max0.08299802650104869
sim_compute_performance-ego_mean0.07033529235040611
sim_compute_performance-ego_median0.07103823914247401
sim_compute_performance-ego_min0.056772579749425255
sim_compute_robot_state-ego_max0.09304376270460046
sim_compute_robot_state-ego_mean0.07853828024005509
sim_compute_robot_state-ego_median0.080594489068696
sim_compute_robot_state-ego_min0.06229841709136963
sim_compute_sim_state_max0.04268485069274902
sim_compute_sim_state_mean0.039285827616360805
sim_compute_sim_state_median0.039433406746905784
sim_compute_sim_state_min0.033071041107177734
sim_physics_max0.15592581292857294
sim_physics_mean0.1221087436681211
sim_physics_median0.1230799961090088
sim_physics_min0.0986503263314565
sim_render-ego_max0.06772597857883998
sim_render-ego_mean0.06275752248798804
sim_render-ego_median0.06334490125829523
sim_render-ego_min0.05200392007827759
simulation-passed1
survival_time_max1.800000000000001
survival_time_mean1.3600000000000003
survival_time_min1.0000000000000002
229962441Jacopo Tanirandom_agentaido2-LFV-sim-testingstep1-simulationerroryes12120:07:37
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
229672449enickyBaseline solution using reinforcement learningaido2-LFV-sim-validationstep1-simulationsuccessyes12120:37:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-1.339793520141566
survival_time_median14.950000000000076
deviation-center-line_median1.002134440312669
in-drivable-lane_median4.050000000000024


other stats
agent_compute-ego_max0.17760818878809612
agent_compute-ego_mean0.16918409411112467
agent_compute-ego_median0.17543508927027385
agent_compute-ego_min0.1554436500867208
deviation-center-line_max1.5296442653166566
deviation-center-line_mean0.925371790854924
deviation-center-line_min0.28261955257418875
deviation-heading_max8.558153948461722
deviation-heading_mean7.098260242116498
deviation-heading_median7.090641611385013
deviation-heading_min5.695926383403844
driven_any_max4.378506444052824
driven_any_mean4.378506444052815
driven_any_median4.378506444052811
driven_any_min4.378506444052806
driven_lanedir_consec_max-1.2728379671211965
driven_lanedir_consec_mean-1.3313530019797526
driven_lanedir_consec_min-1.3670015115194478
driven_lanedir_max-1.3662544443440128
driven_lanedir_mean-2.078199826147362
driven_lanedir_median-2.260637650975249
driven_lanedir_min-2.7107548643537447
in-drivable-lane_max7.400000000000039
in-drivable-lane_mean4.620000000000026
in-drivable-lane_min2.150000000000011
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378506444052806, "sim_physics": 0.15930531660715738, "survival_time": 14.950000000000076, "driven_lanedir": -2.7107548643537447, "sim_render-ego": 0.0561204727490743, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.1554436500867208, "deviation-heading": 8.372894374860635, "set_robot_commands": 0.08831639687220255, "deviation-center-line": 1.5195321274570266, "driven_lanedir_consec": -1.3108775667725403, "sim_compute_sim_state": 0.036106116771698, "sim_compute_performance-ego": 0.06124304215113322, "sim_compute_robot_state-ego": 0.06772487799326579, "sim_compute_robot_state-npc0": 0.06329822937647502, "sim_compute_robot_state-npc1": 0.06375563144683838, "sim_compute_robot_state-npc2": 0.06250531435012817, "sim_compute_robot_state-npc3": 0.06361708323160807}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378506444052822, "sim_physics": 0.17631556351979574, "survival_time": 14.950000000000076, "driven_lanedir": -2.686350659544358, "sim_render-ego": 0.06452457745869955, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.17760818878809612, "deviation-heading": 8.558153948461722, "set_robot_commands": 0.10279776811599732, "deviation-center-line": 1.5296442653166566, "driven_lanedir_consec": -1.2728379671211965, "sim_compute_sim_state": 0.04044605493545532, "sim_compute_performance-ego": 0.07125105698903401, "sim_compute_robot_state-ego": 0.07680485963821411, "sim_compute_robot_state-npc0": 0.07230649868647257, "sim_compute_robot_state-npc1": 0.06985526402791341, "sim_compute_robot_state-npc2": 0.07138206720352173, "sim_compute_robot_state-npc3": 0.07116465012232463}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.378506444052811, "sim_physics": 0.15075119654337563, "survival_time": 14.950000000000076, "driven_lanedir": -1.3662544443440128, "sim_render-ego": 0.05544922351837158, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.16020708163579306, "deviation-heading": 5.773684892471282, "set_robot_commands": 0.08860307296117147, "deviation-center-line": 0.2929285686140787, "driven_lanedir_consec": -1.3662544443440128, "sim_compute_sim_state": 0.03490424950917562, "sim_compute_performance-ego": 0.06210956494013469, "sim_compute_robot_state-ego": 0.06950921138127644, "sim_compute_robot_state-npc0": 0.06372496922810872, "sim_compute_robot_state-npc1": 0.06258289337158203, "sim_compute_robot_state-npc2": 0.0655500070254008, "sim_compute_robot_state-npc3": 0.06291889031728108}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378506444052824, "sim_physics": 0.18114449739456176, "survival_time": 14.950000000000076, "driven_lanedir": -1.3670015115194478, "sim_render-ego": 0.06426085392634073, "in-drivable-lane": 7.400000000000039, "agent_compute-ego": 0.17722646077473958, "deviation-heading": 5.695926383403844, "set_robot_commands": 0.0997756584485372, "deviation-center-line": 0.28261955257418875, "driven_lanedir_consec": -1.3670015115194478, "sim_compute_sim_state": 0.04081124782562256, "sim_compute_performance-ego": 0.07019739548365275, "sim_compute_robot_state-ego": 0.07941562493642171, "sim_compute_robot_state-npc0": 0.07113632520039877, "sim_compute_robot_state-npc1": 0.07129664182662963, "sim_compute_robot_state-npc2": 0.07059564749399821, "sim_compute_robot_state-npc3": 0.07108986059824626}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.37850644405281, "sim_physics": 0.1868092370033264, "survival_time": 14.950000000000076, "driven_lanedir": -2.260637650975249, "sim_render-ego": 0.06470041513442994, "in-drivable-lane": 4.050000000000024, "agent_compute-ego": 0.17543508927027385, "deviation-heading": 7.090641611385013, "set_robot_commands": 0.10028167327245076, "deviation-center-line": 1.002134440312669, "driven_lanedir_consec": -1.339793520141566, "sim_compute_sim_state": 0.0403075385093689, "sim_compute_performance-ego": 0.07050856113433839, "sim_compute_robot_state-ego": 0.07613191286722819, "sim_compute_robot_state-npc0": 0.0727270221710205, "sim_compute_robot_state-npc1": 0.07174268563588461, "sim_compute_robot_state-npc2": 0.07130134423573811, "sim_compute_robot_state-npc3": 0.07214120308558146}}
set_robot_commands_max0.10279776811599732
set_robot_commands_mean0.09595491393407186
set_robot_commands_median0.0997756584485372
set_robot_commands_min0.08831639687220255
sim_compute_performance-ego_max0.07125105698903401
sim_compute_performance-ego_mean0.06706192413965863
sim_compute_performance-ego_median0.07019739548365275
sim_compute_performance-ego_min0.06124304215113322
sim_compute_robot_state-ego_max0.07941562493642171
sim_compute_robot_state-ego_mean0.07391729736328126
sim_compute_robot_state-ego_median0.07613191286722819
sim_compute_robot_state-ego_min0.06772487799326579
sim_compute_robot_state-npc0_max0.0727270221710205
sim_compute_robot_state-npc0_mean0.06863860893249511
sim_compute_robot_state-npc0_median0.07113632520039877
sim_compute_robot_state-npc0_min0.06329822937647502
sim_compute_robot_state-npc1_max0.07174268563588461
sim_compute_robot_state-npc1_mean0.06784662326176961
sim_compute_robot_state-npc1_median0.06985526402791341
sim_compute_robot_state-npc1_min0.06258289337158203
sim_compute_robot_state-npc2_max0.07138206720352173
sim_compute_robot_state-npc2_mean0.06826687606175741
sim_compute_robot_state-npc2_median0.07059564749399821
sim_compute_robot_state-npc2_min0.06250531435012817
sim_compute_robot_state-npc3_max0.07214120308558146
sim_compute_robot_state-npc3_mean0.0681863374710083
sim_compute_robot_state-npc3_median0.07108986059824626
sim_compute_robot_state-npc3_min0.06291889031728108
sim_compute_sim_state_max0.04081124782562256
sim_compute_sim_state_mean0.03851504151026408
sim_compute_sim_state_median0.0403075385093689
sim_compute_sim_state_min0.03490424950917562
sim_physics_max0.1868092370033264
sim_physics_mean0.1708651622136434
sim_physics_median0.17631556351979574
sim_physics_min0.15075119654337563
sim_render-ego_max0.06470041513442994
sim_render-ego_mean0.06101110855738322
sim_render-ego_median0.06426085392634073
sim_render-ego_min0.05544922351837158
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
229532468Liam Paullchallenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessyes12120:05:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.1570279598236084
agent_compute-ego_mean0.15260445708878195
agent_compute-ego_median0.15544038482859163
agent_compute-ego_min0.13959382562076345
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.12047180423030147, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06215539243486193, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.15603367487589517, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09759471151563856, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.0385628585462217, "sim_compute_performance-ego": 0.06907831297980414, "sim_compute_robot_state-ego": 0.07306526325367114}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.11494292464910769, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.0641476547016817, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15492644029505112, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.09578528591230805, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03816442863613952, "sim_compute_performance-ego": 0.06867548998664408, "sim_compute_robot_state-ego": 0.07797761524424833}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.14162836355321548, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.05889111406662885, "in-drivable-lane": 0, "agent_compute-ego": 0.13959382562076345, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.09761320843416102, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.04273867607116699, "sim_compute_performance-ego": 0.06678436784183278, "sim_compute_robot_state-ego": 0.07216238975524902}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.13000476837158204, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06034914970397949, "in-drivable-lane": 0, "agent_compute-ego": 0.1570279598236084, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.09556358337402344, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.04058761596679687, "sim_compute_performance-ego": 0.0654416561126709, "sim_compute_robot_state-ego": 0.06908664703369141}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.1170202750193922, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06339145008521745, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.15544038482859163, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.09794910044609746, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03860443151449856, "sim_compute_performance-ego": 0.06968527504160435, "sim_compute_robot_state-ego": 0.07554328894313378}}
set_robot_commands_max0.09794910044609746
set_robot_commands_mean0.0969011779364457
set_robot_commands_median0.09759471151563856
set_robot_commands_min0.09556358337402344
sim_compute_performance-ego_max0.06968527504160435
sim_compute_performance-ego_mean0.06793302039251126
sim_compute_performance-ego_median0.06867548998664408
sim_compute_performance-ego_min0.0654416561126709
sim_compute_robot_state-ego_max0.07797761524424833
sim_compute_robot_state-ego_mean0.07356704084599874
sim_compute_robot_state-ego_median0.07306526325367114
sim_compute_robot_state-ego_min0.06908664703369141
sim_compute_sim_state_max0.04273867607116699
sim_compute_sim_state_mean0.03973160214696473
sim_compute_sim_state_median0.03860443151449856
sim_compute_sim_state_min0.03816442863613952
sim_physics_max0.14162836355321548
sim_physics_mean0.12481362716471978
sim_physics_median0.12047180423030147
sim_physics_min0.11494292464910769
sim_render-ego_max0.0641476547016817
sim_render-ego_mean0.061786952198473875
sim_render-ego_median0.06215539243486193
sim_render-ego_min0.05889111406662885
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
229522479Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerroryes12120:00:45
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
229442487Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerroryes12120:00:59
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
229272510RamiNaimchallenge-aido_LF-template-rosaido2-LFV-sim-testingstep1-simulationerroryes12120:01:47
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
229082537Liam Paullbaseline-IL-sim-tensorflowaido2-LFVI-sim-validationstep1-simulationerroryes12120:04:00
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
229022544Liam Paullchallenge-aido_LF-template-rosaido2-LF-sim-testingstep1-simulationerroryes12120:03:48
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
228972556Andrea Censichallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-validationstep1-simulationsuccessyes12120:09:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4702323960536803
survival_time_median2.849999999999998
deviation-center-line_median0.13623952041905
in-drivable-lane_median0.7999999999999976


other stats
agent_compute-ego_max0.07947047551472981
agent_compute-ego_mean0.07670751847270899
agent_compute-ego_median0.07693704580649352
agent_compute-ego_min0.07438852700842433
deviation-center-line_max0.2701922695523504
deviation-center-line_mean0.16546426353561405
deviation-center-line_min0.07144385614371519
deviation-heading_max1.2111022380750738
deviation-heading_mean0.8262001110734373
deviation-heading_median0.7978002362162198
deviation-heading_min0.39989969254594865
driven_any_max1.093753441791869
driven_any_mean0.7182169120135662
driven_any_median0.8072381933001392
driven_any_min0.29795781475632777
driven_lanedir_consec_max0.6735785385729686
driven_lanedir_consec_mean0.4271077107010905
driven_lanedir_consec_min0.2312609677194346
driven_lanedir_max0.6758329617605024
driven_lanedir_mean0.4275585953385973
driven_lanedir_median0.4702323960536803
driven_lanedir_min0.2312609677194346
in-drivable-lane_max1.6499999999999957
in-drivable-lane_mean0.7199999999999979
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.093753441791869, "sim_physics": 0.2180842750043754, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.06498289108276367, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.07438852700842433, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.09960337144782744, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.04021551810115217, "sim_compute_performance-ego": 0.07071536420339561, "sim_compute_robot_state-ego": 0.07867743021034333, "sim_compute_robot_state-npc0": 0.06966453575226197, "sim_compute_robot_state-npc1": 0.07202037271246853, "sim_compute_robot_state-npc2": 0.07048561486853175, "sim_compute_robot_state-npc3": 0.07175633706242206}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.23419801394144693, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.07497431613780835, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07947047551472981, "deviation-heading": 0.6953408166028192, "set_robot_commands": 0.10322391545331036, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.04115447291621455, "sim_compute_performance-ego": 0.07563923023365161, "sim_compute_robot_state-ego": 0.0837210460945412, "sim_compute_robot_state-npc0": 0.07219280136956109, "sim_compute_robot_state-npc1": 0.07234955717016149, "sim_compute_robot_state-npc2": 0.07224317833229348, "sim_compute_robot_state-npc3": 0.07302203884831181}, "udem1-2-0": {"driven_any": 1.080947789080493, "sim_physics": 0.22693801537538183, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.06553276074238312, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.07693704580649352, "deviation-heading": 1.0268575719271242, "set_robot_commands": 0.10373496397947654, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.04136441609798334, "sim_compute_performance-ego": 0.07003900637993446, "sim_compute_robot_state-ego": 0.07681498160729042, "sim_compute_robot_state-npc0": 0.07362800378065842, "sim_compute_robot_state-npc1": 0.07094733531658466, "sim_compute_robot_state-npc2": 0.06934565458542262, "sim_compute_robot_state-npc3": 0.0729594933680999}, "udem1-3-0": {"driven_any": 0.8072381933001392, "sim_physics": 0.22432849699990792, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.0643339617210522, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.07553194698534514, "deviation-heading": 0.7978002362162198, "set_robot_commands": 0.09718615130374306, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.041646204496684824, "sim_compute_performance-ego": 0.07171636715269926, "sim_compute_robot_state-ego": 0.07853677816558302, "sim_compute_robot_state-npc0": 0.06986741434063828, "sim_compute_robot_state-npc1": 0.0708393883286861, "sim_compute_robot_state-npc2": 0.07449873706750702, "sim_compute_robot_state-npc3": 0.07430856269702577}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.2259759073672087, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.06827860293181046, "in-drivable-lane": 0, "agent_compute-ego": 0.07720959704855214, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.1183008629342784, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.041218809459520424, "sim_compute_performance-ego": 0.07497413262077, "sim_compute_robot_state-ego": 0.0810992199441661, "sim_compute_robot_state-npc0": 0.07212180676667587, "sim_compute_robot_state-npc1": 0.07123091946477475, "sim_compute_robot_state-npc2": 0.07385125367537788, "sim_compute_robot_state-npc3": 0.07290289712988812}}
set_robot_commands_max0.1183008629342784
set_robot_commands_mean0.10440985302372716
set_robot_commands_median0.10322391545331036
set_robot_commands_min0.09718615130374306
sim_compute_performance-ego_max0.07563923023365161
sim_compute_performance-ego_mean0.0726168201180902
sim_compute_performance-ego_median0.07171636715269926
sim_compute_performance-ego_min0.07003900637993446
sim_compute_robot_state-ego_max0.0837210460945412
sim_compute_robot_state-ego_mean0.07976989120438482
sim_compute_robot_state-ego_median0.07867743021034333
sim_compute_robot_state-ego_min0.07681498160729042
sim_compute_robot_state-npc0_max0.07362800378065842
sim_compute_robot_state-npc0_mean0.07149491240195913
sim_compute_robot_state-npc0_median0.07212180676667587
sim_compute_robot_state-npc0_min0.06966453575226197
sim_compute_robot_state-npc1_max0.07234955717016149
sim_compute_robot_state-npc1_mean0.0714775145985351
sim_compute_robot_state-npc1_median0.07123091946477475
sim_compute_robot_state-npc1_min0.0708393883286861
sim_compute_robot_state-npc2_max0.07449873706750702
sim_compute_robot_state-npc2_mean0.07208488770582655
sim_compute_robot_state-npc2_median0.07224317833229348
sim_compute_robot_state-npc2_min0.06934565458542262
sim_compute_robot_state-npc3_max0.07430856269702577
sim_compute_robot_state-npc3_mean0.07298986582114954
sim_compute_robot_state-npc3_median0.0729594933680999
sim_compute_robot_state-npc3_min0.07175633706242206
sim_compute_sim_state_max0.041646204496684824
sim_compute_sim_state_mean0.04111988421431106
sim_compute_sim_state_median0.041218809459520424
sim_compute_sim_state_min0.04021551810115217
sim_physics_max0.23419801394144693
sim_physics_mean0.22590494173766415
sim_physics_median0.2259759073672087
sim_physics_min0.2180842750043754
sim_render-ego_max0.07497431613780835
sim_render-ego_mean0.06762050652316356
sim_render-ego_median0.06553276074238312
sim_render-ego_min0.0643339617210522
simulation-passed1
survival_time_max4.149999999999993
survival_time_mean2.679999999999997
survival_time_min1.1500000000000004
228772591Julian Zillybaseline-IL-logs-tensorflowaido2-LFV-sim-validationstep1-simulationsuccessyes12120:15:40Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2716987056833706
survival_time_median5.549999999999988
deviation-center-line_median0.3825070516652597
in-drivable-lane_median0


other stats
agent_compute-ego_max0.25023627512663316
agent_compute-ego_mean0.2376359821553382
agent_compute-ego_median0.2456103863923446
agent_compute-ego_min0.20340194071040435
deviation-center-line_max0.4816531256795156
deviation-center-line_mean0.3805850415107731
deviation-center-line_min0.2369383924787904
deviation-heading_max3.023647190428616
deviation-heading_mean2.154979094098645
deviation-heading_median2.051768785026961
deviation-heading_min1.3552476241138214
driven_any_max0.33368102835532826
driven_any_mean0.28966190228764976
driven_any_median0.3129605979752506
driven_any_min0.18772401300848413
driven_lanedir_consec_max0.2849993772364474
driven_lanedir_consec_mean0.24876042203899495
driven_lanedir_consec_min0.14610094523670614
driven_lanedir_max0.2849993772364474
driven_lanedir_mean0.24876042203899495
driven_lanedir_median0.2716987056833706
driven_lanedir_min0.14610094523670614
in-drivable-lane_max0.14999999999999947
in-drivable-lane_mean0.04999999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.33368102835532826, "sim_physics": 0.1898908389834907, "survival_time": 6.349999999999985, "driven_lanedir": 0.27842869636457834, "sim_render-ego": 0.06543387202765998, "in-drivable-lane": 0, "agent_compute-ego": 0.2432498143413874, "deviation-heading": 3.023647190428616, "set_robot_commands": 0.09883700956509808, "deviation-center-line": 0.3825070516652597, "driven_lanedir_consec": 0.27842869636457834, "sim_compute_sim_state": 0.03991235710504487, "sim_compute_performance-ego": 0.07188717774518831, "sim_compute_robot_state-ego": 0.0773239116969071, "sim_compute_robot_state-npc0": 0.07258654579402894, "sim_compute_robot_state-npc1": 0.07065843409440649, "sim_compute_robot_state-npc2": 0.07024664766206516, "sim_compute_robot_state-npc3": 0.07015184717854177}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3234989464631947, "sim_physics": 0.1944331044736116, "survival_time": 5.749999999999988, "driven_lanedir": 0.2716987056833706, "sim_render-ego": 0.06403819374416185, "in-drivable-lane": 0, "agent_compute-ego": 0.2456103863923446, "deviation-heading": 2.9516979608490947, "set_robot_commands": 0.10243547895680304, "deviation-center-line": 0.36952628179764974, "driven_lanedir_consec": 0.2716987056833706, "sim_compute_sim_state": 0.03993908633356509, "sim_compute_performance-ego": 0.07160118973773459, "sim_compute_robot_state-ego": 0.08010525288789169, "sim_compute_robot_state-npc0": 0.07195747624272886, "sim_compute_robot_state-npc1": 0.07151248351387356, "sim_compute_robot_state-npc2": 0.0718862886014192, "sim_compute_robot_state-npc3": 0.07050861068393872}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3129605979752506, "sim_physics": 0.20230487660244775, "survival_time": 5.549999999999988, "driven_lanedir": 0.2849993772364474, "sim_render-ego": 0.06597895880003234, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.2456814942059216, "deviation-heading": 1.3552476241138214, "set_robot_commands": 0.10041196926220045, "deviation-center-line": 0.4816531256795156, "driven_lanedir_consec": 0.2849993772364474, "sim_compute_sim_state": 0.044136247119388065, "sim_compute_performance-ego": 0.07298279452968288, "sim_compute_robot_state-ego": 0.0794684006287171, "sim_compute_robot_state-npc0": 0.07133124970101021, "sim_compute_robot_state-npc1": 0.07287371910370148, "sim_compute_robot_state-npc2": 0.07186140455641188, "sim_compute_robot_state-npc3": 0.07545925905038645}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2904449256359914, "sim_physics": 0.19410169008866096, "survival_time": 5.14999999999999, "driven_lanedir": 0.26257438567387226, "sim_render-ego": 0.06604429124628455, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.25023627512663316, "deviation-heading": 1.3925339100747296, "set_robot_commands": 0.1019030033963398, "deviation-center-line": 0.4323003559326501, "driven_lanedir_consec": 0.26257438567387226, "sim_compute_sim_state": 0.0417030204847021, "sim_compute_performance-ego": 0.07193489908014686, "sim_compute_robot_state-ego": 0.07621604493520792, "sim_compute_robot_state-npc0": 0.07245466315630571, "sim_compute_robot_state-npc1": 0.07080532509146385, "sim_compute_robot_state-npc2": 0.07229428846859237, "sim_compute_robot_state-npc3": 0.07282901967613442}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.18772401300848413, "sim_physics": 0.15728559914757223, "survival_time": 3.399999999999996, "driven_lanedir": 0.14610094523670614, "sim_render-ego": 0.05499461468528299, "in-drivable-lane": 0, "agent_compute-ego": 0.20340194071040435, "deviation-heading": 2.051768785026961, "set_robot_commands": 0.10447345761691824, "deviation-center-line": 0.2369383924787904, "driven_lanedir_consec": 0.14610094523670614, "sim_compute_sim_state": 0.034772452186135686, "sim_compute_performance-ego": 0.059914659051334154, "sim_compute_robot_state-ego": 0.06630083392648135, "sim_compute_robot_state-npc0": 0.061277561327990365, "sim_compute_robot_state-npc1": 0.059757688466240376, "sim_compute_robot_state-npc2": 0.05914246685364667, "sim_compute_robot_state-npc3": 0.08332260566599228}}
set_robot_commands_max0.10447345761691824
set_robot_commands_mean0.1016121837594719
set_robot_commands_median0.1019030033963398
set_robot_commands_min0.09883700956509808
sim_compute_performance-ego_max0.07298279452968288
sim_compute_performance-ego_mean0.06966414402881736
sim_compute_performance-ego_median0.07188717774518831
sim_compute_performance-ego_min0.059914659051334154
sim_compute_robot_state-ego_max0.08010525288789169
sim_compute_robot_state-ego_mean0.07588288881504103
sim_compute_robot_state-ego_median0.0773239116969071
sim_compute_robot_state-ego_min0.06630083392648135
sim_compute_robot_state-npc0_max0.07258654579402894
sim_compute_robot_state-npc0_mean0.06992149924441282
sim_compute_robot_state-npc0_median0.07195747624272886
sim_compute_robot_state-npc0_min0.061277561327990365
sim_compute_robot_state-npc1_max0.07287371910370148
sim_compute_robot_state-npc1_mean0.06912153005393715
sim_compute_robot_state-npc1_median0.07080532509146385
sim_compute_robot_state-npc1_min0.059757688466240376
sim_compute_robot_state-npc2_max0.07229428846859237
sim_compute_robot_state-npc2_mean0.06908621922842706
sim_compute_robot_state-npc2_median0.07186140455641188
sim_compute_robot_state-npc2_min0.05914246685364667
sim_compute_robot_state-npc3_max0.08332260566599228
sim_compute_robot_state-npc3_mean0.07445426845099871
sim_compute_robot_state-npc3_median0.07282901967613442
sim_compute_robot_state-npc3_min0.07015184717854177
sim_compute_sim_state_max0.044136247119388065
sim_compute_sim_state_mean0.04009263264576716
sim_compute_sim_state_median0.03993908633356509
sim_compute_sim_state_min0.034772452186135686
sim_physics_max0.20230487660244775
sim_physics_mean0.18760322185915665
sim_physics_median0.19410169008866096
sim_physics_min0.15728559914757223
sim_render-ego_max0.06604429124628455
sim_render-ego_mean0.06329798610068434
sim_render-ego_median0.06543387202765998
sim_render-ego_min0.05499461468528299
simulation-passed1
survival_time_max6.349999999999985
survival_time_mean5.2399999999999896
survival_time_min3.399999999999996
228573545MYFtestaido2-LF-sim-validationstep1-simulationsuccessyes12120:21:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.0052202182071666
survival_time_median14.950000000000076
deviation-center-line_median0.7414558758082337
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1718784467379252
agent_compute-ego_mean0.16601531662914035
agent_compute-ego_median0.1638468631108602
agent_compute-ego_min0.16144777218500772
deviation-center-line_max0.9279996756537554
deviation-center-line_mean0.6177392559881539
deviation-center-line_min0.2153861588676305
deviation-heading_max2.5063174546082108
deviation-heading_mean1.7203132438004751
deviation-heading_median1.900056984307934
deviation-heading_min0.7766631760452164
driven_any_max3.4140768506553543
driven_any_mean2.6684903275050127
driven_any_median3.069559776329662
driven_any_min0.5746353847318589
driven_lanedir_consec_max3.400084363534463
driven_lanedir_consec_mean2.626256715390884
driven_lanedir_consec_min0.5465844479731508
driven_lanedir_max3.400084363534463
driven_lanedir_mean2.626256715390884
driven_lanedir_median3.0052202182071666
driven_lanedir_min0.5465844479731508
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5746353847318589, "sim_physics": 0.1363207566536079, "survival_time": 2.9499999999999975, "driven_lanedir": 0.5465844479731508, "sim_render-ego": 0.06679500563670013, "in-drivable-lane": 0, "agent_compute-ego": 0.17102331630254197, "deviation-heading": 0.7766631760452164, "set_robot_commands": 0.10417094473111428, "deviation-center-line": 0.2153861588676305, "driven_lanedir_consec": 0.5465844479731508, "sim_compute_sim_state": 0.04271188428846456, "sim_compute_performance-ego": 0.07558435908818649, "sim_compute_robot_state-ego": 0.08617521544634285}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.4140768506553543, "sim_physics": 0.11608511209487916, "survival_time": 14.950000000000076, "driven_lanedir": 3.400084363534463, "sim_render-ego": 0.06203450123469035, "in-drivable-lane": 0, "agent_compute-ego": 0.1638468631108602, "deviation-heading": 0.9231899677667084, "set_robot_commands": 0.09747806708017984, "deviation-center-line": 0.4444918816021941, "driven_lanedir_consec": 3.400084363534463, "sim_compute_sim_state": 0.03966408491134644, "sim_compute_performance-ego": 0.07101794242858887, "sim_compute_robot_state-ego": 0.07655898888905843}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.226014665040336, "sim_physics": 0.1135930879910787, "survival_time": 14.950000000000076, "driven_lanedir": 3.181628412694986, "sim_render-ego": 0.06395241181055705, "in-drivable-lane": 0, "agent_compute-ego": 0.16188018480936686, "deviation-heading": 1.900056984307934, "set_robot_commands": 0.09963079373041787, "deviation-center-line": 0.7414558758082337, "driven_lanedir_consec": 3.181628412694986, "sim_compute_sim_state": 0.03924352407455444, "sim_compute_performance-ego": 0.07078989267349244, "sim_compute_robot_state-ego": 0.07672710259755453}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.0581649607678525, "sim_physics": 0.1210203242301941, "survival_time": 14.950000000000076, "driven_lanedir": 2.9977661345446527, "sim_render-ego": 0.06466678619384765, "in-drivable-lane": 0, "agent_compute-ego": 0.1718784467379252, "deviation-heading": 2.5063174546082108, "set_robot_commands": 0.10123417854309082, "deviation-center-line": 0.9279996756537554, "driven_lanedir_consec": 2.9977661345446527, "sim_compute_sim_state": 0.040228111743927, "sim_compute_performance-ego": 0.07090488115946451, "sim_compute_robot_state-ego": 0.07676643610000611}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.069559776329662, "sim_physics": 0.10988730510075886, "survival_time": 14.950000000000076, "driven_lanedir": 3.0052202182071666, "sim_render-ego": 0.0612392274538676, "in-drivable-lane": 0, "agent_compute-ego": 0.16144777218500772, "deviation-heading": 2.495338636274308, "set_robot_commands": 0.09840897719065347, "deviation-center-line": 0.7593626880089561, "driven_lanedir_consec": 3.0052202182071666, "sim_compute_sim_state": 0.03872402747472127, "sim_compute_performance-ego": 0.06977233568827311, "sim_compute_robot_state-ego": 0.07653978506724039}}
set_robot_commands_max0.10417094473111428
set_robot_commands_mean0.10018459225509128
set_robot_commands_median0.09963079373041787
set_robot_commands_min0.09747806708017984
sim_compute_performance-ego_max0.07558435908818649
sim_compute_performance-ego_mean0.07161388220760109
sim_compute_performance-ego_median0.07090488115946451
sim_compute_performance-ego_min0.06977233568827311
sim_compute_robot_state-ego_max0.08617521544634285
sim_compute_robot_state-ego_mean0.07855350562004046
sim_compute_robot_state-ego_median0.07672710259755453
sim_compute_robot_state-ego_min0.07653978506724039
sim_compute_sim_state_max0.04271188428846456
sim_compute_sim_state_mean0.040114326498602734
sim_compute_sim_state_median0.03966408491134644
sim_compute_sim_state_min0.03872402747472127
sim_physics_max0.1363207566536079
sim_physics_mean0.11938131721410376
sim_physics_median0.11608511209487916
sim_physics_min0.10988730510075886
sim_render-ego_max0.06679500563670013
sim_render-ego_mean0.06373758646593256
sim_render-ego_median0.06395241181055705
sim_render-ego_min0.0612392274538676
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.55000000000006
survival_time_min2.9499999999999975
228482629Andrea Censichallenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessyes12120:06:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.18766229292925665
agent_compute-ego_mean0.16317689608173125
agent_compute-ego_median0.1705010555408619
agent_compute-ego_min0.12883242906308642
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.14331129303684942, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06838876671261257, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1705010555408619, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10793493853674994, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.044860239382143376, "sim_compute_performance-ego": 0.07827019249951397, "sim_compute_robot_state-ego": 0.08567876727492721}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.08812790290982116, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.05095531426224054, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.12883242906308642, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.0776521084355373, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03218628378475413, "sim_compute_performance-ego": 0.056440905028698495, "sim_compute_robot_state-ego": 0.05984825713961732}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.1572107006521786, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.07058393253999598, "in-drivable-lane": 0, "agent_compute-ego": 0.18766229292925665, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.11619165364433735, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.04470755072200999, "sim_compute_performance-ego": 0.07834801954381607, "sim_compute_robot_state-ego": 0.08632225148818072}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.13496453285217286, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06836645126342773, "in-drivable-lane": 0, "agent_compute-ego": 0.1715410327911377, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.10499053955078123, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.04240708351135254, "sim_compute_performance-ego": 0.07340540885925292, "sim_compute_robot_state-ego": 0.08164941787719726}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.11228391188609448, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06396482262430311, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.1573476700843135, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.09747114664391626, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03971879391730586, "sim_compute_performance-ego": 0.06936446322670466, "sim_compute_robot_state-ego": 0.07422382016725178}}
set_robot_commands_max0.11619165364433735
set_robot_commands_mean0.10084807736226442
set_robot_commands_median0.10499053955078123
set_robot_commands_min0.0776521084355373
sim_compute_performance-ego_max0.07834801954381607
sim_compute_performance-ego_mean0.07116579783159722
sim_compute_performance-ego_median0.07340540885925292
sim_compute_performance-ego_min0.056440905028698495
sim_compute_robot_state-ego_max0.08632225148818072
sim_compute_robot_state-ego_mean0.07754450278943485
sim_compute_robot_state-ego_median0.08164941787719726
sim_compute_robot_state-ego_min0.05984825713961732
sim_compute_sim_state_max0.044860239382143376
sim_compute_sim_state_mean0.04077599026351318
sim_compute_sim_state_median0.04240708351135254
sim_compute_sim_state_min0.03218628378475413
sim_physics_max0.1572107006521786
sim_physics_mean0.12717966826742333
sim_physics_median0.13496453285217286
sim_physics_min0.08812790290982116
sim_render-ego_max0.07058393253999598
sim_render-ego_mean0.06445185748051599
sim_render-ego_median0.06836645126342773
sim_render-ego_min0.05095531426224054
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
228422652zamatorychallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerroryes12120:08:01
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
228212699Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationsuccessyes12120:43:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0347969139267192
survival_time_median14.950000000000076
deviation-center-line_median0.9676323197502408
in-drivable-lane_median1.200000000000017


other stats
agent_compute-ego_max0.10827308471756752
agent_compute-ego_mean0.0969117461358658
agent_compute-ego_median0.09586040655771892
agent_compute-ego_min0.08798396507898966
deviation-center-line_max1.2240417562286885
deviation-center-line_mean0.9131416404756024
deviation-center-line_min0.5195348861362664
deviation-heading_max6.447969447458883
deviation-heading_mean4.316404508740158
deviation-heading_median4.601007580117526
deviation-heading_min0.9557359651027842
driven_any_max2.3489080444331454
driven_any_mean2.024058297512674
driven_any_median2.348749456605972
driven_any_min0.7418762410934892
driven_lanedir_consec_max1.7432461876358945
driven_lanedir_consec_mean1.0966423673120018
driven_lanedir_consec_min0.7204901231503708
driven_lanedir_max1.917103263831786
driven_lanedir_mean1.601899068018648
driven_lanedir_median1.8306268470857805
driven_lanedir_min0.7204901231503708
in-drivable-lane_max3.000000000000022
in-drivable-lane_mean1.370000000000014
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.331866813655183, "sim_physics": 0.26676341613133747, "survival_time": 14.950000000000076, "driven_lanedir": 1.8306268470857805, "sim_render-ego": 0.07671574751536052, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.09586040655771892, "deviation-heading": 5.824270353639917, "set_robot_commands": 0.12172087669372558, "deviation-center-line": 0.9690935954952266, "driven_lanedir_consec": 1.0347969139267192, "sim_compute_sim_state": 0.04665467023849487, "sim_compute_performance-ego": 0.08336400032043458, "sim_compute_robot_state-ego": 0.0960922646522522, "sim_compute_robot_state-npc0": 0.08152446508407593, "sim_compute_robot_state-npc1": 0.0810825753211975, "sim_compute_robot_state-npc2": 0.08256057818730672, "sim_compute_robot_state-npc3": 0.08302874247233073}, "udem1-1-0": {"driven_any": 2.348749456605972, "sim_physics": 0.2631913352012634, "survival_time": 14.950000000000076, "driven_lanedir": 1.917103263831786, "sim_render-ego": 0.07485801617304484, "in-drivable-lane": 0.700000000000002, "agent_compute-ego": 0.09463926076889038, "deviation-heading": 6.447969447458883, "set_robot_commands": 0.12308108965555828, "deviation-center-line": 0.9676323197502408, "driven_lanedir_consec": 0.8998459935507921, "sim_compute_sim_state": 0.046121726830800375, "sim_compute_performance-ego": 0.0837237517038981, "sim_compute_robot_state-ego": 0.09732165177663168, "sim_compute_robot_state-npc0": 0.08102134784062703, "sim_compute_robot_state-npc1": 0.0820860767364502, "sim_compute_robot_state-npc2": 0.08225205421447754, "sim_compute_robot_state-npc3": 0.08444050391515096}, "udem1-2-0": {"driven_any": 0.7418762410934892, "sim_physics": 0.31012982310670795, "survival_time": 4.94999999999999, "driven_lanedir": 0.7204901231503708, "sim_render-ego": 0.08006368261395079, "in-drivable-lane": 0, "agent_compute-ego": 0.10827308471756752, "deviation-heading": 0.9557359651027842, "set_robot_commands": 0.12727364385970916, "deviation-center-line": 0.5195348861362664, "driven_lanedir_consec": 0.7204901231503708, "sim_compute_sim_state": 0.0490942940567479, "sim_compute_performance-ego": 0.08673587230720906, "sim_compute_robot_state-ego": 0.10060247507962314, "sim_compute_robot_state-npc0": 0.08321278986304698, "sim_compute_robot_state-npc1": 0.08332214933453184, "sim_compute_robot_state-npc2": 0.08568280393427069, "sim_compute_robot_state-npc3": 0.08641268267776027}, "udem1-3-0": {"driven_any": 2.348890931775583, "sim_physics": 0.2563531017303467, "survival_time": 14.950000000000076, "driven_lanedir": 1.6516868417096475, "sim_render-ego": 0.07521909236907959, "in-drivable-lane": 3.000000000000022, "agent_compute-ego": 0.09780201355616253, "deviation-heading": 4.601007580117526, "set_robot_commands": 0.1228886079788208, "deviation-center-line": 1.2240417562286885, "driven_lanedir_consec": 1.0848326182962318, "sim_compute_sim_state": 0.04639856338500976, "sim_compute_performance-ego": 0.0826255997021993, "sim_compute_robot_state-ego": 0.09627878824869791, "sim_compute_robot_state-npc0": 0.08280357917149862, "sim_compute_robot_state-npc1": 0.08241352717081706, "sim_compute_robot_state-npc2": 0.0818927009900411, "sim_compute_robot_state-npc3": 0.08269699335098267}, "udem1-4-0": {"driven_any": 2.3489080444331454, "sim_physics": 0.2369021201133728, "survival_time": 14.950000000000076, "driven_lanedir": 1.889588264315656, "sim_render-ego": 0.06839807748794556, "in-drivable-lane": 1.9500000000000275, "agent_compute-ego": 0.08798396507898966, "deviation-heading": 3.7530391973816783, "set_robot_commands": 0.11188069502512614, "deviation-center-line": 0.88540564476759, "driven_lanedir_consec": 1.7432461876358945, "sim_compute_sim_state": 0.0406018861134847, "sim_compute_performance-ego": 0.07452790578206381, "sim_compute_robot_state-ego": 0.0840007495880127, "sim_compute_robot_state-npc0": 0.07453361511230469, "sim_compute_robot_state-npc1": 0.07475243330001831, "sim_compute_robot_state-npc2": 0.07556800285975139, "sim_compute_robot_state-npc3": 0.0743675176302592}}
set_robot_commands_max0.12727364385970916
set_robot_commands_mean0.121368982642588
set_robot_commands_median0.1228886079788208
set_robot_commands_min0.11188069502512614
sim_compute_performance-ego_max0.08673587230720906
sim_compute_performance-ego_mean0.08219542596316096
sim_compute_performance-ego_median0.08336400032043458
sim_compute_performance-ego_min0.07452790578206381
sim_compute_robot_state-ego_max0.10060247507962314
sim_compute_robot_state-ego_mean0.09485918586904352
sim_compute_robot_state-ego_median0.09627878824869791
sim_compute_robot_state-ego_min0.0840007495880127
sim_compute_robot_state-npc0_max0.08321278986304698
sim_compute_robot_state-npc0_mean0.08061915941431066
sim_compute_robot_state-npc0_median0.08152446508407593
sim_compute_robot_state-npc0_min0.07453361511230469
sim_compute_robot_state-npc1_max0.08332214933453184
sim_compute_robot_state-npc1_mean0.08073135237260298
sim_compute_robot_state-npc1_median0.0820860767364502
sim_compute_robot_state-npc1_min0.07475243330001831
sim_compute_robot_state-npc2_max0.08568280393427069
sim_compute_robot_state-npc2_mean0.08159122803716949
sim_compute_robot_state-npc2_median0.08225205421447754
sim_compute_robot_state-npc2_min0.07556800285975139
sim_compute_robot_state-npc3_max0.08641268267776027
sim_compute_robot_state-npc3_mean0.08218928800929677
sim_compute_robot_state-npc3_median0.08302874247233073
sim_compute_robot_state-npc3_min0.0743675176302592
sim_compute_sim_state_max0.0490942940567479
sim_compute_sim_state_mean0.04577422812490752
sim_compute_sim_state_median0.04639856338500976
sim_compute_sim_state_min0.0406018861134847
sim_physics_max0.31012982310670795
sim_physics_mean0.26666795925660564
sim_physics_median0.2631913352012634
sim_physics_min0.2369021201133728
sim_render-ego_max0.08006368261395079
sim_render-ego_mean0.07505092323187626
sim_render-ego_median0.07521909236907959
sim_render-ego_min0.06839807748794556
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.95000000000006
survival_time_min4.94999999999999
228122715jp18813100494test for ppoaido2-LF-sim-testingstep1-simulationerroryes12120:01:41
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
228012734Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-testingstep1-simulationfailedyes12120:01:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
227932746RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationfailedyes12120:02:11
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
227842767Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationerroryes12120:06:34
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
227802779RamiNaimchallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validationstep1-simulationerroryes12120:00:37
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
227732782RamiNaimchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-testingstep1-simulationerroryes12120:00:36
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
227682796RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationfailedyes12120:02:06
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
227612813Andrea Censichallenge-aido_LF-template-random - random_agentaido2-LFVI-sim-validationstep1-simulationsuccessyes12120:10:42Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.493517638549009
survival_time_median2.3999999999999995
deviation-center-line_median0.09791133281082
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.17503543745113326
agent_compute-ego_mean0.16925188659300677
agent_compute-ego_median0.17016725029264176
agent_compute-ego_min0.15971388135637557
deviation-center-line_max0.2348196785686717
deviation-center-line_mean0.13547481992266058
deviation-center-line_min0.06216029860587694
deviation-heading_max0.8115272458314897
deviation-heading_mean0.49959867397150787
deviation-heading_median0.46504862964833654
deviation-heading_min0.30044835691402494
driven_any_max2.1864003300000694
driven_any_mean1.1068208197848532
driven_any_median0.9410513078477724
driven_any_min0.34749292376309954
driven_lanedir_consec_max1.826231945363564
driven_lanedir_consec_mean0.804744013449103
driven_lanedir_consec_min0.3325249708009643
driven_lanedir_max1.826231945363564
driven_lanedir_mean0.804828147320482
driven_lanedir_median0.493517638549009
driven_lanedir_min0.3325249708009643
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.5599999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.23346554176716863, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06831821308860296, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.17503543745113326, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.10882862308357336, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.04269554343404649, "sim_compute_performance-ego": 0.07650764079033574, "sim_compute_robot_state-ego": 0.08743897269043742, "sim_compute_robot_state-npc0": 0.0766801049437704, "sim_compute_robot_state-npc1": 0.0782563233677345, "sim_compute_robot_state-npc2": 0.07581536377532573, "sim_compute_robot_state-npc3": 0.07747029050996032}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.23737158945628575, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06860918658120292, "in-drivable-lane": 0, "agent_compute-ego": 0.17016725029264176, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.10384397847311835, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.043559023312159946, "sim_compute_performance-ego": 0.08032421554837908, "sim_compute_robot_state-ego": 0.08741664034979683, "sim_compute_robot_state-npc0": 0.07739345516477313, "sim_compute_robot_state-npc1": 0.07921137980052403, "sim_compute_robot_state-npc2": 0.07650480951581683, "sim_compute_robot_state-npc3": 0.07716562066759382}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.20929255994778231, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06765698923647982, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.16658728562512445, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.10475697795164238, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.04242072985010239, "sim_compute_performance-ego": 0.07503091478810726, "sim_compute_robot_state-ego": 0.08068662939719784, "sim_compute_robot_state-npc0": 0.07256521761996075, "sim_compute_robot_state-npc1": 0.07359055639470666, "sim_compute_robot_state-npc2": 0.07505804126702466, "sim_compute_robot_state-npc3": 0.07658671638340626}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.24898182849089304, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06807517508665721, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.17475557823975882, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.10867620011170703, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.042710656921068825, "sim_compute_performance-ego": 0.07916600008805592, "sim_compute_robot_state-ego": 0.08555899063746135, "sim_compute_robot_state-npc0": 0.07829954226811726, "sim_compute_robot_state-npc1": 0.07708316047986348, "sim_compute_robot_state-npc2": 0.07712213198343913, "sim_compute_robot_state-npc3": 0.07934217651685078}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.2412259238106864, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06532481738499232, "in-drivable-lane": 0, "agent_compute-ego": 0.15971388135637557, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.10132336616516112, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.04384403001694452, "sim_compute_performance-ego": 0.07661843299865723, "sim_compute_robot_state-ego": 0.08610464277721587, "sim_compute_robot_state-npc0": 0.07588458061218262, "sim_compute_robot_state-npc1": 0.07950488726298015, "sim_compute_robot_state-npc2": 0.07789494877769834, "sim_compute_robot_state-npc3": 0.08363442193894159}}
set_robot_commands_max0.10882862308357336
set_robot_commands_mean0.10548582915704044
set_robot_commands_median0.10475697795164238
set_robot_commands_min0.10132336616516112
sim_compute_performance-ego_max0.08032421554837908
sim_compute_performance-ego_mean0.07752944084270705
sim_compute_performance-ego_median0.07661843299865723
sim_compute_performance-ego_min0.07503091478810726
sim_compute_robot_state-ego_max0.08743897269043742
sim_compute_robot_state-ego_mean0.08544117517042185
sim_compute_robot_state-ego_median0.08610464277721587
sim_compute_robot_state-ego_min0.08068662939719784
sim_compute_robot_state-npc0_max0.07829954226811726
sim_compute_robot_state-npc0_mean0.07616458012176083
sim_compute_robot_state-npc0_median0.0766801049437704
sim_compute_robot_state-npc0_min0.07256521761996075
sim_compute_robot_state-npc1_max0.07950488726298015
sim_compute_robot_state-npc1_mean0.07752926146116176
sim_compute_robot_state-npc1_median0.0782563233677345
sim_compute_robot_state-npc1_min0.07359055639470666
sim_compute_robot_state-npc2_max0.07789494877769834
sim_compute_robot_state-npc2_mean0.07647905906386095
sim_compute_robot_state-npc2_median0.07650480951581683
sim_compute_robot_state-npc2_min0.07505804126702466
sim_compute_robot_state-npc3_max0.08363442193894159
sim_compute_robot_state-npc3_mean0.07883984520335055
sim_compute_robot_state-npc3_median0.07747029050996032
sim_compute_robot_state-npc3_min0.07658671638340626
sim_compute_sim_state_max0.04384403001694452
sim_compute_sim_state_mean0.04304599670686443
sim_compute_sim_state_median0.042710656921068825
sim_compute_sim_state_min0.04242072985010239
sim_physics_max0.24898182849089304
sim_physics_mean0.2340674886945632
sim_physics_median0.23737158945628575
sim_physics_min0.20929255994778231
sim_render-ego_max0.06860918658120292
sim_render-ego_mean0.06759687627558705
sim_render-ego_median0.06807517508665721
sim_render-ego_min0.06532481738499232
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.789999999999997
survival_time_min1.0500000000000005
227142899Julian ZillyBaseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationsuccessyes12120:36:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6549380919829523
survival_time_median5.999999999999987
deviation-center-line_median0.2500615736512529
in-drivable-lane_median0.8500000000000121


other stats
agent_compute-ego_max0.28403556220074916
agent_compute-ego_mean0.25249015374045247
agent_compute-ego_median0.25465900301933286
agent_compute-ego_min0.20970675964985996
deviation-center-line_max0.6241758860684284
deviation-center-line_mean0.30605179601445237
deviation-center-line_min0.19028534371277703
deviation-heading_max1.8317126683483456
deviation-heading_mean0.9449064506103224
deviation-heading_median0.8945710427524652
deviation-heading_min0.44874065602003615
driven_any_max2.160393263975218
driven_any_mean0.9275729243547832
driven_any_median0.9898831336164802
driven_any_min0.2648710459225631
driven_lanedir_consec_max1.9719663351310144
driven_lanedir_consec_mean0.7345999499039054
driven_lanedir_consec_min0.2569246953277573
driven_lanedir_max1.9719663351310144
driven_lanedir_mean0.7345999499039054
driven_lanedir_median0.6549380919829523
driven_lanedir_min0.2569246953277573
in-drivable-lane_max2.549999999999991
in-drivable-lane_mean0.9133333333333342
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9986182835992308, "sim_physics": 0.09853663129254804, "survival_time": 6.0499999999999865, "driven_lanedir": 0.6700583579405008, "sim_render-ego": 0.05886435114647731, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.20970675964985996, "deviation-heading": 0.9584632163764666, "set_robot_commands": 0.10479097523965128, "deviation-center-line": 0.229184896196581, "driven_lanedir_consec": 0.6700583579405008, "sim_compute_sim_state": 0.03531865443079925, "sim_compute_performance-ego": 0.06420528987222467, "sim_compute_robot_state-ego": 0.07089802450384976}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0073534343051809, "sim_physics": 0.11787494870482898, "survival_time": 6.099999999999986, "driven_lanedir": 0.8666043062033748, "sim_render-ego": 0.065985912182292, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.24508369359813753, "deviation-heading": 1.7089382302492009, "set_robot_commands": 0.09955732744248189, "deviation-center-line": 0.48682172653539846, "driven_lanedir_consec": 0.8666043062033748, "sim_compute_sim_state": 0.04137452508582443, "sim_compute_performance-ego": 0.07190720956833636, "sim_compute_robot_state-ego": 0.0766351692012099}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2648710459225631, "sim_physics": 0.12494561478898332, "survival_time": 1.850000000000001, "driven_lanedir": 0.2569246953277573, "sim_render-ego": 0.07041947906081741, "in-drivable-lane": 0, "agent_compute-ego": 0.2334173498926936, "deviation-heading": 0.4523071711606882, "set_robot_commands": 0.10201356862042402, "deviation-center-line": 0.19028534371277703, "driven_lanedir_consec": 0.2569246953277573, "sim_compute_sim_state": 0.041408184412363415, "sim_compute_performance-ego": 0.07245605700724833, "sim_compute_robot_state-ego": 0.07956372724997031}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.44830384407782126, "sim_physics": 0.1404003274851832, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4266216174587392, "sim_render-ego": 0.06632915036431675, "in-drivable-lane": 0, "agent_compute-ego": 0.26718758303543616, "deviation-heading": 0.9042996768410582, "set_robot_commands": 0.10319770204609838, "deviation-center-line": 0.2000654842364332, "driven_lanedir_consec": 0.4266216174587392, "sim_compute_sim_state": 0.0432934884367318, "sim_compute_performance-ego": 0.07488818415280046, "sim_compute_robot_state-ego": 0.08192533871223187}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.575138194527954, "sim_physics": 0.12062863742603976, "survival_time": 9.349999999999998, "driven_lanedir": 1.1899106948505498, "sim_render-ego": 0.06398261549638555, "in-drivable-lane": 2.1500000000000155, "agent_compute-ego": 0.24257162420507425, "deviation-heading": 0.5495116766932356, "set_robot_commands": 0.10132985574038908, "deviation-center-line": 0.6241758860684284, "driven_lanedir_consec": 1.1899106948505498, "sim_compute_sim_state": 0.04080750725486062, "sim_compute_performance-ego": 0.07403210650153338, "sim_compute_robot_state-ego": 0.07905945165909548}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.4483038440408249, "sim_physics": 0.117691812844112, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4227993213164738, "sim_render-ego": 0.06488101646817963, "in-drivable-lane": 0, "agent_compute-ego": 0.2508700551657841, "deviation-heading": 0.9813994973397404, "set_robot_commands": 0.1042681233636264, "deviation-center-line": 0.20796815436762567, "driven_lanedir_consec": 0.4227993213164738, "sim_compute_sim_state": 0.041984266248242606, "sim_compute_performance-ego": 0.07208191526347194, "sim_compute_robot_state-ego": 0.07774497722757273}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0160885841428031, "sim_physics": 0.13040574391682944, "survival_time": 6.149999999999986, "driven_lanedir": 0.5516827739079271, "sim_render-ego": 0.06627839367564131, "in-drivable-lane": 2.549999999999991, "agent_compute-ego": 0.2580156365061194, "deviation-heading": 0.8945710427524652, "set_robot_commands": 0.10594457533301375, "deviation-center-line": 0.2500615736512529, "driven_lanedir_consec": 0.5516827739079271, "sim_compute_sim_state": 0.04165796341934824, "sim_compute_performance-ego": 0.07580975788395579, "sim_compute_robot_state-ego": 0.08868732491159827}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.29107361377454816, "sim_physics": 0.12067381739616394, "survival_time": 2.000000000000001, "driven_lanedir": 0.28374525761121827, "sim_render-ego": 0.06356636881828308, "in-drivable-lane": 0, "agent_compute-ego": 0.25980121493339536, "deviation-heading": 0.44874065602003615, "set_robot_commands": 0.10138930678367616, "deviation-center-line": 0.1987065435306638, "driven_lanedir_consec": 0.28374525761121827, "sim_compute_sim_state": 0.04088294506072998, "sim_compute_performance-ego": 0.07287419438362122, "sim_compute_robot_state-ego": 0.0787412941455841}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.6666825735996985, "sim_physics": 0.10915907319769802, "survival_time": 4.149999999999993, "driven_lanedir": 0.6596948906802429, "sim_render-ego": 0.05944540414465479, "in-drivable-lane": 0, "agent_compute-ego": 0.2321209189403488, "deviation-heading": 0.5977744380513031, "set_robot_commands": 0.09797859191894533, "deviation-center-line": 0.2884395853961925, "driven_lanedir_consec": 0.6596948906802429, "sim_compute_sim_state": 0.039208478238209186, "sim_compute_performance-ego": 0.07308682188930282, "sim_compute_robot_state-ego": 0.07717905561608004}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9898831324391452, "sim_physics": 0.12525303761164347, "survival_time": 5.999999999999987, "driven_lanedir": 0.6549380919829523, "sim_render-ego": 0.06862846811612447, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.25465900301933286, "deviation-heading": 1.187734297181029, "set_robot_commands": 0.10448911190032958, "deviation-center-line": 0.26939309530143185, "driven_lanedir_consec": 0.6549380919829523, "sim_compute_sim_state": 0.041304385662078856, "sim_compute_performance-ego": 0.07674826582272848, "sim_compute_robot_state-ego": 0.07885154883066813}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.583873349121392, "sim_physics": 0.13708373079908656, "survival_time": 9.4, "driven_lanedir": 1.2124192541954315, "sim_render-ego": 0.06995996769438399, "in-drivable-lane": 2.000000000000017, "agent_compute-ego": 0.28403556220074916, "deviation-heading": 0.8897962420686931, "set_robot_commands": 0.10940023939660257, "deviation-center-line": 0.3289840744115673, "driven_lanedir_consec": 1.2124192541954315, "sim_compute_sim_state": 0.04188554844957717, "sim_compute_performance-ego": 0.07866054266057115, "sim_compute_robot_state-ego": 0.08902912063801542}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0073534335940946, "sim_physics": 0.1348396969623253, "survival_time": 6.099999999999986, "driven_lanedir": 0.6366060707539863, "sim_render-ego": 0.06895234350298272, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.2645627416548182, "deviation-heading": 1.8317126683483456, "set_robot_commands": 0.10720309859416524, "deviation-center-line": 0.3820267414968929, "driven_lanedir_consec": 0.6366060707539863, "sim_compute_sim_state": 0.04166852059911509, "sim_compute_performance-ego": 0.07637714167110256, "sim_compute_robot_state-ego": 0.08470343957181836}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.9898831336164802, "sim_physics": 0.1129702866077423, "survival_time": 5.999999999999987, "driven_lanedir": 0.7597756905309283, "sim_render-ego": 0.06581691900889079, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.2455985148747762, "deviation-heading": 0.8027896576519975, "set_robot_commands": 0.0999188999334971, "deviation-center-line": 0.22885738160556524, "driven_lanedir_consec": 0.7597756905309283, "sim_compute_sim_state": 0.039995755751927695, "sim_compute_performance-ego": 0.07225418289502462, "sim_compute_robot_state-ego": 0.08488326072692871}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.4657741345847929, "sim_physics": 0.12991583347320557, "survival_time": 2.9999999999999973, "driven_lanedir": 0.4552518906674847, "sim_render-ego": 0.0680710752805074, "in-drivable-lane": 0, "agent_compute-ego": 0.2796384930610657, "deviation-heading": 0.6376789682385315, "set_robot_commands": 0.11238406896591188, "deviation-center-line": 0.2142140825594132, "driven_lanedir_consec": 0.4552518906674847, "sim_compute_sim_state": 0.0434118906656901, "sim_compute_performance-ego": 0.07759089867273966, "sim_compute_robot_state-ego": 0.08976452350616455}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.160393263975218, "sim_physics": 0.1301100976823822, "survival_time": 12.700000000000044, "driven_lanedir": 1.9719663351310144, "sim_render-ego": 0.06748773263195368, "in-drivable-lane": 0.8500000000000121, "agent_compute-ego": 0.2600831553691954, "deviation-heading": 1.3278793201820436, "set_robot_commands": 0.106496635384447, "deviation-center-line": 0.4915923711465623, "driven_lanedir_consec": 1.9719663351310144, "sim_compute_sim_state": 0.041988091205987406, "sim_compute_performance-ego": 0.07540837329203688, "sim_compute_robot_state-ego": 0.08431660941266637}}
set_robot_commands_max0.11238406896591188
set_robot_commands_mean0.10402413871088396
set_robot_commands_median0.1042681233636264
set_robot_commands_min0.09797859191894533
sim_compute_performance-ego_max0.07866054266057115
sim_compute_performance-ego_mean0.07389206276911324
sim_compute_performance-ego_median0.07403210650153338
sim_compute_performance-ego_min0.06420528987222467
sim_compute_robot_state-ego_max0.08976452350616455
sim_compute_robot_state-ego_mean0.08146552439423026
sim_compute_robot_state-ego_median0.07956372724997031
sim_compute_robot_state-ego_min0.07089802450384976
sim_compute_sim_state_max0.0434118906656901
sim_compute_sim_state_mean0.04107934699476572
sim_compute_sim_state_median0.041408184412363415
sim_compute_sim_state_min0.03531865443079925
sim_physics_max0.1404003274851832
sim_physics_mean0.12336595267925148
sim_physics_median0.12494561478898332
sim_physics_min0.09853663129254804
sim_render-ego_max0.07041947906081741
sim_render-ego_mean0.0659112798394594
sim_render-ego_median0.06627839367564131
sim_render-ego_min0.05886435114647731
simulation-passed1
survival_time_max12.700000000000044
survival_time_mean5.64333333333333
survival_time_min1.850000000000001
226363058Andrea Censirotationaido2-LFV-sim-testingstep1-simulationerroryes12120:59:40
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
226163101awoo424HKU Duckietown Projectaido2-LFV-sim-validationstep1-simulationerroryes12120:26:40
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
225933126RamiNaim[0.27;0.75]aido2-LF-sim-validationstep1-simulationsuccessyes12120:26:28Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.52704957135005
survival_time_median14.950000000000076
deviation-center-line_median1.1837467477087331
in-drivable-lane_median0


other stats
agent_compute-ego_max0.16293227593104043
agent_compute-ego_mean0.1532480611910765
agent_compute-ego_median0.15913609504699708
agent_compute-ego_min0.14084962526957193
deviation-center-line_max1.4503169468836845
deviation-center-line_mean1.040886226280616
deviation-center-line_min0.20069940057969884
deviation-heading_max2.6888900490674037
deviation-heading_mean2.000082089080597
deviation-heading_median1.9457601790857144
deviation-heading_min0.8340957612187905
driven_any_max2.7577165661073884
driven_any_mean2.3011775189361527
driven_any_median2.7576610757744473
driven_any_min0.4841623546045137
driven_lanedir_consec_max2.717006161010834
driven_lanedir_consec_mean2.170840563780437
driven_lanedir_consec_min0.4631609731616342
driven_lanedir_max2.717006161010834
driven_lanedir_mean2.170840563780437
driven_lanedir_median2.52704957135005
driven_lanedir_min0.4631609731616342
in-drivable-lane_max1.2999999999999972
in-drivable-lane_mean0.4200000000000017
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.7486488307943393, "sim_physics": 0.14763400236765545, "survival_time": 14.950000000000076, "driven_lanedir": 2.52704957135005, "sim_render-ego": 0.07286841789881389, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.15913609504699708, "deviation-heading": 2.6013588954331675, "set_robot_commands": 0.1169973866144816, "deviation-center-line": 1.1375144144863911, "driven_lanedir_consec": 2.52704957135005, "sim_compute_sim_state": 0.04479247411092122, "sim_compute_performance-ego": 0.08160048246383667, "sim_compute_robot_state-ego": 0.09228695313135785}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.7576987674000755, "sim_physics": 0.15056438684463502, "survival_time": 14.950000000000076, "driven_lanedir": 2.6920614985589717, "sim_render-ego": 0.07275659084320069, "in-drivable-lane": 0, "agent_compute-ego": 0.1441075253486633, "deviation-heading": 2.6888900490674037, "set_robot_commands": 0.11862891912460329, "deviation-center-line": 1.1837467477087331, "driven_lanedir_consec": 2.6920614985589717, "sim_compute_sim_state": 0.04605876684188843, "sim_compute_performance-ego": 0.08314026753107706, "sim_compute_robot_state-ego": 0.094779687722524}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.7577165661073884, "sim_physics": 0.14840990622838338, "survival_time": 14.950000000000076, "driven_lanedir": 2.4549246148206967, "sim_render-ego": 0.07380793809890747, "in-drivable-lane": 1.2999999999999972, "agent_compute-ego": 0.16293227593104043, "deviation-heading": 1.9457601790857144, "set_robot_commands": 0.12021348476409913, "deviation-center-line": 1.4503169468836845, "driven_lanedir_consec": 2.4549246148206967, "sim_compute_sim_state": 0.04596478780110677, "sim_compute_performance-ego": 0.08225913127263387, "sim_compute_robot_state-ego": 0.09450051148732504}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4841623546045137, "sim_physics": 0.1652154223672275, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4631609731616342, "sim_render-ego": 0.08144224101099475, "in-drivable-lane": 0, "agent_compute-ego": 0.15921478435910982, "deviation-heading": 0.8340957612187905, "set_robot_commands": 0.11465135113946325, "deviation-center-line": 0.20069940057969884, "driven_lanedir_consec": 0.4631609731616342, "sim_compute_sim_state": 0.04651460976436221, "sim_compute_performance-ego": 0.08399782509639345, "sim_compute_robot_state-ego": 0.0952213797075995}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.7576610757744473, "sim_physics": 0.12119553963343302, "survival_time": 14.950000000000076, "driven_lanedir": 2.717006161010834, "sim_render-ego": 0.06266595125198364, "in-drivable-lane": 0, "agent_compute-ego": 0.14084962526957193, "deviation-heading": 1.930305560597908, "set_robot_commands": 0.1012347706158956, "deviation-center-line": 1.232153621744573, "driven_lanedir_consec": 2.717006161010834, "sim_compute_sim_state": 0.039297475814819335, "sim_compute_performance-ego": 0.06843873023986817, "sim_compute_robot_state-ego": 0.07805796066919962}}
set_robot_commands_max0.12021348476409913
set_robot_commands_mean0.11434518245170858
set_robot_commands_median0.1169973866144816
set_robot_commands_min0.1012347706158956
sim_compute_performance-ego_max0.08399782509639345
sim_compute_performance-ego_mean0.07988728732076185
sim_compute_performance-ego_median0.08225913127263387
sim_compute_performance-ego_min0.06843873023986817
sim_compute_robot_state-ego_max0.0952213797075995
sim_compute_robot_state-ego_mean0.0909692985436012
sim_compute_robot_state-ego_median0.09450051148732504
sim_compute_robot_state-ego_min0.07805796066919962
sim_compute_sim_state_max0.04651460976436221
sim_compute_sim_state_mean0.04452562286661958
sim_compute_sim_state_median0.04596478780110677
sim_compute_sim_state_min0.039297475814819335
sim_physics_max0.1652154223672275
sim_physics_mean0.14660385148826688
sim_physics_median0.14840990622838338
sim_physics_min0.12119553963343302
sim_render-ego_max0.08144224101099475
sim_render-ego_mean0.07270822782078008
sim_render-ego_median0.07286841789881389
sim_render-ego_min0.06266595125198364
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.540000000000065
survival_time_min2.8999999999999977
225813138AmaurXchallenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessyes12120:06:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.17048062553888635
agent_compute-ego_mean0.1474101082250907
agent_compute-ego_median0.13507676124572754
agent_compute-ego_min0.12897795789382038
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.10139943935253004, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.0543806376280608, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.13505340064013446, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08582089565418384, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03645882341596815, "sim_compute_performance-ego": 0.06320402357313368, "sim_compute_robot_state-ego": 0.06546010794462981}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.0984653678594851, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.05139619228886623, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.12897795789382038, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.07733060331905589, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03190155590281767, "sim_compute_performance-ego": 0.057512979881436214, "sim_compute_robot_state-ego": 0.05999171967599906}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.11788317736457377, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.0595393040600945, "in-drivable-lane": 0, "agent_compute-ego": 0.13507676124572754, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.0871419766369988, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.036165686214671415, "sim_compute_performance-ego": 0.06098752863266889, "sim_compute_robot_state-ego": 0.06391631855684168}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.1524586009979248, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06733570098876954, "in-drivable-lane": 0, "agent_compute-ego": 0.16746179580688478, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.10292929649353028, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.04309316635131836, "sim_compute_performance-ego": 0.08309941291809082, "sim_compute_robot_state-ego": 0.07628225326538086}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.13530708566496644, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06913551801367651, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.17048062553888635, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.10492769675918771, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.04231666915024383, "sim_compute_performance-ego": 0.07433714444124245, "sim_compute_robot_state-ego": 0.0847863607768771}}
set_robot_commands_max0.10492769675918771
set_robot_commands_mean0.0916300937725913
set_robot_commands_median0.0871419766369988
set_robot_commands_min0.07733060331905589
sim_compute_performance-ego_max0.08309941291809082
sim_compute_performance-ego_mean0.06782821788931441
sim_compute_performance-ego_median0.06320402357313368
sim_compute_performance-ego_min0.057512979881436214
sim_compute_robot_state-ego_max0.0847863607768771
sim_compute_robot_state-ego_mean0.0700873520439457
sim_compute_robot_state-ego_median0.06546010794462981
sim_compute_robot_state-ego_min0.05999171967599906
sim_compute_sim_state_max0.04309316635131836
sim_compute_sim_state_mean0.03798718020700389
sim_compute_sim_state_median0.03645882341596815
sim_compute_sim_state_min0.03190155590281767
sim_physics_max0.1524586009979248
sim_physics_mean0.12110273424789604
sim_physics_median0.11788317736457377
sim_physics_min0.0984653678594851
sim_render-ego_max0.06913551801367651
sim_render-ego_mean0.06035747059589351
sim_render-ego_median0.0595393040600945
sim_render-ego_min0.05139619228886623
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
225663158awoo424Roasted duckaido2-LF-sim-validationstep1-simulationhost-erroryes12120:15:33
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 544, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1123, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1358, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1405, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission3158/step1-simulation-ip-172-31-38-104-2553-job22566/tmp/tmpvjw9cucr/episodes/ETHZ_autolab_technical_track-0-0/drawing.html']' returned non-zero exit status 1.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
225603174leohsu870325challenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessyes12120:06:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.16949484825134278
agent_compute-ego_mean0.1624513287457854
agent_compute-ego_median0.16387193810706044
agent_compute-ego_min0.1532816132412681
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.12578735969684743, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06575346876073766, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.15651861826578775, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09709229734208848, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03971276901386402, "sim_compute_performance-ego": 0.07336563975722701, "sim_compute_robot_state-ego": 0.07725495320779306}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.12035095457937205, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06960177421569824, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.16387193810706044, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.1063852777668074, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.04230789109772327, "sim_compute_performance-ego": 0.07489299306682512, "sim_compute_robot_state-ego": 0.08106566410438687}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.1322781338411219, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.06732386701247271, "in-drivable-lane": 0, "agent_compute-ego": 0.16908962586346796, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.10044306867262896, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.043311175178079045, "sim_compute_performance-ego": 0.07356774105745204, "sim_compute_robot_state-ego": 0.07930789274327896}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.14239834785461425, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06759527206420898, "in-drivable-lane": 0, "agent_compute-ego": 0.16949484825134278, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.10703473091125489, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.04400422096252441, "sim_compute_performance-ego": 0.07881162643432617, "sim_compute_robot_state-ego": 0.09141051292419432}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.11600844165946864, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06417218944694422, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.1532816132412681, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.09824956821489936, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03867932512790342, "sim_compute_performance-ego": 0.06952754153481013, "sim_compute_robot_state-ego": 0.07997568951377386}}
set_robot_commands_max0.10703473091125489
set_robot_commands_mean0.10184098858153584
set_robot_commands_median0.10044306867262896
set_robot_commands_min0.09709229734208848
sim_compute_performance-ego_max0.07881162643432617
sim_compute_performance-ego_mean0.07403310837012808
sim_compute_performance-ego_median0.07356774105745204
sim_compute_performance-ego_min0.06952754153481013
sim_compute_robot_state-ego_max0.09141051292419432
sim_compute_robot_state-ego_mean0.08180294249868543
sim_compute_robot_state-ego_median0.07997568951377386
sim_compute_robot_state-ego_min0.07725495320779306
sim_compute_sim_state_max0.04400422096252441
sim_compute_sim_state_mean0.04160307627601883
sim_compute_sim_state_median0.04230789109772327
sim_compute_sim_state_min0.03867932512790342
sim_physics_max0.14239834785461425
sim_physics_mean0.12736464752628485
sim_physics_median0.12578735969684743
sim_physics_min0.11600844165946864
sim_render-ego_max0.06960177421569824
sim_render-ego_mean0.06688931430001237
sim_render-ego_median0.06732386701247271
sim_render-ego_min0.06417218944694422
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
225553182jp18813100494First test - THaido2-LF-sim-testingstep1-simulationerroryes12120:02:37
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.