AI Driving Olympics Home Challenges Submissions Jobs

Submission 2880

Submission2880
Competingyes
Challengeaido2-LFV-sim-testing
UserAndrea Daniele
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22724
Next
User labelminimal_agent (Python 3)
Admin priority50
Blessing50
User priority

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
227242880Andrea Danieleminimal_agent (Python 3)aido2-LFV-sim-testingstep1-simulationsuccessyes-0:42:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4278874896529574
survival_time_median7.049999999999983
deviation-center-line_median0.336080725822317
in-drivable-lane_median1.999999999999993


other stats
agent_compute-ego_max0.15755861202875773
agent_compute-ego_mean0.15149817493679182
agent_compute-ego_median0.1538810002888348
agent_compute-ego_min0.13767221441679597
deviation-center-line_max0.6395179658578088
deviation-center-line_mean0.3376081825040823
deviation-center-line_min0.18432680552089345
deviation-heading_max2.5988183506786204
deviation-heading_mean1.1439412496731016
deviation-heading_median1.0007157377877205
deviation-heading_min0.4339628546397995
driven_any_max2.1824083368295137
driven_any_mean1.041548572842095
driven_any_median1.002289442536604
driven_any_min0.3471148409579561
driven_lanedir_consec_max1.2416141769078073
driven_lanedir_consec_mean0.5855696461150995
driven_lanedir_consec_min0.32724226781545207
driven_lanedir_max1.2416141769078073
driven_lanedir_mean0.5855696461150995
driven_lanedir_median0.4278874896529574
driven_lanedir_min0.32724226781545207
in-drivable-lane_max10.500000000000064
in-drivable-lane_mean2.776666666666675
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900915586687412, "sim_physics": 0.10541282111792256, "survival_time": 6.949999999999983, "driven_lanedir": 0.6591401084474304, "sim_render-ego": 0.06647060586394166, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.15547534544690908, "deviation-heading": 0.801279189692507, "set_robot_commands": 0.07863450050354004, "deviation-center-line": 0.33899838427143014, "driven_lanedir_consec": 0.6591401084474304, "sim_compute_sim_state": 0.039923206507730825, "sim_compute_performance-ego": 0.06619382933746996, "sim_compute_robot_state-ego": 0.06547637637570608, "sim_compute_robot_state-npc0": 0.07559344236799281, "sim_compute_robot_state-npc1": 0.07044356846980912, "sim_compute_robot_state-npc2": 0.06765945009190402, "sim_compute_robot_state-npc3": 0.06852625428343849}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4167848967141688, "sim_physics": 0.12011247211032444, "survival_time": 3.149999999999997, "driven_lanedir": 0.3888322247827789, "sim_render-ego": 0.06485199928283691, "in-drivable-lane": 0, "agent_compute-ego": 0.15411507137238034, "deviation-heading": 1.1492236283129806, "set_robot_commands": 0.07859247828286792, "deviation-center-line": 0.22729035014002288, "driven_lanedir_consec": 0.3888322247827789, "sim_compute_sim_state": 0.04237143577091278, "sim_compute_performance-ego": 0.06904969139704628, "sim_compute_robot_state-ego": 0.06810450553894043, "sim_compute_robot_state-npc0": 0.0767127067323715, "sim_compute_robot_state-npc1": 0.07801451758732872, "sim_compute_robot_state-npc2": 0.07259029055398608, "sim_compute_robot_state-npc3": 0.07394528010534862}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6381859911990262, "sim_physics": 0.10805840916103789, "survival_time": 11.250000000000025, "driven_lanedir": 0.8981740479582627, "sim_render-ego": 0.06704929245842828, "in-drivable-lane": 4.85000000000004, "agent_compute-ego": 0.15737675560845268, "deviation-heading": 1.0007157377877205, "set_robot_commands": 0.07959677696228028, "deviation-center-line": 0.4843179558881834, "driven_lanedir_consec": 0.8981740479582627, "sim_compute_sim_state": 0.04212338129679362, "sim_compute_performance-ego": 0.06985646141899957, "sim_compute_robot_state-ego": 0.06665858692593045, "sim_compute_robot_state-npc0": 0.07714104016621907, "sim_compute_robot_state-npc1": 0.0735800658331977, "sim_compute_robot_state-npc2": 0.07325798776414659, "sim_compute_robot_state-npc3": 0.07254130787319607}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.578827325923981, "sim_physics": 0.10052363553904169, "survival_time": 10.85000000000002, "driven_lanedir": 1.2206700211390982, "sim_render-ego": 0.06735082046227521, "in-drivable-lane": 2.250000000000032, "agent_compute-ego": 0.15395419608612765, "deviation-heading": 1.0094809624268894, "set_robot_commands": 0.07755247458884243, "deviation-center-line": 0.41569520444906216, "driven_lanedir_consec": 1.2206700211390982, "sim_compute_sim_state": 0.039734573408205937, "sim_compute_performance-ego": 0.06657026110706242, "sim_compute_robot_state-ego": 0.06378966102951683, "sim_compute_robot_state-npc0": 0.075079622356573, "sim_compute_robot_state-npc1": 0.07109189033508301, "sim_compute_robot_state-npc2": 0.07039846033544585, "sim_compute_robot_state-npc3": 0.0697234446002591}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.42438846278159503, "sim_physics": 0.09377624496581062, "survival_time": 3.149999999999997, "driven_lanedir": 0.4129829416491664, "sim_render-ego": 0.06432164661468022, "in-drivable-lane": 0, "agent_compute-ego": 0.15231591179257348, "deviation-heading": 0.7390440083021812, "set_robot_commands": 0.07760732136075459, "deviation-center-line": 0.22858033061406635, "driven_lanedir_consec": 0.4129829416491664, "sim_compute_sim_state": 0.037789098800174774, "sim_compute_performance-ego": 0.0650911633930509, "sim_compute_robot_state-ego": 0.06192477165706574, "sim_compute_robot_state-npc0": 0.0739867573692685, "sim_compute_robot_state-npc1": 0.07057678131830125, "sim_compute_robot_state-npc2": 0.06831505185081846, "sim_compute_robot_state-npc3": 0.06868191370888362}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0504010241155275, "sim_physics": 0.09351350836557884, "survival_time": 7.299999999999982, "driven_lanedir": 0.39597378214039874, "sim_render-ego": 0.05789095734896725, "in-drivable-lane": 3.5499999999999874, "agent_compute-ego": 0.14342735401571613, "deviation-heading": 2.3434677844360583, "set_robot_commands": 0.07552281797748722, "deviation-center-line": 0.37507737640988825, "driven_lanedir_consec": 0.39597378214039874, "sim_compute_sim_state": 0.03531661752152116, "sim_compute_performance-ego": 0.06055612923347787, "sim_compute_robot_state-ego": 0.06022564025774394, "sim_compute_robot_state-npc0": 0.06960619639043938, "sim_compute_robot_state-npc1": 0.06386808989799186, "sim_compute_robot_state-npc2": 0.062307633765756265, "sim_compute_robot_state-npc3": 0.06211159490559199}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9925466226450728, "sim_physics": 0.09062655023533664, "survival_time": 6.949999999999983, "driven_lanedir": 0.647038156506072, "sim_render-ego": 0.059586312273423446, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.14293560707311836, "deviation-heading": 1.5590891377390808, "set_robot_commands": 0.07694077320236097, "deviation-center-line": 0.37918470593477854, "driven_lanedir_consec": 0.647038156506072, "sim_compute_sim_state": 0.03522997622867283, "sim_compute_performance-ego": 0.0611206953474086, "sim_compute_robot_state-ego": 0.06039245180088839, "sim_compute_robot_state-npc0": 0.06843439966654606, "sim_compute_robot_state-npc1": 0.06465145495298097, "sim_compute_robot_state-npc2": 0.06241760494040071, "sim_compute_robot_state-npc3": 0.06290228246784896}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.5143195051826088, "sim_physics": 0.094721637844469, "survival_time": 10.450000000000014, "driven_lanedir": 0.5946085645782655, "sim_render-ego": 0.05465765432877974, "in-drivable-lane": 6.050000000000021, "agent_compute-ego": 0.13767221441679597, "deviation-heading": 1.0074551066905668, "set_robot_commands": 0.0752247725947622, "deviation-center-line": 0.31096291732963327, "driven_lanedir_consec": 0.5946085645782655, "sim_compute_sim_state": 0.03336735205216841, "sim_compute_performance-ego": 0.05860108850104957, "sim_compute_robot_state-ego": 0.05898531201923863, "sim_compute_robot_state-npc0": 0.06622508724340412, "sim_compute_robot_state-npc1": 0.06132914232865475, "sim_compute_robot_state-npc2": 0.06151334406656512, "sim_compute_robot_state-npc3": 0.060249324050246245}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0526053931137378, "sim_physics": 0.0919797371844856, "survival_time": 7.349999999999982, "driven_lanedir": 0.35306598250901233, "sim_render-ego": 0.06376493544805617, "in-drivable-lane": 4.599999999999984, "agent_compute-ego": 0.15096773906629912, "deviation-heading": 0.7493734577809043, "set_robot_commands": 0.07750383526289543, "deviation-center-line": 0.2543770508936741, "driven_lanedir_consec": 0.35306598250901233, "sim_compute_sim_state": 0.03724809082186952, "sim_compute_performance-ego": 0.06596831723946292, "sim_compute_robot_state-ego": 0.06309021249109385, "sim_compute_robot_state-npc0": 0.07429474876040504, "sim_compute_robot_state-npc1": 0.06893177097346508, "sim_compute_robot_state-npc2": 0.06654399268481197, "sim_compute_robot_state-npc3": 0.06741334143139067}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.4247089136171447, "sim_physics": 0.10032679921104797, "survival_time": 3.149999999999997, "driven_lanedir": 0.4065794545774155, "sim_render-ego": 0.060887722741989864, "in-drivable-lane": 0, "agent_compute-ego": 0.15134286880493164, "deviation-heading": 0.9116478049678652, "set_robot_commands": 0.07851966600569468, "deviation-center-line": 0.20984142395940591, "driven_lanedir_consec": 0.4065794545774155, "sim_compute_sim_state": 0.03661202627515036, "sim_compute_performance-ego": 0.06658498824588836, "sim_compute_robot_state-ego": 0.06337554114205497, "sim_compute_robot_state-npc0": 0.07305961941915845, "sim_compute_robot_state-npc1": 0.06901484444027856, "sim_compute_robot_state-npc2": 0.06533649611094641, "sim_compute_robot_state-npc3": 0.06525342048160614}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3471148409579561, "sim_physics": 0.11357973206718013, "survival_time": 2.6499999999999986, "driven_lanedir": 0.32724226781545207, "sim_render-ego": 0.06738315888170926, "in-drivable-lane": 0, "agent_compute-ego": 0.15678156546826633, "deviation-heading": 0.8969790273027586, "set_robot_commands": 0.0785172570426509, "deviation-center-line": 0.18432680552089345, "driven_lanedir_consec": 0.32724226781545207, "sim_compute_sim_state": 0.039242474537975386, "sim_compute_performance-ego": 0.06529195803516316, "sim_compute_robot_state-ego": 0.06362797629158452, "sim_compute_robot_state-npc0": 0.07493462202683934, "sim_compute_robot_state-npc1": 0.07123854475201301, "sim_compute_robot_state-npc2": 0.07142936958456939, "sim_compute_robot_state-npc3": 0.07062335734097462}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.43182353608565555, "sim_physics": 0.09063705056905746, "survival_time": 3.1999999999999966, "driven_lanedir": 0.4278874896529574, "sim_render-ego": 0.06576446443796158, "in-drivable-lane": 0, "agent_compute-ego": 0.15041271224617958, "deviation-heading": 0.4339628546397995, "set_robot_commands": 0.07994329556822777, "deviation-center-line": 0.336080725822317, "driven_lanedir_consec": 0.4278874896529574, "sim_compute_sim_state": 0.03786928951740265, "sim_compute_performance-ego": 0.06698016077280045, "sim_compute_robot_state-ego": 0.06344443187117577, "sim_compute_robot_state-npc0": 0.07641815766692162, "sim_compute_robot_state-npc1": 0.07092183828353882, "sim_compute_robot_state-npc2": 0.06907018646597862, "sim_compute_robot_state-npc3": 0.06910956278443336}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.002289442536604, "sim_physics": 0.09543876275948598, "survival_time": 7.049999999999983, "driven_lanedir": 0.3465233549666594, "sim_render-ego": 0.06533774754679794, "in-drivable-lane": 4.3499999999999845, "agent_compute-ego": 0.1538810002888348, "deviation-heading": 0.5501933908035521, "set_robot_commands": 0.07959933652945445, "deviation-center-line": 0.33321411572814535, "driven_lanedir_consec": 0.3465233549666594, "sim_compute_sim_state": 0.03874408099668246, "sim_compute_performance-ego": 0.06831448467065257, "sim_compute_robot_state-ego": 0.06299897288599758, "sim_compute_robot_state-npc0": 0.0748940038342848, "sim_compute_robot_state-npc1": 0.07142406490677637, "sim_compute_robot_state-npc2": 0.06946872819400003, "sim_compute_robot_state-npc3": 0.06840125888797409}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.5767327422600936, "sim_physics": 0.09591750944814374, "survival_time": 10.85000000000002, "driven_lanedir": 1.2416141769078073, "sim_render-ego": 0.06715339669434156, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.15425567033653434, "deviation-heading": 1.4083883035350369, "set_robot_commands": 0.07901152377853746, "deviation-center-line": 0.6395179658578088, "driven_lanedir_consec": 1.2416141769078073, "sim_compute_sim_state": 0.03971744133030764, "sim_compute_performance-ego": 0.06818323091427851, "sim_compute_robot_state-ego": 0.06394096124007405, "sim_compute_robot_state-npc0": 0.07633166049482636, "sim_compute_robot_state-npc1": 0.07183921392062842, "sim_compute_robot_state-npc2": 0.07038625923719274, "sim_compute_robot_state-npc3": 0.06957355842062954}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1824083368295137, "sim_physics": 0.09705981413523355, "survival_time": 14.950000000000076, "driven_lanedir": 0.4632121180957165, "sim_render-ego": 0.06741995652516683, "in-drivable-lane": 10.500000000000064, "agent_compute-ego": 0.15755861202875773, "deviation-heading": 2.5988183506786204, "set_robot_commands": 0.0788708758354187, "deviation-center-line": 0.3466574247419256, "driven_lanedir_consec": 0.4632121180957165, "sim_compute_sim_state": 0.03955990711847941, "sim_compute_performance-ego": 0.06720725536346435, "sim_compute_robot_state-ego": 0.06298162778218587, "sim_compute_robot_state-npc0": 0.07492499192555746, "sim_compute_robot_state-npc1": 0.07096438725789388, "sim_compute_robot_state-npc2": 0.07027114073435466, "sim_compute_robot_state-npc3": 0.07048318068186442}}
set_robot_commands_max0.07994329556822777
set_robot_commands_mean0.07810918036638498
set_robot_commands_median0.07851966600569468
set_robot_commands_min0.0752247725947622
sim_compute_performance-ego_max0.06985646141899957
sim_compute_performance-ego_mean0.0657046476651517
sim_compute_performance-ego_median0.06657026110706242
sim_compute_performance-ego_min0.05860108850104957
sim_compute_robot_state-ego_max0.06810450553894043
sim_compute_robot_state-ego_mean0.06326780195394648
sim_compute_robot_state-ego_median0.06337554114205497
sim_compute_robot_state-ego_min0.05898531201923863
sim_compute_robot_state-npc0_max0.07714104016621907
sim_compute_robot_state-npc0_mean0.07384247042805382
sim_compute_robot_state-npc0_median0.07492499192555746
sim_compute_robot_state-npc0_min0.06622508724340412
sim_compute_robot_state-npc1_max0.07801451758732872
sim_compute_robot_state-npc1_mean0.0698593450171961
sim_compute_robot_state-npc1_median0.07092183828353882
sim_compute_robot_state-npc1_min0.06132914232865475
sim_compute_robot_state-npc2_max0.07325798776414659
sim_compute_robot_state-npc2_mean0.06806439975872512
sim_compute_robot_state-npc2_median0.06907018646597862
sim_compute_robot_state-npc2_min0.06151334406656512
sim_compute_robot_state-npc3_max0.07394528010534862
sim_compute_robot_state-npc3_mean0.06796927213491238
sim_compute_robot_state-npc3_median0.06868191370888362
sim_compute_robot_state-npc3_min0.060249324050246245
sim_compute_sim_state_max0.04237143577091278
sim_compute_sim_state_mean0.038323263478936526
sim_compute_sim_state_median0.03874408099668246
sim_compute_sim_state_min0.03336735205216841
sim_physics_max0.12011247211032444
sim_physics_mean0.0994456456476104
sim_physics_median0.09591750944814374
sim_physics_min0.09062655023533664
sim_render-ego_max0.06741995652516683
sim_render-ego_mean0.06399271139395707
sim_render-ego_median0.06533774754679794
sim_render-ego_min0.05465765432877974
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.283333333333336
survival_time_min2.6499999999999986
210112880Andrea Danieleminimal_agent (Python 3)aido2-LFV-sim-testingstep1-simulationsuccessno-0:57:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4278874896529574
survival_time_median7.049999999999983
deviation-center-line_median0.336080725822317
in-drivable-lane_median1.999999999999993


other stats
agent_compute-ego_max0.20625066242629675
agent_compute-ego_mean0.15942765071688964
agent_compute-ego_median0.15796940288846456
agent_compute-ego_min0.13733520731329918
deviation-center-line_max0.6395179658578088
deviation-center-line_mean0.3376081825040823
deviation-center-line_min0.18432680552089345
deviation-heading_max2.5988183506786204
deviation-heading_mean1.1439412496731016
deviation-heading_median1.0007157377877205
deviation-heading_min0.4339628546397995
driven_any_max2.1824083368295137
driven_any_mean1.041548572842095
driven_any_median1.002289442536604
driven_any_min0.3471148409579561
driven_lanedir_consec_max1.2416141769078073
driven_lanedir_consec_mean0.5855696461150995
driven_lanedir_consec_min0.32724226781545207
driven_lanedir_max1.2416141769078073
driven_lanedir_mean0.5855696461150995
driven_lanedir_median0.4278874896529574
driven_lanedir_min0.32724226781545207
in-drivable-lane_max10.500000000000064
in-drivable-lane_mean2.776666666666675
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900915586687412, "sim_physics": 0.22916683361684675, "survival_time": 6.949999999999983, "driven_lanedir": 0.6591401084474304, "sim_render-ego": 0.07936740436142298, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.20625066242629675, "deviation-heading": 0.801279189692507, "set_robot_commands": 0.13715228416936862, "deviation-center-line": 0.33899838427143014, "driven_lanedir_consec": 0.6591401084474304, "sim_compute_sim_state": 0.04764060493853453, "sim_compute_performance-ego": 0.0874028857663381, "sim_compute_robot_state-ego": 0.10181550499346616, "sim_compute_robot_state-npc0": 0.08838698160734108, "sim_compute_robot_state-npc1": 0.08522218937496487, "sim_compute_robot_state-npc2": 0.09123110428130884, "sim_compute_robot_state-npc3": 0.08702670069907209}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4167848967141688, "sim_physics": 0.1914641440860809, "survival_time": 3.149999999999997, "driven_lanedir": 0.3888322247827789, "sim_render-ego": 0.06203829674493699, "in-drivable-lane": 0, "agent_compute-ego": 0.15796940288846456, "deviation-heading": 1.1492236283129806, "set_robot_commands": 0.09633806773594449, "deviation-center-line": 0.22729035014002288, "driven_lanedir_consec": 0.3888322247827789, "sim_compute_sim_state": 0.04004759258694119, "sim_compute_performance-ego": 0.07027562837752085, "sim_compute_robot_state-ego": 0.07552159021771143, "sim_compute_robot_state-npc0": 0.0693080084664481, "sim_compute_robot_state-npc1": 0.07308818802000984, "sim_compute_robot_state-npc2": 0.07266428357078916, "sim_compute_robot_state-npc3": 0.07229011777847533}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6381859911990262, "sim_physics": 0.19158929930792917, "survival_time": 11.250000000000025, "driven_lanedir": 0.8981740479582627, "sim_render-ego": 0.06609155654907227, "in-drivable-lane": 4.85000000000004, "agent_compute-ego": 0.16163234180874295, "deviation-heading": 1.0007157377877205, "set_robot_commands": 0.1036596647898356, "deviation-center-line": 0.4843179558881834, "driven_lanedir_consec": 0.8981740479582627, "sim_compute_sim_state": 0.041642896864149306, "sim_compute_performance-ego": 0.07316384209526909, "sim_compute_robot_state-ego": 0.0787881088256836, "sim_compute_robot_state-npc0": 0.07318044874403212, "sim_compute_robot_state-npc1": 0.07344143019782172, "sim_compute_robot_state-npc2": 0.07340158250596789, "sim_compute_robot_state-npc3": 0.07287420060899523}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.578827325923981, "sim_physics": 0.18155628525167017, "survival_time": 10.85000000000002, "driven_lanedir": 1.2206700211390982, "sim_render-ego": 0.06430235326564807, "in-drivable-lane": 2.250000000000032, "agent_compute-ego": 0.1575156411816997, "deviation-heading": 1.0094809624268894, "set_robot_commands": 0.10169873918805804, "deviation-center-line": 0.41569520444906216, "driven_lanedir_consec": 1.2206700211390982, "sim_compute_sim_state": 0.04141711749239451, "sim_compute_performance-ego": 0.07218059087129232, "sim_compute_robot_state-ego": 0.07936792879060667, "sim_compute_robot_state-npc0": 0.0724995125273955, "sim_compute_robot_state-npc1": 0.0727780996929116, "sim_compute_robot_state-npc2": 0.07252473325773318, "sim_compute_robot_state-npc3": 0.07335500233733709}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.42438846278159503, "sim_physics": 0.17391671453203475, "survival_time": 3.149999999999997, "driven_lanedir": 0.4129829416491664, "sim_render-ego": 0.0644638008541531, "in-drivable-lane": 0, "agent_compute-ego": 0.1584649540129162, "deviation-heading": 0.7390440083021812, "set_robot_commands": 0.09890561255197676, "deviation-center-line": 0.22858033061406635, "driven_lanedir_consec": 0.4129829416491664, "sim_compute_sim_state": 0.04127595159742567, "sim_compute_performance-ego": 0.070970062225584, "sim_compute_robot_state-ego": 0.07679463946630084, "sim_compute_robot_state-npc0": 0.07451086952572777, "sim_compute_robot_state-npc1": 0.07302216121128627, "sim_compute_robot_state-npc2": 0.07221357406131805, "sim_compute_robot_state-npc3": 0.07067423775082543}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0504010241155275, "sim_physics": 0.17791348124203615, "survival_time": 7.299999999999982, "driven_lanedir": 0.39597378214039874, "sim_render-ego": 0.06367851773353472, "in-drivable-lane": 3.5499999999999874, "agent_compute-ego": 0.16281899034160455, "deviation-heading": 2.3434677844360583, "set_robot_commands": 0.10613428729854218, "deviation-center-line": 0.37507737640988825, "driven_lanedir_consec": 0.39597378214039874, "sim_compute_sim_state": 0.03993111930481375, "sim_compute_performance-ego": 0.07151747566379912, "sim_compute_robot_state-ego": 0.07637152116592616, "sim_compute_robot_state-npc0": 0.07182746390773825, "sim_compute_robot_state-npc1": 0.0747120837642722, "sim_compute_robot_state-npc2": 0.07101707262535618, "sim_compute_robot_state-npc3": 0.07173391727552023}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9925466226450728, "sim_physics": 0.18198401464832772, "survival_time": 6.949999999999983, "driven_lanedir": 0.647038156506072, "sim_render-ego": 0.0657822296773787, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.15779599011373177, "deviation-heading": 1.5590891377390808, "set_robot_commands": 0.09968334307773508, "deviation-center-line": 0.37918470593477854, "driven_lanedir_consec": 0.647038156506072, "sim_compute_sim_state": 0.04060445929602753, "sim_compute_performance-ego": 0.07327621274714848, "sim_compute_robot_state-ego": 0.07807872278227222, "sim_compute_robot_state-npc0": 0.07232903062010841, "sim_compute_robot_state-npc1": 0.07266074461902645, "sim_compute_robot_state-npc2": 0.07169891775940819, "sim_compute_robot_state-npc3": 0.07327548548472014}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.5143195051826088, "sim_physics": 0.1905337292611884, "survival_time": 10.450000000000014, "driven_lanedir": 0.5946085645782655, "sim_render-ego": 0.06522452089775121, "in-drivable-lane": 6.050000000000021, "agent_compute-ego": 0.16102795053326913, "deviation-heading": 1.0074551066905668, "set_robot_commands": 0.10201461691605418, "deviation-center-line": 0.31096291732963327, "driven_lanedir_consec": 0.5946085645782655, "sim_compute_sim_state": 0.03996281418503757, "sim_compute_performance-ego": 0.07165472016950543, "sim_compute_robot_state-ego": 0.07900250699531519, "sim_compute_robot_state-npc0": 0.07096044298564418, "sim_compute_robot_state-npc1": 0.07373606074940074, "sim_compute_robot_state-npc2": 0.07225090693058579, "sim_compute_robot_state-npc3": 0.0726801196924237}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0526053931137378, "sim_physics": 0.1690914047007658, "survival_time": 7.349999999999982, "driven_lanedir": 0.35306598250901233, "sim_render-ego": 0.06332642367096986, "in-drivable-lane": 4.599999999999984, "agent_compute-ego": 0.16059550460504027, "deviation-heading": 0.7493734577809043, "set_robot_commands": 0.09729511072846496, "deviation-center-line": 0.2543770508936741, "driven_lanedir_consec": 0.35306598250901233, "sim_compute_sim_state": 0.038569859095982144, "sim_compute_performance-ego": 0.0682073077377008, "sim_compute_robot_state-ego": 0.07476999321762397, "sim_compute_robot_state-npc0": 0.06995743472559922, "sim_compute_robot_state-npc1": 0.07051917647017913, "sim_compute_robot_state-npc2": 0.06957452475619154, "sim_compute_robot_state-npc3": 0.06920758720968856}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.4247089136171447, "sim_physics": 0.17239501362755186, "survival_time": 3.149999999999997, "driven_lanedir": 0.4065794545774155, "sim_render-ego": 0.05841676394144694, "in-drivable-lane": 0, "agent_compute-ego": 0.14488078677465047, "deviation-heading": 0.9116478049678652, "set_robot_commands": 0.0934402829124814, "deviation-center-line": 0.20984142395940591, "driven_lanedir_consec": 0.4065794545774155, "sim_compute_sim_state": 0.03780386939881339, "sim_compute_performance-ego": 0.06762866368369451, "sim_compute_robot_state-ego": 0.07295115788777669, "sim_compute_robot_state-npc0": 0.06576535058399988, "sim_compute_robot_state-npc1": 0.06449393242124528, "sim_compute_robot_state-npc2": 0.06655058028205993, "sim_compute_robot_state-npc3": 0.06996288753691174}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3471148409579561, "sim_physics": 0.20810989613802927, "survival_time": 2.6499999999999986, "driven_lanedir": 0.32724226781545207, "sim_render-ego": 0.06560814155722564, "in-drivable-lane": 0, "agent_compute-ego": 0.15713931029697634, "deviation-heading": 0.8969790273027586, "set_robot_commands": 0.0970117505991234, "deviation-center-line": 0.18432680552089345, "driven_lanedir_consec": 0.32724226781545207, "sim_compute_sim_state": 0.03766418403049685, "sim_compute_performance-ego": 0.07182773104253805, "sim_compute_robot_state-ego": 0.0746637650255887, "sim_compute_robot_state-npc0": 0.07176409577423672, "sim_compute_robot_state-npc1": 0.07241866723546442, "sim_compute_robot_state-npc2": 0.07199055293820938, "sim_compute_robot_state-npc3": 0.07078698896012216}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.43182353608565555, "sim_physics": 0.14712389186024666, "survival_time": 3.1999999999999966, "driven_lanedir": 0.4278874896529574, "sim_render-ego": 0.05805732682347298, "in-drivable-lane": 0, "agent_compute-ego": 0.13733520731329918, "deviation-heading": 0.4339628546397995, "set_robot_commands": 0.08466009795665741, "deviation-center-line": 0.336080725822317, "driven_lanedir_consec": 0.4278874896529574, "sim_compute_sim_state": 0.03487711027264595, "sim_compute_performance-ego": 0.05901094898581505, "sim_compute_robot_state-ego": 0.06827369332313538, "sim_compute_robot_state-npc0": 0.06261763349175453, "sim_compute_robot_state-npc1": 0.05980796739459038, "sim_compute_robot_state-npc2": 0.06020103022456169, "sim_compute_robot_state-npc3": 0.06085248291492462}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.002289442536604, "sim_physics": 0.14985266137630382, "survival_time": 7.049999999999983, "driven_lanedir": 0.3465233549666594, "sim_render-ego": 0.05446057454914066, "in-drivable-lane": 4.3499999999999845, "agent_compute-ego": 0.13861337452070088, "deviation-heading": 0.5501933908035521, "set_robot_commands": 0.08651676076523801, "deviation-center-line": 0.33321411572814535, "driven_lanedir_consec": 0.3465233549666594, "sim_compute_sim_state": 0.03463747822646553, "sim_compute_performance-ego": 0.06111820877021086, "sim_compute_robot_state-ego": 0.06659166694532895, "sim_compute_robot_state-npc0": 0.061843765542862264, "sim_compute_robot_state-npc1": 0.06128234897099488, "sim_compute_robot_state-npc2": 0.06240696940861695, "sim_compute_robot_state-npc3": 0.06093234204231424}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.5767327422600936, "sim_physics": 0.1986188822627617, "survival_time": 10.85000000000002, "driven_lanedir": 1.2416141769078073, "sim_render-ego": 0.06283088433577717, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.15790817814488564, "deviation-heading": 1.4083883035350369, "set_robot_commands": 0.09910163132276403, "deviation-center-line": 0.6395179658578088, "driven_lanedir_consec": 1.2416141769078073, "sim_compute_sim_state": 0.039138935678016205, "sim_compute_performance-ego": 0.06873075753313056, "sim_compute_robot_state-ego": 0.07393582075971612, "sim_compute_robot_state-npc0": 0.07033262055041054, "sim_compute_robot_state-npc1": 0.06940157841976886, "sim_compute_robot_state-npc2": 0.06837918571612801, "sim_compute_robot_state-npc3": 0.06983649346136278}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1824083368295137, "sim_physics": 0.20162309249242147, "survival_time": 14.950000000000076, "driven_lanedir": 0.4632121180957165, "sim_render-ego": 0.06957073529561361, "in-drivable-lane": 10.500000000000064, "agent_compute-ego": 0.17146646579106647, "deviation-heading": 2.5988183506786204, "set_robot_commands": 0.10960356473922728, "deviation-center-line": 0.3466574247419256, "driven_lanedir_consec": 0.4632121180957165, "sim_compute_sim_state": 0.042099182605743406, "sim_compute_performance-ego": 0.07581034501393637, "sim_compute_robot_state-ego": 0.08636175235112509, "sim_compute_robot_state-npc0": 0.07698588530222575, "sim_compute_robot_state-npc1": 0.07687935590744019, "sim_compute_robot_state-npc2": 0.076132284005483, "sim_compute_robot_state-npc3": 0.07746575355529785}}
set_robot_commands_max0.13715228416936862
set_robot_commands_mean0.10088105431676476
set_robot_commands_median0.09910163132276403
set_robot_commands_min0.08466009795665741
sim_compute_performance-ego_max0.0874028857663381
sim_compute_performance-ego_mean0.07085169204556557
sim_compute_performance-ego_median0.07151747566379912
sim_compute_performance-ego_min0.05901094898581505
sim_compute_robot_state-ego_max0.10181550499346616
sim_compute_robot_state-ego_mean0.0775525581831718
sim_compute_robot_state-ego_median0.07637152116592616
sim_compute_robot_state-ego_min0.06659166694532895
sim_compute_robot_state-npc0_max0.08838698160734108
sim_compute_robot_state-npc0_mean0.0714846362903683
sim_compute_robot_state-npc0_median0.07176409577423672
sim_compute_robot_state-npc0_min0.061843765542862264
sim_compute_robot_state-npc1_max0.08522218937496487
sim_compute_robot_state-npc1_mean0.07156426562995846
sim_compute_robot_state-npc1_median0.0727780996929116
sim_compute_robot_state-npc1_min0.05980796739459038
sim_compute_robot_state-npc2_max0.09123110428130884
sim_compute_robot_state-npc2_mean0.07148248682158118
sim_compute_robot_state-npc2_median0.07199055293820938
sim_compute_robot_state-npc2_min0.06020103022456169
sim_compute_robot_state-npc3_max0.08702670069907209
sim_compute_robot_state-npc3_mean0.07153028782053275
sim_compute_robot_state-npc3_median0.07173391727552023
sim_compute_robot_state-npc3_min0.06085248291492462
sim_compute_sim_state_max0.04764060493853453
sim_compute_sim_state_mean0.03982087837156583
sim_compute_sim_state_median0.03996281418503757
sim_compute_sim_state_min0.03463747822646553
sim_physics_max0.22916683361684675
sim_physics_mean0.1843292896269463
sim_physics_median0.18198401464832772
sim_physics_min0.14712389186024666
sim_render-ego_max0.07936740436142298
sim_render-ego_mean0.064214635350503
sim_render-ego_median0.06430235326564807
sim_render-ego_min0.05446057454914066
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.283333333333336
survival_time_min2.6499999999999986
209712880Andrea Danieleminimal_agent (Python 3)aido2-LFV-sim-testingstep1-simulationhost-errorno-0:49:38
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2880/step1-simulation-ip-172-31-38-104-5197-job20971/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
209512880Andrea Danieleminimal_agent (Python 3)aido2-LFV-sim-testingstep1-simulationhost-errorno-0:04:15
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2880/step1-simulation-ip-172-31-42-167-7194-job20951/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
202792880Andrea Danieleminimal_agent (Python 3)aido2-LFV-sim-testingstep1-simulationsuccessno-0:19:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.658141340093886
survival_time_median6.999999999999983
deviation-center-line_median0.3310166859136158
in-drivable-lane_median2.0499999999999927


other stats
agent_compute-ego_max0.16445061248568346
agent_compute-ego_mean0.16054849906932414
agent_compute-ego_median0.1589739599398204
agent_compute-ego_min0.1583586641720363
deviation-center-line_max0.4794323637301212
deviation-center-line_mean0.3427896670341769
deviation-center-line_min0.2298545284155696
deviation-heading_max1.1504193675314938
deviation-heading_mean0.9407336626620916
deviation-heading_median0.9938354337214896
deviation-heading_min0.7450586214352332
driven_any_max1.6290075912696764
driven_any_mean1.0117836241191598
driven_any_median0.9970530395825568
driven_any_min0.4251549262204664
driven_lanedir_consec_max1.214560148863141
driven_lanedir_consec_mean0.7110836872382787
driven_lanedir_consec_min0.4039437775266599
driven_lanedir_max1.214560148863141
driven_lanedir_mean0.7110836872382787
driven_lanedir_median0.658141340093886
driven_lanedir_min0.4039437775266599
in-drivable-lane_max5.000000000000038
in-drivable-lane_mean1.8700000000000128
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9970530395825568, "sim_physics": 0.17205593075071063, "survival_time": 6.999999999999983, "driven_lanedir": 0.658141340093886, "sim_render-ego": 0.06373628888811383, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.1583586641720363, "deviation-heading": 0.8064348941516836, "set_robot_commands": 0.09882202318736484, "deviation-center-line": 0.3310166859136158, "driven_lanedir_consec": 0.658141340093886, "sim_compute_sim_state": 0.039644307749611994, "sim_compute_performance-ego": 0.06898339305605207, "sim_compute_robot_state-ego": 0.07459180865968977, "sim_compute_robot_state-npc0": 0.07095036847250802, "sim_compute_robot_state-npc1": 0.07119429111480713, "sim_compute_robot_state-npc2": 0.06991058247429983, "sim_compute_robot_state-npc3": 0.07094243253980365}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.43097149972321946, "sim_physics": 0.17481787754939151, "survival_time": 3.2499999999999964, "driven_lanedir": 0.4039437775266599, "sim_render-ego": 0.0637566456427941, "in-drivable-lane": 0, "agent_compute-ego": 0.16259857691251314, "deviation-heading": 1.1504193675314938, "set_robot_commands": 0.10252596781804012, "deviation-center-line": 0.23438865875177528, "driven_lanedir_consec": 0.4039437775266599, "sim_compute_sim_state": 0.039790149835439825, "sim_compute_performance-ego": 0.07226204505333533, "sim_compute_robot_state-ego": 0.07787397824800932, "sim_compute_robot_state-npc0": 0.07124311006986178, "sim_compute_robot_state-npc1": 0.07177085142869216, "sim_compute_robot_state-npc2": 0.07263193130493165, "sim_compute_robot_state-npc3": 0.07184024590712328}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6290075912696764, "sim_physics": 0.17851558327674866, "survival_time": 11.200000000000024, "driven_lanedir": 0.8652843360363267, "sim_render-ego": 0.06203322751181466, "in-drivable-lane": 5.000000000000038, "agent_compute-ego": 0.1589739599398204, "deviation-heading": 1.007919996470557, "set_robot_commands": 0.0992854620729174, "deviation-center-line": 0.4794323637301212, "driven_lanedir_consec": 0.8652843360363267, "sim_compute_sim_state": 0.03947242668696812, "sim_compute_performance-ego": 0.07200472056865692, "sim_compute_robot_state-ego": 0.07477397258792605, "sim_compute_robot_state-npc0": 0.07015963643789291, "sim_compute_robot_state-npc1": 0.06991691674504961, "sim_compute_robot_state-npc2": 0.07138667574950627, "sim_compute_robot_state-npc3": 0.07025516884667533}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.57673106379988, "sim_physics": 0.1817690007697602, "survival_time": 10.85000000000002, "driven_lanedir": 1.214560148863141, "sim_render-ego": 0.06549253551641368, "in-drivable-lane": 2.3000000000000327, "agent_compute-ego": 0.16445061248568346, "deviation-heading": 0.9938354337214896, "set_robot_commands": 0.10732454748197634, "deviation-center-line": 0.4392560983598026, "driven_lanedir_consec": 1.214560148863141, "sim_compute_sim_state": 0.04044880185808454, "sim_compute_performance-ego": 0.07226100824944984, "sim_compute_robot_state-ego": 0.07935429608217583, "sim_compute_robot_state-npc0": 0.07369383798766246, "sim_compute_robot_state-npc1": 0.07191507607561103, "sim_compute_robot_state-npc2": 0.07362468781009797, "sim_compute_robot_state-npc3": 0.07254307940258958}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4251549262204664, "sim_physics": 0.1473480709015377, "survival_time": 3.149999999999997, "driven_lanedir": 0.4134888336713798, "sim_render-ego": 0.06137187518770733, "in-drivable-lane": 0, "agent_compute-ego": 0.15836068183656724, "deviation-heading": 0.7450586214352332, "set_robot_commands": 0.09998539515904016, "deviation-center-line": 0.2298545284155696, "driven_lanedir_consec": 0.4134888336713798, "sim_compute_sim_state": 0.040661527996971494, "sim_compute_performance-ego": 0.06782636188325428, "sim_compute_robot_state-ego": 0.07242545248970153, "sim_compute_robot_state-npc0": 0.07195923441932314, "sim_compute_robot_state-npc1": 0.06875869962904188, "sim_compute_robot_state-npc2": 0.07240713588775151, "sim_compute_robot_state-npc3": 0.07501849674043201}}
set_robot_commands_max0.10732454748197634
set_robot_commands_mean0.10158867914386778
set_robot_commands_median0.09998539515904016
set_robot_commands_min0.09882202318736484
sim_compute_performance-ego_max0.07226204505333533
sim_compute_performance-ego_mean0.07066750576214968
sim_compute_performance-ego_median0.07200472056865692
sim_compute_performance-ego_min0.06782636188325428
sim_compute_robot_state-ego_max0.07935429608217583
sim_compute_robot_state-ego_mean0.07580390161350051
sim_compute_robot_state-ego_median0.07477397258792605
sim_compute_robot_state-ego_min0.07242545248970153
sim_compute_robot_state-npc0_max0.07369383798766246
sim_compute_robot_state-npc0_mean0.07160123747744966
sim_compute_robot_state-npc0_median0.07124311006986178
sim_compute_robot_state-npc0_min0.07015963643789291
sim_compute_robot_state-npc1_max0.07191507607561103
sim_compute_robot_state-npc1_mean0.07071116699864037
sim_compute_robot_state-npc1_median0.07119429111480713
sim_compute_robot_state-npc1_min0.06875869962904188
sim_compute_robot_state-npc2_max0.07362468781009797
sim_compute_robot_state-npc2_mean0.07199220264531744
sim_compute_robot_state-npc2_median0.07240713588775151
sim_compute_robot_state-npc2_min0.06991058247429983
sim_compute_robot_state-npc3_max0.07501849674043201
sim_compute_robot_state-npc3_mean0.07211988468732478
sim_compute_robot_state-npc3_median0.07184024590712328
sim_compute_robot_state-npc3_min0.07025516884667533
sim_compute_sim_state_max0.040661527996971494
sim_compute_sim_state_mean0.040003442825415195
sim_compute_sim_state_median0.039790149835439825
sim_compute_sim_state_min0.03947242668696812
sim_physics_max0.1817690007697602
sim_physics_mean0.17090129264962975
sim_physics_median0.17481787754939151
sim_physics_min0.1473480709015377
sim_render-ego_max0.06549253551641368
sim_render-ego_mean0.06327811454936873
sim_render-ego_median0.06373628888811383
sim_render-ego_min0.06137187518770733
simulation-passed1
survival_time_max11.200000000000024
survival_time_mean7.090000000000005
survival_time_min3.149999999999997
202632880Andrea Danieleminimal_agent (Python 3)aido2-LFV-sim-testingstep1-simulationhost-errorno-0:09:58
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20263-123184', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20263-123184', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20263-123184', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
193352880Andrea Danieleminimal_agent (Python 3)aido2-LFV-sim-testingstep1-simulationsuccessno-0:24:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2271628965464352
survival_time_median10.800000000000018
deviation-center-line_median0.4302836987803837
in-drivable-lane_median2.0499999999999927


other stats
agent_compute-ego_max0.16472830454508464
agent_compute-ego_mean0.1474205445921683
agent_compute-ego_median0.14921223183381394
agent_compute-ego_min0.11768155874207964
deviation-center-line_max0.5576039074284667
deviation-center-line_mean0.3744391706010032
deviation-center-line_min0.1475671628461062
deviation-heading_max1.826624936691222
deviation-heading_mean1.1745965471911113
deviation-heading_median0.9779276407610488
deviation-heading_min0.7451786321286323
driven_any_max2.1956524856063173
driven_any_mean1.585349600382327
driven_any_median1.5771367475578253
driven_any_min0.993745776226499
driven_lanedir_consec_max1.659262210665728
driven_lanedir_consec_mean1.1960969538526285
driven_lanedir_consec_min0.6474115509746436
driven_lanedir_max1.659262210665728
driven_lanedir_mean1.1960969538526285
driven_lanedir_median1.2271628965464352
driven_lanedir_min0.6474115509746436
in-drivable-lane_max3.5000000000000497
in-drivable-lane_mean2.280000000000025
in-drivable-lane_min1.7000000000000242
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.993745776226499, "sim_physics": 0.04341198557572399, "survival_time": 6.949999999999983, "driven_lanedir": 0.6474115509746436, "sim_render-ego": 0.06558374020693114, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.15695132454522223, "deviation-heading": 0.8273534093107037, "set_robot_commands": 0.09861496884188206, "deviation-center-line": 0.1475671628461062, "driven_lanedir_consec": 0.6474115509746436, "sim_compute_sim_state": 0.0402619306989711, "sim_compute_performance-ego": 0.07121606010327236, "sim_compute_robot_state-ego": 0.07467724608002807, "sim_compute_robot_state-npc0": 0.07156812372825129, "sim_compute_robot_state-npc1": 0.07282463766688066, "sim_compute_robot_state-npc2": 0.07193218546805621, "sim_compute_robot_state-npc3": 0.0722436510401664}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.1956524856063173, "sim_physics": 0.043131834665934246, "survival_time": 14.950000000000076, "driven_lanedir": 1.659262210665728, "sim_render-ego": 0.06657022714614869, "in-drivable-lane": 3.5000000000000497, "agent_compute-ego": 0.16472830454508464, "deviation-heading": 0.9779276407610488, "set_robot_commands": 0.1055268375078837, "deviation-center-line": 0.5576039074284667, "driven_lanedir_consec": 1.659262210665728, "sim_compute_sim_state": 0.04279696305592855, "sim_compute_performance-ego": 0.07518502473831176, "sim_compute_robot_state-ego": 0.07843102137247722, "sim_compute_robot_state-npc0": 0.07497341950734457, "sim_compute_robot_state-npc1": 0.07521727244059245, "sim_compute_robot_state-npc2": 0.07386375427246093, "sim_compute_robot_state-npc3": 0.0751126519838969}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.583473805081668, "sim_physics": 0.035911417227186916, "survival_time": 10.85000000000002, "driven_lanedir": 1.243796514016382, "sim_render-ego": 0.06029861204085812, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.14921223183381394, "deviation-heading": 1.4958981170639498, "set_robot_commands": 0.09282246602845082, "deviation-center-line": 0.28274302907821136, "driven_lanedir_consec": 1.243796514016382, "sim_compute_sim_state": 0.03690491184111564, "sim_compute_performance-ego": 0.0656473515769853, "sim_compute_robot_state-ego": 0.07064687381691646, "sim_compute_robot_state-npc0": 0.06719370811216292, "sim_compute_robot_state-npc1": 0.06406971166760142, "sim_compute_robot_state-npc2": 0.06508299941840809, "sim_compute_robot_state-npc3": 0.06874413204632597}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5767391874393253, "sim_physics": 0.03779627327565794, "survival_time": 10.800000000000018, "driven_lanedir": 1.2271628965464352, "sim_render-ego": 0.05953850900685346, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.148529303294641, "deviation-heading": 1.826624936691222, "set_robot_commands": 0.09413533850952432, "deviation-center-line": 0.4302836987803837, "driven_lanedir_consec": 1.2271628965464352, "sim_compute_sim_state": 0.03962848142341331, "sim_compute_performance-ego": 0.06829722611992448, "sim_compute_robot_state-ego": 0.07211207681232029, "sim_compute_robot_state-npc0": 0.06952886007450244, "sim_compute_robot_state-npc1": 0.06870301123018618, "sim_compute_robot_state-npc2": 0.06752204122366728, "sim_compute_robot_state-npc3": 0.06952520763432538}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5771367475578253, "sim_physics": 0.027726428453312364, "survival_time": 10.750000000000018, "driven_lanedir": 1.2028515970599525, "sim_render-ego": 0.05076620079750239, "in-drivable-lane": 2.3500000000000334, "agent_compute-ego": 0.11768155874207964, "deviation-heading": 0.7451786321286323, "set_robot_commands": 0.07561893795811853, "deviation-center-line": 0.4539980548718481, "driven_lanedir_consec": 1.2028515970599525, "sim_compute_sim_state": 0.03080616219099178, "sim_compute_performance-ego": 0.05149539348691009, "sim_compute_robot_state-ego": 0.05286264419555664, "sim_compute_robot_state-npc0": 0.059012770098309186, "sim_compute_robot_state-npc1": 0.058258980374003566, "sim_compute_robot_state-npc2": 0.05424048290696255, "sim_compute_robot_state-npc3": 0.07872579596763433}}
set_robot_commands_max0.1055268375078837
set_robot_commands_mean0.09334370976917188
set_robot_commands_median0.09413533850952432
set_robot_commands_min0.07561893795811853
sim_compute_performance-ego_max0.07518502473831176
sim_compute_performance-ego_mean0.0663682112050808
sim_compute_performance-ego_median0.06829722611992448
sim_compute_performance-ego_min0.05149539348691009
sim_compute_robot_state-ego_max0.07843102137247722
sim_compute_robot_state-ego_mean0.06974597245545974
sim_compute_robot_state-ego_median0.07211207681232029
sim_compute_robot_state-ego_min0.05286264419555664
sim_compute_robot_state-npc0_max0.07497341950734457
sim_compute_robot_state-npc0_mean0.06845537630411408
sim_compute_robot_state-npc0_median0.06952886007450244
sim_compute_robot_state-npc0_min0.059012770098309186
sim_compute_robot_state-npc1_max0.07521727244059245
sim_compute_robot_state-npc1_mean0.06781472267585285
sim_compute_robot_state-npc1_median0.06870301123018618
sim_compute_robot_state-npc1_min0.058258980374003566
sim_compute_robot_state-npc2_max0.07386375427246093
sim_compute_robot_state-npc2_mean0.06652829265791102
sim_compute_robot_state-npc2_median0.06752204122366728
sim_compute_robot_state-npc2_min0.05424048290696255
sim_compute_robot_state-npc3_max0.07872579596763433
sim_compute_robot_state-npc3_mean0.07287028773446981
sim_compute_robot_state-npc3_median0.0722436510401664
sim_compute_robot_state-npc3_min0.06874413204632597
sim_compute_sim_state_max0.04279696305592855
sim_compute_sim_state_mean0.03807968984208407
sim_compute_sim_state_median0.03962848142341331
sim_compute_sim_state_min0.03080616219099178
sim_physics_max0.04341198557572399
sim_physics_mean0.037595587839563085
sim_physics_median0.03779627327565794
sim_physics_min0.027726428453312364
sim_render-ego_max0.06657022714614869
sim_render-ego_mean0.06055145783965876
sim_render-ego_median0.06029861204085812
sim_render-ego_min0.05076620079750239
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.860000000000024
survival_time_min6.949999999999983
192952880Andrea Danieleminimal_agent (Python 3)aido2-LFV-sim-testingstep1-simulationhost-errorno-0:10:56
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19295-723628', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19295-723628', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19295-723628', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
189432880Andrea Danieleminimal_agent (Python 3)aido2-LFV-sim-testingstep1-simulationerrorno-0:20:58
Waited 1204 seconds [...]
Waited 1204 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
189422880Andrea Danieleminimal_agent (Python 3)aido2-LFV-sim-testingstep1-simulationhost-errorno-0:05:59
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18942-41914', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18942-41914', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18942-41914', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
189352880Andrea Danieleminimal_agent (Python 3)aido2-LFV-sim-testingstep1-simulationhost-errorno-0:23:28
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 481, in get_cr
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1016, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1171, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1217, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2880/step1-simulation-nutonomy-P50-5996-job18935/tmp/tmp4bxcuksu/attempts/ETHZ_autolab_technical_track-4-0.attempt4/log.gs2.cbor']' returned non-zero exit status 1.
Hidden. If you are the author, please login using the top-right link or use the dashboard.