AI Driving Olympics Home Challenges Submissions Jobs

Submission 2680

Submission2680
Competingyes
Challengeaido2-LFV-sim-testing
UserRamiNaim
Date submitted
Completecomplete
Resultsuccess
Jobsstep1-simulation: 22829
Next
User labelchallenge-aido_LF-baseline-duckietown
Admin priority50
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
228292680RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationsuccessyes-0:46:18(hidden)
driven_lanedir_consec_median0.8978797544254031
survival_time_median14.950000000000076
deviation-center-line_median0.9053887635539783
in-drivable-lane_median1.8500000000000183


other stats
agent_compute-ego_max0.0410152276357015
agent_compute-ego_mean0.03902189303630465
agent_compute-ego_median0.03871884584426879
agent_compute-ego_min0.038430514335632326
deviation-center-line_max1.1827260995852698
deviation-center-line_mean0.7986541810975463
deviation-center-line_min0.3265371245987829
deviation-heading_max7.287015811488866
deviation-heading_mean4.666623975752733
deviation-heading_median5.24216003320387
deviation-heading_min0.7992649948727001
driven_any_max2.349068078523283
driven_any_mean1.7996518530968126
driven_any_median2.34856485195945
driven_any_min0.6446759124755118
driven_lanedir_consec_max2.022275049294276
driven_lanedir_consec_mean0.9983701823540848
driven_lanedir_consec_min0.24750745880541647
driven_lanedir_max2.022275049294276
driven_lanedir_mean1.2452160723074783
driven_lanedir_median1.2939518100970635
driven_lanedir_min0.4639779886949782
in-drivable-lane_max4.600000000000008
in-drivable-lane_mean1.83666666666667
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6446759124755118, "sim_physics": 0.07152023476161314, "survival_time": 4.449999999999992, "driven_lanedir": 0.5085655977799672, "sim_render-ego": 0.03475114468778117, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.04037911972303069, "deviation-heading": 1.4529882919224093, "set_robot_commands": 0.051434168654881166, "deviation-center-line": 0.3265371245987829, "driven_lanedir_consec": 0.5085655977799672, "sim_compute_sim_state": 0.021465130066603756, "sim_compute_performance-ego": 0.03671217232607723, "sim_compute_robot_state-ego": 0.0388655448227786, "sim_compute_robot_state-npc0": 0.037628476539354645, "sim_compute_robot_state-npc1": 0.037997476170572, "sim_compute_robot_state-npc2": 0.037983546096287416, "sim_compute_robot_state-npc3": 0.03745567396785436}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3486643617000205, "sim_physics": 0.07059879144032796, "survival_time": 14.950000000000076, "driven_lanedir": 1.6486043873428429, "sim_render-ego": 0.0341278338432312, "in-drivable-lane": 1.8500000000000183, "agent_compute-ego": 0.03871884584426879, "deviation-heading": 7.129794909194173, "set_robot_commands": 0.05224060455958048, "deviation-center-line": 0.9648410879914784, "driven_lanedir_consec": 1.241300151966395, "sim_compute_sim_state": 0.02162352164586385, "sim_compute_performance-ego": 0.037071423530578615, "sim_compute_robot_state-ego": 0.03855469783147176, "sim_compute_robot_state-npc0": 0.03772365172704061, "sim_compute_robot_state-npc1": 0.03797820011774699, "sim_compute_robot_state-npc2": 0.03778666734695434, "sim_compute_robot_state-npc3": 0.037799630959828696}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3486169895288564, "sim_physics": 0.07009765227635702, "survival_time": 14.950000000000076, "driven_lanedir": 1.2939518100970635, "sim_render-ego": 0.0339020037651062, "in-drivable-lane": 3.6000000000000068, "agent_compute-ego": 0.03865463813145956, "deviation-heading": 7.287015811488866, "set_robot_commands": 0.05201335430145264, "deviation-center-line": 0.8795195010110861, "driven_lanedir_consec": 0.8589812116333073, "sim_compute_sim_state": 0.02135192632675171, "sim_compute_performance-ego": 0.037140968640645346, "sim_compute_robot_state-ego": 0.03826268513997396, "sim_compute_robot_state-npc0": 0.03766241312026977, "sim_compute_robot_state-npc1": 0.037969391345977786, "sim_compute_robot_state-npc2": 0.03790225505828857, "sim_compute_robot_state-npc3": 0.03786034901936849}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3485874889438167, "sim_physics": 0.07178265810012817, "survival_time": 14.950000000000076, "driven_lanedir": 1.2931001153650192, "sim_render-ego": 0.033975416819254554, "in-drivable-lane": 4.600000000000008, "agent_compute-ego": 0.03949803511301676, "deviation-heading": 5.370937819382867, "set_robot_commands": 0.05218669732411702, "deviation-center-line": 1.006528047271139, "driven_lanedir_consec": 0.8939800674811287, "sim_compute_sim_state": 0.02141225814819336, "sim_compute_performance-ego": 0.037219637235005695, "sim_compute_robot_state-ego": 0.03861245393753051, "sim_compute_robot_state-npc0": 0.037773265838623046, "sim_compute_robot_state-npc1": 0.03796491543451945, "sim_compute_robot_state-npc2": 0.03787972132364909, "sim_compute_robot_state-npc3": 0.037599267164866126}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6454831015144277, "sim_physics": 0.06520662362548127, "survival_time": 4.3499999999999925, "driven_lanedir": 0.6333644034153836, "sim_render-ego": 0.03432203709394082, "in-drivable-lane": 0, "agent_compute-ego": 0.038747395592174314, "deviation-heading": 0.7992649948727001, "set_robot_commands": 0.05194716892023196, "deviation-center-line": 0.3583495808721403, "driven_lanedir_consec": 0.6333644034153836, "sim_compute_sim_state": 0.0214436465296252, "sim_compute_performance-ego": 0.03692472118070756, "sim_compute_robot_state-ego": 0.038184683898399616, "sim_compute_robot_state-npc0": 0.03824785111964434, "sim_compute_robot_state-npc1": 0.037701946565474584, "sim_compute_robot_state-npc2": 0.03785560048859695, "sim_compute_robot_state-npc3": 0.03727758067777787}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.071188250223395, "sim_physics": 0.07013532263892037, "survival_time": 6.999999999999983, "driven_lanedir": 0.5566436956560228, "sim_render-ego": 0.03421661513192313, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.03853212084089007, "deviation-heading": 3.3917851165100856, "set_robot_commands": 0.05223367043903896, "deviation-center-line": 0.5658477439972391, "driven_lanedir_consec": 0.28889244118302204, "sim_compute_sim_state": 0.02150033371789115, "sim_compute_performance-ego": 0.03702266727175031, "sim_compute_robot_state-ego": 0.03955997228622436, "sim_compute_robot_state-npc0": 0.037786456516810826, "sim_compute_robot_state-npc1": 0.03810385465621948, "sim_compute_robot_state-npc2": 0.03775852067129953, "sim_compute_robot_state-npc3": 0.03770705461502075}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9106108218985782, "sim_physics": 0.07075324654579163, "survival_time": 5.999999999999987, "driven_lanedir": 0.8619235094803662, "sim_render-ego": 0.034204667806625365, "in-drivable-lane": 0, "agent_compute-ego": 0.03856101234753927, "deviation-heading": 1.4794498745455007, "set_robot_commands": 0.05223226348559062, "deviation-center-line": 0.4781765916297879, "driven_lanedir_consec": 0.8619235094803662, "sim_compute_sim_state": 0.021222678820292155, "sim_compute_performance-ego": 0.03742044369379679, "sim_compute_robot_state-ego": 0.038370126485824586, "sim_compute_robot_state-npc0": 0.038155738512674967, "sim_compute_robot_state-npc1": 0.03773999015490214, "sim_compute_robot_state-npc2": 0.03849217096964518, "sim_compute_robot_state-npc3": 0.03814038435618083}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.7658832312059227, "sim_physics": 0.07007530623791265, "survival_time": 5.09999999999999, "driven_lanedir": 0.4639779886949782, "sim_render-ego": 0.034153386658313224, "in-drivable-lane": 0.55, "agent_compute-ego": 0.0410152276357015, "deviation-heading": 2.9457570883426687, "set_robot_commands": 0.05136306379355636, "deviation-center-line": 0.4726268180199212, "driven_lanedir_consec": 0.24750745880541647, "sim_compute_sim_state": 0.021163631887996897, "sim_compute_performance-ego": 0.03677391772176705, "sim_compute_robot_state-ego": 0.0386196117775113, "sim_compute_robot_state-npc0": 0.0377655076045616, "sim_compute_robot_state-npc1": 0.03828177966323553, "sim_compute_robot_state-npc2": 0.03792843397925882, "sim_compute_robot_state-npc3": 0.03819968653660195}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.3488046627326997, "sim_physics": 0.06894954919815063, "survival_time": 14.950000000000076, "driven_lanedir": 1.948707000596421, "sim_render-ego": 0.0339596144358317, "in-drivable-lane": 0.7000000000000031, "agent_compute-ego": 0.038630271752675374, "deviation-heading": 5.829305210448549, "set_robot_commands": 0.05206413427988688, "deviation-center-line": 1.1081301352868396, "driven_lanedir_consec": 1.4215317188111218, "sim_compute_sim_state": 0.02140802303949992, "sim_compute_performance-ego": 0.0367464025815328, "sim_compute_robot_state-ego": 0.03812904755274455, "sim_compute_robot_state-npc0": 0.037823726336161295, "sim_compute_robot_state-npc1": 0.037701642513275145, "sim_compute_robot_state-npc2": 0.037548521359761555, "sim_compute_robot_state-npc3": 0.03755371809005737}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.348675149610332, "sim_physics": 0.07312440554300945, "survival_time": 14.950000000000076, "driven_lanedir": 1.375361041512425, "sim_render-ego": 0.03416662931442261, "in-drivable-lane": 3.3000000000000114, "agent_compute-ego": 0.038430514335632326, "deviation-heading": 7.070502895800575, "set_robot_commands": 0.05176014423370361, "deviation-center-line": 0.787762859460344, "driven_lanedir_consec": 1.1917471920683638, "sim_compute_sim_state": 0.02143421729405721, "sim_compute_performance-ego": 0.03715886036554973, "sim_compute_robot_state-ego": 0.038602335453033446, "sim_compute_robot_state-npc0": 0.03778303225835165, "sim_compute_robot_state-npc1": 0.03799190203348795, "sim_compute_robot_state-npc2": 0.03770037015279134, "sim_compute_robot_state-npc3": 0.03789130846659342}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.349068078523283, "sim_physics": 0.0679710292816162, "survival_time": 14.950000000000076, "driven_lanedir": 1.8444163179922024, "sim_render-ego": 0.034144775072733564, "in-drivable-lane": 1.900000000000003, "agent_compute-ego": 0.0387628165880839, "deviation-heading": 5.24216003320387, "set_robot_commands": 0.05228164037068685, "deviation-center-line": 0.9985419346867458, "driven_lanedir_consec": 1.8444163179922024, "sim_compute_sim_state": 0.021434213320414227, "sim_compute_performance-ego": 0.03699474414189657, "sim_compute_robot_state-ego": 0.03842739661534627, "sim_compute_robot_state-npc0": 0.03781946023305257, "sim_compute_robot_state-npc1": 0.037896774609883624, "sim_compute_robot_state-npc2": 0.03782220602035522, "sim_compute_robot_state-npc3": 0.037617974281311035}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.3490417922239817, "sim_physics": 0.06689083258310954, "survival_time": 14.950000000000076, "driven_lanedir": 2.022275049294276, "sim_render-ego": 0.03363688309987386, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.03905247767766317, "deviation-heading": 4.1972179821626705, "set_robot_commands": 0.051466715335845944, "deviation-center-line": 1.0386131686552715, "driven_lanedir_consec": 2.022275049294276, "sim_compute_sim_state": 0.02125149647394816, "sim_compute_performance-ego": 0.03679918845494588, "sim_compute_robot_state-ego": 0.038499943415323895, "sim_compute_robot_state-npc0": 0.03752013921737671, "sim_compute_robot_state-npc1": 0.03754080931345622, "sim_compute_robot_state-npc2": 0.03782504717508952, "sim_compute_robot_state-npc3": 0.0378455909093221}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.8183701846397415, "sim_physics": 0.06720255884489788, "survival_time": 11.65000000000003, "driven_lanedir": 1.254122761820048, "sim_render-ego": 0.03446632802742233, "in-drivable-lane": 1.7999999999999952, "agent_compute-ego": 0.038507359222281136, "deviation-heading": 4.736929297442443, "set_robot_commands": 0.05190430792616161, "deviation-center-line": 0.9053887635539783, "driven_lanedir_consec": 1.0799769557365442, "sim_compute_sim_state": 0.02147573053581009, "sim_compute_performance-ego": 0.037211633035553374, "sim_compute_robot_state-ego": 0.0384113716976837, "sim_compute_robot_state-npc0": 0.038171670979184655, "sim_compute_robot_state-npc1": 0.03806118596776872, "sim_compute_robot_state-npc2": 0.03799399899822448, "sim_compute_robot_state-npc3": 0.037845064130463825}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.34856485195945, "sim_physics": 0.06996794859568278, "survival_time": 14.950000000000076, "driven_lanedir": 1.362205116595515, "sim_render-ego": 0.033998185793558754, "in-drivable-lane": 3.90000000000001, "agent_compute-ego": 0.03921487967173259, "deviation-heading": 5.909834507439167, "set_robot_commands": 0.05122409184773763, "deviation-center-line": 0.906223259843169, "driven_lanedir_consec": 0.9832109052383768, "sim_compute_sim_state": 0.02130258083343506, "sim_compute_performance-ego": 0.03670088132222493, "sim_compute_robot_state-ego": 0.038633507092793784, "sim_compute_robot_state-npc0": 0.0376745859781901, "sim_compute_robot_state-npc1": 0.03781512896219889, "sim_compute_robot_state-npc2": 0.03762899080912272, "sim_compute_robot_state-npc3": 0.03756457567214966}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.3485429192721696, "sim_physics": 0.07104145447413127, "survival_time": 14.950000000000076, "driven_lanedir": 1.6110222889696435, "sim_render-ego": 0.03418943723042806, "in-drivable-lane": 2.0000000000000107, "agent_compute-ego": 0.03862368106842041, "deviation-heading": 7.156415803534466, "set_robot_commands": 0.05231973965962728, "deviation-center-line": 1.1827260995852698, "driven_lanedir_consec": 0.8978797544254031, "sim_compute_sim_state": 0.021568671862284346, "sim_compute_performance-ego": 0.037292234897613526, "sim_compute_robot_state-ego": 0.03868702173233032, "sim_compute_robot_state-npc0": 0.03792251348495483, "sim_compute_robot_state-npc1": 0.038045072555541994, "sim_compute_robot_state-npc2": 0.038802358309427895, "sim_compute_robot_state-npc3": 0.038144535223642986}}
set_robot_commands_max0.05231973965962728
set_robot_commands_mean0.05191145100880659
set_robot_commands_median0.05201335430145264
set_robot_commands_min0.05122409184773763
sim_compute_performance-ego_max0.03742044369379679
sim_compute_performance-ego_mean0.03701265975997636
sim_compute_performance-ego_median0.03702266727175031
sim_compute_performance-ego_min0.03670088132222493
sim_compute_robot_state-ego_max0.03955997228622436
sim_compute_robot_state-ego_mean0.03856135998259804
sim_compute_robot_state-ego_median0.03855469783147176
sim_compute_robot_state-ego_min0.03812904755274455
sim_compute_robot_state-npc0_max0.03824785111964434
sim_compute_robot_state-npc0_mean0.03783056596441677
sim_compute_robot_state-npc0_median0.03778303225835165
sim_compute_robot_state-npc0_min0.03752013921737671
sim_compute_robot_state-npc1_max0.03828177966323553
sim_compute_robot_state-npc1_mean0.037919338004284035
sim_compute_robot_state-npc1_median0.037969391345977786
sim_compute_robot_state-npc1_min0.03754080931345622
sim_compute_robot_state-npc2_max0.038802358309427895
sim_compute_robot_state-npc2_mean0.037927227250583506
sim_compute_robot_state-npc2_median0.03785560048859695
sim_compute_robot_state-npc2_min0.037548521359761555
sim_compute_robot_state-npc3_max0.03819968653660195
sim_compute_robot_state-npc3_mean0.03776682627140263
sim_compute_robot_state-npc3_median0.037799630959828696
sim_compute_robot_state-npc3_min0.03727758067777787
sim_compute_sim_state_max0.02162352164586385
sim_compute_sim_state_mean0.021403870700177803
sim_compute_sim_state_median0.021434213320414227
sim_compute_sim_state_min0.021163631887996897
sim_physics_max0.07312440554300945
sim_physics_mean0.06968784094314201
sim_physics_median0.07009765227635702
sim_physics_min0.06520662362548127
sim_render-ego_max0.03475114468778117
sim_render-ego_mean0.03414766391869643
sim_render-ego_median0.034153386658313224
sim_render-ego_min0.03363688309987386
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.540000000000044
survival_time_min4.3499999999999925
210952680RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationsuccessno-0:55:04(hidden)
driven_lanedir_consec_median0.8875168299747294
survival_time_median14.950000000000076
deviation-center-line_median0.9020387563805992
in-drivable-lane_median2.450000000000031


other stats
agent_compute-ego_max0.06583439749340679
agent_compute-ego_mean0.06045812820200065
agent_compute-ego_median0.060485285196344225
agent_compute-ego_min0.0572935422261556
deviation-center-line_max1.163794504628409
deviation-center-line_mean0.7849798374720562
deviation-center-line_min0.2527164983363592
deviation-heading_max8.348486764254828
deviation-heading_mean4.310733386899979
deviation-heading_median3.913817675260771
deviation-heading_min0.9754991989018036
driven_any_max2.3490663978125306
driven_any_mean1.7359262889058706
driven_any_median2.3484953299050355
driven_any_min0.6205800254289026
driven_lanedir_consec_max2.243243292806796
driven_lanedir_consec_mean0.9602111922617
driven_lanedir_consec_min0.2822950451489603
driven_lanedir_max2.243243292806796
driven_lanedir_mean1.2174445405005287
driven_lanedir_median1.3183302719367995
driven_lanedir_min0.4350574393494768
in-drivable-lane_max3.650000000000011
in-drivable-lane_mean1.7533333333333438
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6205800254289026, "sim_physics": 0.0990964091101358, "survival_time": 4.299999999999993, "driven_lanedir": 0.4929279646537359, "sim_render-ego": 0.05473932000093682, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.06583439749340679, "deviation-heading": 1.4269262499074973, "set_robot_commands": 0.07806598308474519, "deviation-center-line": 0.3278578816712112, "driven_lanedir_consec": 0.4929279646537359, "sim_compute_sim_state": 0.03148963007816048, "sim_compute_performance-ego": 0.057778208754783456, "sim_compute_robot_state-ego": 0.05843244319738344, "sim_compute_robot_state-npc0": 0.06358487661494765, "sim_compute_robot_state-npc1": 0.06041160017945046, "sim_compute_robot_state-npc2": 0.05749079792998558, "sim_compute_robot_state-npc3": 0.056945917218230495}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3490663978125306, "sim_physics": 0.1028355630238851, "survival_time": 14.950000000000076, "driven_lanedir": 2.243243292806796, "sim_render-ego": 0.05570100466410319, "in-drivable-lane": 0, "agent_compute-ego": 0.062823699315389, "deviation-heading": 3.913817675260771, "set_robot_commands": 0.07574888944625854, "deviation-center-line": 1.077256243183294, "driven_lanedir_consec": 2.243243292806796, "sim_compute_sim_state": 0.033057603836059574, "sim_compute_performance-ego": 0.06089347759882609, "sim_compute_robot_state-ego": 0.0614791210492452, "sim_compute_robot_state-npc0": 0.06613245169321696, "sim_compute_robot_state-npc1": 0.06189043521881103, "sim_compute_robot_state-npc2": 0.060349090099334715, "sim_compute_robot_state-npc3": 0.06008388757705688}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3485232112586876, "sim_physics": 0.09702805678049724, "survival_time": 14.950000000000076, "driven_lanedir": 1.3121402161144489, "sim_render-ego": 0.051852118174235025, "in-drivable-lane": 3.650000000000011, "agent_compute-ego": 0.05901031891504924, "deviation-heading": 6.943669928932866, "set_robot_commands": 0.07492194811503093, "deviation-center-line": 1.018927188009764, "driven_lanedir_consec": 0.9661802472399276, "sim_compute_sim_state": 0.03174317518870036, "sim_compute_performance-ego": 0.05503877957661946, "sim_compute_robot_state-ego": 0.05673110723495483, "sim_compute_robot_state-npc0": 0.060968902905782066, "sim_compute_robot_state-npc1": 0.05765189170837402, "sim_compute_robot_state-npc2": 0.05737665891647339, "sim_compute_robot_state-npc3": 0.05590386946996053}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9989443898333632, "sim_physics": 0.10081240603032005, "survival_time": 6.549999999999985, "driven_lanedir": 0.4350574393494768, "sim_render-ego": 0.05251212884451597, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.0605551122709085, "deviation-heading": 1.185723385375553, "set_robot_commands": 0.07419711032896552, "deviation-center-line": 0.2527164983363592, "driven_lanedir_consec": 0.4350574393494768, "sim_compute_sim_state": 0.032069593895482654, "sim_compute_performance-ego": 0.0566039813383845, "sim_compute_robot_state-ego": 0.05815508529430127, "sim_compute_robot_state-npc0": 0.06122314110967039, "sim_compute_robot_state-npc1": 0.057233617505954425, "sim_compute_robot_state-npc2": 0.05716883317204832, "sim_compute_robot_state-npc3": 0.05624145587892023}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6936909940509788, "sim_physics": 0.09149349889447612, "survival_time": 4.6499999999999915, "driven_lanedir": 0.6766769491397397, "sim_render-ego": 0.05287925915051532, "in-drivable-lane": 0, "agent_compute-ego": 0.05818526719206123, "deviation-heading": 0.9754991989018036, "set_robot_commands": 0.07371517919724987, "deviation-center-line": 0.3867498288303864, "driven_lanedir_consec": 0.6766769491397397, "sim_compute_sim_state": 0.03219568088490476, "sim_compute_performance-ego": 0.05687007852779922, "sim_compute_robot_state-ego": 0.05836468101829611, "sim_compute_robot_state-npc0": 0.06144818695642615, "sim_compute_robot_state-npc1": 0.05819916468794628, "sim_compute_robot_state-npc2": 0.057288933825749226, "sim_compute_robot_state-npc3": 0.05716364358061103}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.3487876814673183, "sim_physics": 0.10215285778045656, "survival_time": 14.950000000000076, "driven_lanedir": 1.5061510759318044, "sim_render-ego": 0.053244694868723554, "in-drivable-lane": 3.1000000000000356, "agent_compute-ego": 0.06001580715179443, "deviation-heading": 6.33989423511673, "set_robot_commands": 0.07358978350957235, "deviation-center-line": 1.0445306704409605, "driven_lanedir_consec": 1.3480056957898188, "sim_compute_sim_state": 0.03227600574493408, "sim_compute_performance-ego": 0.05670373678207397, "sim_compute_robot_state-ego": 0.05781966050465902, "sim_compute_robot_state-npc0": 0.06180115620295207, "sim_compute_robot_state-npc1": 0.058486140569051104, "sim_compute_robot_state-npc2": 0.05703017791112264, "sim_compute_robot_state-npc3": 0.05824728886286418}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9186441146025912, "sim_physics": 0.09532014791630516, "survival_time": 6.0499999999999865, "driven_lanedir": 0.8875168299747294, "sim_render-ego": 0.05202018130909313, "in-drivable-lane": 0, "agent_compute-ego": 0.05819120880000848, "deviation-heading": 1.25762773014403, "set_robot_commands": 0.07416929883405196, "deviation-center-line": 0.47914292806454295, "driven_lanedir_consec": 0.8875168299747294, "sim_compute_sim_state": 0.03162968848362442, "sim_compute_performance-ego": 0.05476169152693315, "sim_compute_robot_state-ego": 0.057904923257748944, "sim_compute_robot_state-npc0": 0.06122028729147162, "sim_compute_robot_state-npc1": 0.05730240798193561, "sim_compute_robot_state-npc2": 0.055725020810592274, "sim_compute_robot_state-npc3": 0.0598170776997716}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.7739425390123377, "sim_physics": 0.09776994325582264, "survival_time": 5.14999999999999, "driven_lanedir": 0.4801651035753378, "sim_render-ego": 0.05483015532632476, "in-drivable-lane": 0.8499999999999994, "agent_compute-ego": 0.060806114696761934, "deviation-heading": 2.3303139554136645, "set_robot_commands": 0.07460229373672633, "deviation-center-line": 0.41134549129758574, "driven_lanedir_consec": 0.2822950451489603, "sim_compute_sim_state": 0.033209421102283074, "sim_compute_performance-ego": 0.058465890514040456, "sim_compute_robot_state-ego": 0.06394779103473552, "sim_compute_robot_state-npc0": 0.06564770855949921, "sim_compute_robot_state-npc1": 0.059870474546858406, "sim_compute_robot_state-npc2": 0.06119862343501119, "sim_compute_robot_state-npc3": 0.06090469036287474}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.3487617263289966, "sim_physics": 0.09582660913467408, "survival_time": 14.950000000000076, "driven_lanedir": 1.6240474230817736, "sim_render-ego": 0.05602411111195882, "in-drivable-lane": 2.450000000000031, "agent_compute-ego": 0.061232335567474365, "deviation-heading": 6.04328459741134, "set_robot_commands": 0.07413790146509806, "deviation-center-line": 0.9020387563805992, "driven_lanedir_consec": 1.039191286871754, "sim_compute_sim_state": 0.033260263601938886, "sim_compute_performance-ego": 0.059256094296773275, "sim_compute_robot_state-ego": 0.06027923107147217, "sim_compute_robot_state-npc0": 0.06621177991231282, "sim_compute_robot_state-npc1": 0.06210643212000529, "sim_compute_robot_state-npc2": 0.059551044305165605, "sim_compute_robot_state-npc3": 0.060230271816253664}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.8668185804711157, "sim_physics": 0.10441782185223313, "survival_time": 11.950000000000037, "driven_lanedir": 1.3183302719367995, "sim_render-ego": 0.05387902459340115, "in-drivable-lane": 2.8500000000000405, "agent_compute-ego": 0.060485285196344225, "deviation-heading": 2.4672167001404075, "set_robot_commands": 0.07534023209096996, "deviation-center-line": 0.7768447349354649, "driven_lanedir_consec": 1.3183302719367995, "sim_compute_sim_state": 0.032774634939856113, "sim_compute_performance-ego": 0.05880715058937232, "sim_compute_robot_state-ego": 0.05995083553521703, "sim_compute_robot_state-npc0": 0.06411866862404796, "sim_compute_robot_state-npc1": 0.06047139506958519, "sim_compute_robot_state-npc2": 0.058718129680745274, "sim_compute_robot_state-npc3": 0.059279357040277585}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.3766938480269235, "sim_physics": 0.1002691930599427, "survival_time": 8.899999999999991, "driven_lanedir": 1.176427886684253, "sim_render-ego": 0.05694950028751673, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.06160251746016942, "deviation-heading": 3.3826168289127354, "set_robot_commands": 0.07699831683983964, "deviation-center-line": 0.7366624008199092, "driven_lanedir_consec": 1.176427886684253, "sim_compute_sim_state": 0.033920790372269874, "sim_compute_performance-ego": 0.06045575222272551, "sim_compute_robot_state-ego": 0.06003582343626558, "sim_compute_robot_state-npc0": 0.06561130888006661, "sim_compute_robot_state-npc1": 0.06131978918997089, "sim_compute_robot_state-npc2": 0.061936016832844595, "sim_compute_robot_state-npc3": 0.060813429650295986}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.348871080508647, "sim_physics": 0.09547104517618817, "survival_time": 14.950000000000076, "driven_lanedir": 1.9173020531381688, "sim_render-ego": 0.05746443510055542, "in-drivable-lane": 1.2000000000000115, "agent_compute-ego": 0.06202659845352173, "deviation-heading": 5.2576734337084545, "set_robot_commands": 0.07623132228851319, "deviation-center-line": 1.163794504628409, "driven_lanedir_consec": 1.421988312532538, "sim_compute_sim_state": 0.03449725389480591, "sim_compute_performance-ego": 0.0610253111521403, "sim_compute_robot_state-ego": 0.061374831994374594, "sim_compute_robot_state-npc0": 0.06719781557718912, "sim_compute_robot_state-npc1": 0.06266873836517334, "sim_compute_robot_state-npc2": 0.06133931795756022, "sim_compute_robot_state-npc3": 0.06211265643437704}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.3484953299050355, "sim_physics": 0.09928401549657186, "survival_time": 14.950000000000076, "driven_lanedir": 1.4021842341379378, "sim_render-ego": 0.0527529231707255, "in-drivable-lane": 2.550000000000008, "agent_compute-ego": 0.05943116188049316, "deviation-heading": 8.348486764254828, "set_robot_commands": 0.07399710893630981, "deviation-center-line": 1.1542218177933918, "driven_lanedir_consec": 0.7216003789596356, "sim_compute_sim_state": 0.032338265577952066, "sim_compute_performance-ego": 0.05712747573852539, "sim_compute_robot_state-ego": 0.05892820755640666, "sim_compute_robot_state-npc0": 0.060696820418039955, "sim_compute_robot_state-npc1": 0.05789892832438151, "sim_compute_robot_state-npc2": 0.05724602222442627, "sim_compute_robot_state-npc3": 0.05697968165079752}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.348551790190653, "sim_physics": 0.1022146781285604, "survival_time": 14.950000000000076, "driven_lanedir": 1.3910348906782095, "sim_render-ego": 0.05040286938349406, "in-drivable-lane": 3.1500000000000155, "agent_compute-ego": 0.0572935422261556, "deviation-heading": 6.934786080535409, "set_robot_commands": 0.07264350255330404, "deviation-center-line": 1.0801857155407577, "driven_lanedir_consec": 0.8239364669461158, "sim_compute_sim_state": 0.030996408462524418, "sim_compute_performance-ego": 0.05535118579864502, "sim_compute_robot_state-ego": 0.05740467151006063, "sim_compute_robot_state-npc0": 0.05788695732752482, "sim_compute_robot_state-npc1": 0.05552141507466634, "sim_compute_robot_state-npc2": 0.05549255132675171, "sim_compute_robot_state-npc3": 0.056829404830932614}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.348522624689985, "sim_physics": 0.10101372400919596, "survival_time": 14.950000000000076, "driven_lanedir": 1.3984624763047204, "sim_render-ego": 0.0506968887646993, "in-drivable-lane": 2.85000000000002, "agent_compute-ego": 0.0593785564104716, "deviation-heading": 7.853464039483581, "set_robot_commands": 0.07261263688405355, "deviation-center-line": 0.9624229021482076, "driven_lanedir_consec": 0.56978981589122, "sim_compute_sim_state": 0.03136607646942138, "sim_compute_performance-ego": 0.054708763758341473, "sim_compute_robot_state-ego": 0.05587846199671427, "sim_compute_robot_state-npc0": 0.05768755833307902, "sim_compute_robot_state-npc1": 0.05577371994654338, "sim_compute_robot_state-npc2": 0.05554863214492798, "sim_compute_robot_state-npc3": 0.05514102220535278}}
set_robot_commands_max0.07806598308474519
set_robot_commands_mean0.0747314338207126
set_robot_commands_median0.07419711032896552
set_robot_commands_min0.07261263688405355
sim_compute_performance-ego_max0.0610253111521403
sim_compute_performance-ego_mean0.05758983854506557
sim_compute_performance-ego_median0.05712747573852539
sim_compute_performance-ego_min0.054708763758341473
sim_compute_robot_state-ego_max0.06394779103473552
sim_compute_robot_state-ego_mean0.05911245837945569
sim_compute_robot_state-ego_median0.05843244319738344
sim_compute_robot_state-ego_min0.05587846199671427
sim_compute_robot_state-npc0_max0.06719781557718912
sim_compute_robot_state-npc0_mean0.06276250802708176
sim_compute_robot_state-npc0_median0.06180115620295207
sim_compute_robot_state-npc0_min0.05768755833307902
sim_compute_robot_state-npc1_max0.06266873836517334
sim_compute_robot_state-npc1_mean0.05912041003258049
sim_compute_robot_state-npc1_median0.058486140569051104
sim_compute_robot_state-npc1_min0.05552141507466634
sim_compute_robot_state-npc2_max0.061936016832844595
sim_compute_robot_state-npc2_mean0.05823065670484927
sim_compute_robot_state-npc2_median0.05737665891647339
sim_compute_robot_state-npc2_min0.05549255132675171
sim_compute_robot_state-npc3_max0.06211265643437704
sim_compute_robot_state-npc3_mean0.05844624361857178
sim_compute_robot_state-npc3_median0.05824728886286418
sim_compute_robot_state-npc3_min0.05514102220535278
sim_compute_sim_state_max0.03449725389480591
sim_compute_sim_state_mean0.032454966168861205
sim_compute_sim_state_median0.03227600574493408
sim_compute_sim_state_min0.030996408462524418
sim_physics_max0.10441782185223313
sim_physics_mean0.09900039797661768
sim_physics_median0.09928401549657186
sim_physics_min0.09149349889447612
sim_render-ego_max0.05746443510055542
sim_render-ego_mean0.053729907650053255
sim_render-ego_median0.053244694868723554
sim_render-ego_min0.05040286938349406
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.143333333333372
survival_time_min4.299999999999993
203792680RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationsuccessno-0:19:38(hidden)
driven_lanedir_consec_median0.3440505760376964
survival_time_median3.899999999999994
deviation-center-line_median0.3085364058559797
in-drivable-lane_median0


other stats
agent_compute-ego_max0.08848207705729716
agent_compute-ego_mean0.08770285211385874
agent_compute-ego_median0.08785079255958513
agent_compute-ego_min0.08662193530314677
deviation-center-line_max0.5859752827064052
deviation-center-line_mean0.3210584436700906
deviation-center-line_min0.1574949472636814
deviation-heading_max4.478739159985982
deviation-heading_mean2.035514342555811
deviation-heading_median0.6448162459336365
deviation-heading_min0.4301825418671719
driven_any_max2.2277789111247226
driven_any_mean0.9217952672550924
driven_any_median0.5730599972430763
driven_any_min0.2435692407037807
driven_lanedir_consec_max0.8608856031053993
driven_lanedir_consec_mean0.4465205894840903
driven_lanedir_consec_min0.23170034362748515
driven_lanedir_max0.8608856031053993
driven_lanedir_mean0.5098077707474195
driven_lanedir_median0.563856255352441
driven_lanedir_min0.23170034362748515
in-drivable-lane_max7.900000000000048
in-drivable-lane_mean1.8200000000000087
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.3209985150904526, "sim_physics": 0.216126488812397, "survival_time": 8.649999999999988, "driven_lanedir": 0.8608856031053993, "sim_render-ego": 0.07027095452898499, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.08785079255958513, "deviation-heading": 4.184649242180787, "set_robot_commands": 0.11452833489875572, "deviation-center-line": 0.5859752827064052, "driven_lanedir_consec": 0.8608856031053993, "sim_compute_sim_state": 0.04469787454329474, "sim_compute_performance-ego": 0.07913829963331277, "sim_compute_robot_state-ego": 0.08833079117570998, "sim_compute_robot_state-npc0": 0.07781751720891522, "sim_compute_robot_state-npc1": 0.0790303621677994, "sim_compute_robot_state-npc2": 0.07878403994389352, "sim_compute_robot_state-npc3": 0.07903153496670585}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.2277789111247226, "sim_physics": 0.22744408375780348, "survival_time": 14.200000000000069, "driven_lanedir": 0.6604864823543424, "sim_render-ego": 0.07163828611373901, "in-drivable-lane": 7.900000000000048, "agent_compute-ego": 0.08769050534342376, "deviation-heading": 4.478739159985982, "set_robot_commands": 0.11461777754232916, "deviation-center-line": 0.3932099760433071, "driven_lanedir_consec": 0.3440505760376964, "sim_compute_sim_state": 0.04496409439704788, "sim_compute_performance-ego": 0.08165973844662519, "sim_compute_robot_state-ego": 0.09079004593298468, "sim_compute_robot_state-npc0": 0.07909114595869897, "sim_compute_robot_state-npc1": 0.07958734958944186, "sim_compute_robot_state-npc2": 0.08000216013948683, "sim_compute_robot_state-npc3": 0.0792798744121068}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.24356967211342956, "sim_physics": 0.20235037803649905, "survival_time": 1.850000000000001, "driven_lanedir": 0.23170034362748515, "sim_render-ego": 0.07134929863182274, "in-drivable-lane": 0, "agent_compute-ego": 0.08848207705729716, "deviation-heading": 0.4391845228114776, "set_robot_commands": 0.11714803205954062, "deviation-center-line": 0.16007560648108005, "driven_lanedir_consec": 0.23170034362748515, "sim_compute_sim_state": 0.0473457349313272, "sim_compute_performance-ego": 0.07880436407553183, "sim_compute_robot_state-ego": 0.08173889082831305, "sim_compute_robot_state-npc0": 0.08148555497865419, "sim_compute_robot_state-npc1": 0.09152960132908176, "sim_compute_robot_state-npc2": 0.08092498779296875, "sim_compute_robot_state-npc3": 0.0801737437377105}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2435692407037807, "sim_physics": 0.2056248832393337, "survival_time": 1.850000000000001, "driven_lanedir": 0.23211016929742945, "sim_render-ego": 0.0743041940637537, "in-drivable-lane": 0, "agent_compute-ego": 0.08662193530314677, "deviation-heading": 0.4301825418671719, "set_robot_commands": 0.11706586141844054, "deviation-center-line": 0.1574949472636814, "driven_lanedir_consec": 0.23211016929742945, "sim_compute_sim_state": 0.04639974800316063, "sim_compute_performance-ego": 0.07849577955297522, "sim_compute_robot_state-ego": 0.08245811591277251, "sim_compute_robot_state-npc0": 0.07686478382832296, "sim_compute_robot_state-npc1": 0.07666611671447754, "sim_compute_robot_state-npc2": 0.07789835414370976, "sim_compute_robot_state-npc3": 0.07746363974906303}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5730599972430763, "sim_physics": 0.17599191421117538, "survival_time": 3.899999999999994, "driven_lanedir": 0.563856255352441, "sim_render-ego": 0.07242219570355538, "in-drivable-lane": 0, "agent_compute-ego": 0.08786895030584091, "deviation-heading": 0.6448162459336365, "set_robot_commands": 0.11643386498475686, "deviation-center-line": 0.3085364058559797, "driven_lanedir_consec": 0.563856255352441, "sim_compute_sim_state": 0.04839789867401123, "sim_compute_performance-ego": 0.08092368566072904, "sim_compute_robot_state-ego": 0.09112039590493226, "sim_compute_robot_state-npc0": 0.08564393948286007, "sim_compute_robot_state-npc1": 0.08176817955114903, "sim_compute_robot_state-npc2": 0.0829311395302797, "sim_compute_robot_state-npc3": 0.0838000224186824}}
set_robot_commands_max0.11714803205954062
set_robot_commands_mean0.11595877418076458
set_robot_commands_median0.11643386498475686
set_robot_commands_min0.11452833489875572
sim_compute_performance-ego_max0.08165973844662519
sim_compute_performance-ego_mean0.07980437347383482
sim_compute_performance-ego_median0.07913829963331277
sim_compute_performance-ego_min0.07849577955297522
sim_compute_robot_state-ego_max0.09112039590493226
sim_compute_robot_state-ego_mean0.0868876479509425
sim_compute_robot_state-ego_median0.08833079117570998
sim_compute_robot_state-ego_min0.08173889082831305
sim_compute_robot_state-npc0_max0.08564393948286007
sim_compute_robot_state-npc0_mean0.08018058829149029
sim_compute_robot_state-npc0_median0.07909114595869897
sim_compute_robot_state-npc0_min0.07686478382832296
sim_compute_robot_state-npc1_max0.09152960132908176
sim_compute_robot_state-npc1_mean0.08171632187038992
sim_compute_robot_state-npc1_median0.07958734958944186
sim_compute_robot_state-npc1_min0.07666611671447754
sim_compute_robot_state-npc2_max0.0829311395302797
sim_compute_robot_state-npc2_mean0.08010813631006772
sim_compute_robot_state-npc2_median0.08000216013948683
sim_compute_robot_state-npc2_min0.07789835414370976
sim_compute_robot_state-npc3_max0.0838000224186824
sim_compute_robot_state-npc3_mean0.07994976305685372
sim_compute_robot_state-npc3_median0.0792798744121068
sim_compute_robot_state-npc3_min0.07746363974906303
sim_compute_sim_state_max0.04839789867401123
sim_compute_sim_state_mean0.04636107010976834
sim_compute_sim_state_median0.04639974800316063
sim_compute_sim_state_min0.04469787454329474
sim_physics_max0.22744408375780348
sim_physics_mean0.20550754961144171
sim_physics_median0.2056248832393337
sim_physics_min0.17599191421117538
sim_render-ego_max0.0743041940637537
sim_render-ego_mean0.07199698580837118
sim_render-ego_median0.07163828611373901
sim_render-ego_min0.07027095452898499
simulation-passed1
survival_time_max14.200000000000069
survival_time_mean6.0900000000000105
survival_time_min1.850000000000001
194652680RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationsuccessno-0:17:46(hidden)
driven_lanedir_consec_median1.0774205271402328
survival_time_median7.499999999999981
deviation-center-line_median0.6842458530531172
in-drivable-lane_median0.04999999999999982


other stats
agent_compute-ego_max0.07881567080815634
agent_compute-ego_mean0.06738868006668879
agent_compute-ego_median0.0679639466603597
agent_compute-ego_min0.058592546397242054
deviation-center-line_max0.9821229956727928
deviation-center-line_mean0.7176553295438862
deviation-center-line_min0.272735061797157
deviation-heading_max4.723287028718434
deviation-heading_mean2.5757061015427074
deviation-heading_median1.3783836847036235
deviation-heading_min1.2902566773762008
driven_any_max2.3556292594914714
driven_any_mean1.543473652732805
driven_any_median1.1583427445585308
driven_any_min0.7297122204296577
driven_lanedir_consec_max2.094007849215527
driven_lanedir_consec_mean1.2047772294786985
driven_lanedir_consec_min0.6762207382038103
driven_lanedir_max2.094007849215527
driven_lanedir_mean1.3962226126328805
driven_lanedir_median1.1297138906528057
driven_lanedir_min0.6762207382038103
in-drivable-lane_max0.7500000000000107
in-drivable-lane_mean0.2900000000000017
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7297122204296577, "sim_physics": 0.03172100076870042, "survival_time": 4.899999999999991, "driven_lanedir": 0.6762207382038103, "sim_render-ego": 0.05723577372881831, "in-drivable-lane": 0, "agent_compute-ego": 0.06919368189208362, "deviation-heading": 1.2902566773762008, "set_robot_commands": 0.07812015134461071, "deviation-center-line": 0.272735061797157, "driven_lanedir_consec": 0.6762207382038103, "sim_compute_sim_state": 0.03438681485701581, "sim_compute_performance-ego": 0.06129799813640361, "sim_compute_robot_state-ego": 0.06254776156678492, "sim_compute_robot_state-npc0": 0.06486519988702268, "sim_compute_robot_state-npc1": 0.06233861251753204, "sim_compute_robot_state-npc2": 0.06093508856637137, "sim_compute_robot_state-npc3": 0.05938829694475446}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.355511571522875, "sim_physics": 0.02624845027923584, "survival_time": 14.950000000000076, "driven_lanedir": 2.0037500579520255, "sim_render-ego": 0.05380173126856486, "in-drivable-lane": 0.6499999999999981, "agent_compute-ego": 0.06237755457560221, "deviation-heading": 4.723287028718434, "set_robot_commands": 0.07506148894627888, "deviation-center-line": 0.9813101222563424, "driven_lanedir_consec": 1.0465231421811163, "sim_compute_sim_state": 0.032651952902475995, "sim_compute_performance-ego": 0.05932641585667928, "sim_compute_robot_state-ego": 0.06041263659795126, "sim_compute_robot_state-npc0": 0.06152827262878418, "sim_compute_robot_state-npc1": 0.060079189936319985, "sim_compute_robot_state-npc2": 0.05851143042246501, "sim_compute_robot_state-npc3": 0.058596835136413575}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.11817246766149, "sim_physics": 0.027251253456904972, "survival_time": 7.249999999999982, "driven_lanedir": 1.0774205271402328, "sim_render-ego": 0.0513375134303652, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.058592546397242054, "deviation-heading": 1.3783836847036235, "set_robot_commands": 0.07249954979995202, "deviation-center-line": 0.6842458530531172, "driven_lanedir_consec": 1.0774205271402328, "sim_compute_sim_state": 0.03275021684580836, "sim_compute_performance-ego": 0.0563291467469314, "sim_compute_robot_state-ego": 0.05886317285998114, "sim_compute_robot_state-npc0": 0.05973439709893588, "sim_compute_robot_state-npc1": 0.05792248988973683, "sim_compute_robot_state-npc2": 0.05695585382395777, "sim_compute_robot_state-npc3": 0.05979621163729964}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1583427445585308, "sim_physics": 0.0308695650100708, "survival_time": 7.499999999999981, "driven_lanedir": 1.1297138906528057, "sim_render-ego": 0.057618719736735026, "in-drivable-lane": 0, "agent_compute-ego": 0.0679639466603597, "deviation-heading": 1.361046853380277, "set_robot_commands": 0.08312367598215739, "deviation-center-line": 0.6678626149400217, "driven_lanedir_consec": 1.1297138906528057, "sim_compute_sim_state": 0.035338727633158366, "sim_compute_performance-ego": 0.06235385100046793, "sim_compute_robot_state-ego": 0.06373240947723388, "sim_compute_robot_state-npc0": 0.06634080886840821, "sim_compute_robot_state-npc1": 0.06437204519907634, "sim_compute_robot_state-npc2": 0.0627458413441976, "sim_compute_robot_state-npc3": 0.06320038477579752}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3556292594914714, "sim_physics": 0.03553653081258138, "survival_time": 14.950000000000076, "driven_lanedir": 2.094007849215527, "sim_render-ego": 0.06176823536554972, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.07881567080815634, "deviation-heading": 4.125556263535001, "set_robot_commands": 0.09066924492518108, "deviation-center-line": 0.9821229956727928, "driven_lanedir_consec": 2.094007849215527, "sim_compute_sim_state": 0.03920427322387696, "sim_compute_performance-ego": 0.06771989425023396, "sim_compute_robot_state-ego": 0.07046984513600667, "sim_compute_robot_state-npc0": 0.0698258113861084, "sim_compute_robot_state-npc1": 0.06938078085581462, "sim_compute_robot_state-npc2": 0.06917890230814616, "sim_compute_robot_state-npc3": 0.06922197262446085}}
set_robot_commands_max0.09066924492518108
set_robot_commands_mean0.07989482219963602
set_robot_commands_median0.07812015134461071
set_robot_commands_min0.07249954979995202
sim_compute_performance-ego_max0.06771989425023396
sim_compute_performance-ego_mean0.06140546119814323
sim_compute_performance-ego_median0.06129799813640361
sim_compute_performance-ego_min0.0563291467469314
sim_compute_robot_state-ego_max0.07046984513600667
sim_compute_robot_state-ego_mean0.06320516512759157
sim_compute_robot_state-ego_median0.06254776156678492
sim_compute_robot_state-ego_min0.05886317285998114
sim_compute_robot_state-npc0_max0.0698258113861084
sim_compute_robot_state-npc0_mean0.06445889797385186
sim_compute_robot_state-npc0_median0.06486519988702268
sim_compute_robot_state-npc0_min0.05973439709893588
sim_compute_robot_state-npc1_max0.06938078085581462
sim_compute_robot_state-npc1_mean0.06281862367969596
sim_compute_robot_state-npc1_median0.06233861251753204
sim_compute_robot_state-npc1_min0.05792248988973683
sim_compute_robot_state-npc2_max0.06917890230814616
sim_compute_robot_state-npc2_mean0.06166542329302758
sim_compute_robot_state-npc2_median0.06093508856637137
sim_compute_robot_state-npc2_min0.05695585382395777
sim_compute_robot_state-npc3_max0.06922197262446085
sim_compute_robot_state-npc3_mean0.06204074022374521
sim_compute_robot_state-npc3_median0.05979621163729964
sim_compute_robot_state-npc3_min0.058596835136413575
sim_compute_sim_state_max0.03920427322387696
sim_compute_sim_state_mean0.0348663970924671
sim_compute_sim_state_median0.03438681485701581
sim_compute_sim_state_min0.032651952902475995
sim_physics_max0.03553653081258138
sim_physics_mean0.03032536006549868
sim_physics_median0.0308695650100708
sim_physics_min0.02624845027923584
sim_render-ego_max0.06176823536554972
sim_render-ego_mean0.05635239470600663
sim_render-ego_median0.05723577372881831
sim_render-ego_min0.0513375134303652
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.91000000000002
survival_time_min4.899999999999991
194552680RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationsuccessno-0:18:20(hidden)
driven_lanedir_consec_median1.0240093155136043
survival_time_median6.8999999999999835
deviation-center-line_median0.4768743338929914
in-drivable-lane_median0


other stats
agent_compute-ego_max0.091946595509847
agent_compute-ego_mean0.08684022580904638
agent_compute-ego_median0.08772176612507213
agent_compute-ego_min0.07876198879186658
deviation-center-line_max0.6680510785758133
deviation-center-line_mean0.4827280842553369
deviation-center-line_min0.27245655101549265
deviation-heading_max1.4219328001059632
deviation-heading_mean1.226393609169372
deviation-heading_median1.2670270328437836
deviation-heading_min0.9750786737419777
driven_any_max1.1583444269684966
driven_any_mean1.0404710094067904
driven_any_median1.061897793095121
driven_any_min0.826124985421427
driven_lanedir_consec_max1.1275355962650453
driven_lanedir_consec_mean1.0116781290253154
driven_lanedir_consec_min0.7926179835525367
driven_lanedir_max1.1275355962650453
driven_lanedir_mean1.0116781290253154
driven_lanedir_median1.0240093155136043
driven_lanedir_min0.7926179835525367
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.826124985421427, "sim_physics": 0.04794454141096635, "survival_time": 5.4999999999999885, "driven_lanedir": 0.7926179835525367, "sim_render-ego": 0.06943152384324507, "in-drivable-lane": 0, "agent_compute-ego": 0.08772176612507213, "deviation-heading": 1.1303159433032055, "set_robot_commands": 0.1102610718120228, "deviation-center-line": 0.27245655101549265, "driven_lanedir_consec": 0.7926179835525367, "sim_compute_sim_state": 0.04387309984727339, "sim_compute_performance-ego": 0.07631322253834118, "sim_compute_robot_state-ego": 0.08133997266942805, "sim_compute_robot_state-npc0": 0.07785440574992787, "sim_compute_robot_state-npc1": 0.07782458392056552, "sim_compute_robot_state-npc2": 0.07815422361547297, "sim_compute_robot_state-npc3": 0.07795810049230402}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.1342352788874617, "sim_physics": 0.04797448430742536, "survival_time": 7.349999999999982, "driven_lanedir": 1.1095075558762866, "sim_render-ego": 0.07153981234751591, "in-drivable-lane": 0, "agent_compute-ego": 0.08768382040010829, "deviation-heading": 1.2670270328437836, "set_robot_commands": 0.11161322820754278, "deviation-center-line": 0.6381826438294421, "driven_lanedir_consec": 1.1095075558762866, "sim_compute_sim_state": 0.043668904272066496, "sim_compute_performance-ego": 0.07892482783518681, "sim_compute_robot_state-ego": 0.08221117655436198, "sim_compute_robot_state-npc0": 0.07638412754551895, "sim_compute_robot_state-npc1": 0.07919608168050546, "sim_compute_robot_state-npc2": 0.07797589918383124, "sim_compute_robot_state-npc3": 0.07802939739357047}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0217525626614452, "sim_physics": 0.04862336467083236, "survival_time": 6.649999999999984, "driven_lanedir": 1.0047201939191042, "sim_render-ego": 0.0724440248388993, "in-drivable-lane": 0, "agent_compute-ego": 0.0880869582183379, "deviation-heading": 0.9750786737419777, "set_robot_commands": 0.11358853031818132, "deviation-center-line": 0.6680510785758133, "driven_lanedir_consec": 1.0047201939191042, "sim_compute_sim_state": 0.04302767165621421, "sim_compute_performance-ego": 0.0793965364757337, "sim_compute_robot_state-ego": 0.08714400915274943, "sim_compute_robot_state-npc0": 0.08240886559163717, "sim_compute_robot_state-npc1": 0.07793993519661122, "sim_compute_robot_state-npc2": 0.07874628296472076, "sim_compute_robot_state-npc3": 0.07833965021864812}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1583444269684966, "sim_physics": 0.046646011670430504, "survival_time": 7.499999999999981, "driven_lanedir": 1.1275355962650453, "sim_render-ego": 0.07011596838633219, "in-drivable-lane": 0, "agent_compute-ego": 0.091946595509847, "deviation-heading": 1.3376135958519308, "set_robot_commands": 0.1171632973353068, "deviation-center-line": 0.4768743338929914, "driven_lanedir_consec": 1.1275355962650453, "sim_compute_sim_state": 0.0445082410176595, "sim_compute_performance-ego": 0.07905644893646241, "sim_compute_robot_state-ego": 0.08685746033986409, "sim_compute_robot_state-npc0": 0.07912398815155029, "sim_compute_robot_state-npc1": 0.07794795831044515, "sim_compute_robot_state-npc2": 0.0790939458211263, "sim_compute_robot_state-npc3": 0.07979381879170735}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.061897793095121, "sim_physics": 0.039001660070557526, "survival_time": 6.8999999999999835, "driven_lanedir": 1.0240093155136043, "sim_render-ego": 0.06187779661537944, "in-drivable-lane": 0, "agent_compute-ego": 0.07876198879186658, "deviation-heading": 1.4219328001059632, "set_robot_commands": 0.0927256414855736, "deviation-center-line": 0.35807581396294486, "driven_lanedir_consec": 1.0240093155136043, "sim_compute_sim_state": 0.038469463154889534, "sim_compute_performance-ego": 0.0688541004623192, "sim_compute_robot_state-ego": 0.06995647540990857, "sim_compute_robot_state-npc0": 0.06827106683150581, "sim_compute_robot_state-npc1": 0.06852705064027206, "sim_compute_robot_state-npc2": 0.06812747492306474, "sim_compute_robot_state-npc3": 0.06906057095182115}}
set_robot_commands_max0.1171632973353068
set_robot_commands_mean0.10907035383172548
set_robot_commands_median0.11161322820754278
set_robot_commands_min0.0927256414855736
sim_compute_performance-ego_max0.0793965364757337
sim_compute_performance-ego_mean0.07650902724960866
sim_compute_performance-ego_median0.07892482783518681
sim_compute_performance-ego_min0.0688541004623192
sim_compute_robot_state-ego_max0.08714400915274943
sim_compute_robot_state-ego_mean0.08150181882526243
sim_compute_robot_state-ego_median0.08221117655436198
sim_compute_robot_state-ego_min0.06995647540990857
sim_compute_robot_state-npc0_max0.08240886559163717
sim_compute_robot_state-npc0_mean0.07680849077402802
sim_compute_robot_state-npc0_median0.07785440574992787
sim_compute_robot_state-npc0_min0.06827106683150581
sim_compute_robot_state-npc1_max0.07919608168050546
sim_compute_robot_state-npc1_mean0.07628712194967988
sim_compute_robot_state-npc1_median0.07793993519661122
sim_compute_robot_state-npc1_min0.06852705064027206
sim_compute_robot_state-npc2_max0.0790939458211263
sim_compute_robot_state-npc2_mean0.0764195653016432
sim_compute_robot_state-npc2_median0.07815422361547297
sim_compute_robot_state-npc2_min0.06812747492306474
sim_compute_robot_state-npc3_max0.07979381879170735
sim_compute_robot_state-npc3_mean0.07663630756961022
sim_compute_robot_state-npc3_median0.07802939739357047
sim_compute_robot_state-npc3_min0.06906057095182115
sim_compute_sim_state_max0.0445082410176595
sim_compute_sim_state_mean0.042709475989620625
sim_compute_sim_state_median0.043668904272066496
sim_compute_sim_state_min0.038469463154889534
sim_physics_max0.04862336467083236
sim_physics_mean0.04603801242604242
sim_physics_median0.04794454141096635
sim_physics_min0.039001660070557526
sim_render-ego_max0.0724440248388993
sim_render-ego_mean0.06908182520627439
sim_render-ego_median0.07011596838633219
sim_render-ego_min0.06187779661537944
simulation-passed1
survival_time_max7.499999999999981
survival_time_mean6.779999999999984
survival_time_min5.4999999999999885
194252680RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationhost-errorno-0:12:18
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19425-641583', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19425-641583', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19425-641583', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
(hidden)
187022680RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationerrorno-0:01:03
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 88, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 88, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 > 
(hidden)
187012680RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationsuccessno-0:18:03(hidden)
driven_lanedir_consec_median1.0494101139404726
survival_time_median6.999999999999983
deviation-center-line_median0.4114452923747232
in-drivable-lane_median0


other stats
agent_compute-ego_max0.058055541094611675
agent_compute-ego_mean0.056533243481632814
agent_compute-ego_median0.056312439289498833
agent_compute-ego_min0.05561222859791347
deviation-center-line_max0.6224996164639154
deviation-center-line_mean0.420658543577316
deviation-center-line_min0.18669002326807368
deviation-heading_max2.7051896780359175
deviation-heading_mean1.82092421288296
deviation-heading_median2.1176976665979463
deviation-heading_min0.6240920157870962
driven_any_max1.3270581137113913
driven_any_mean0.984184420377592
driven_any_median1.0779845464860416
driven_any_min0.4886497723225228
driven_lanedir_consec_max1.2414388188003094
driven_lanedir_consec_mean0.8399082041571099
driven_lanedir_consec_min0.24101563879124388
driven_lanedir_max1.2414388188003094
driven_lanedir_mean0.8798729125236007
driven_lanedir_median1.0494101139404726
driven_lanedir_min0.44083918062369776
in-drivable-lane_max0.4999999999999995
in-drivable-lane_mean0.15000000000000063
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4886497723225228, "sim_physics": 0.025568471235387465, "survival_time": 3.399999999999996, "driven_lanedir": 0.4738535967511015, "sim_render-ego": 0.05256384611129761, "in-drivable-lane": 0, "agent_compute-ego": 0.058055541094611675, "deviation-heading": 0.6240920157870962, "set_robot_commands": 0.0721786898725173, "deviation-center-line": 0.18669002326807368, "driven_lanedir_consec": 0.4738535967511015, "sim_compute_sim_state": 0.031239902271943933, "sim_compute_performance-ego": 0.0544653710197, "sim_compute_robot_state-ego": 0.05606660772772396, "sim_compute_robot_state-npc0": 0.05844837076523725, "sim_compute_robot_state-npc1": 0.05609311075771556, "sim_compute_robot_state-npc2": 0.054628144292270434, "sim_compute_robot_state-npc3": 0.05491023905137006}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7082069604129195, "sim_physics": 0.024996356761201897, "survival_time": 4.699999999999991, "driven_lanedir": 0.44083918062369776, "sim_render-ego": 0.053299622332796136, "in-drivable-lane": 0.4999999999999995, "agent_compute-ego": 0.056312439289498833, "deviation-heading": 2.7051896780359175, "set_robot_commands": 0.07100561324586259, "deviation-center-line": 0.41024624739519655, "driven_lanedir_consec": 0.24101563879124388, "sim_compute_sim_state": 0.03115388941257558, "sim_compute_performance-ego": 0.05435696814922576, "sim_compute_robot_state-ego": 0.055436890176002014, "sim_compute_robot_state-npc0": 0.05690842486442404, "sim_compute_robot_state-npc1": 0.05505929855590171, "sim_compute_robot_state-npc2": 0.05453406242614097, "sim_compute_robot_state-npc3": 0.05487891714623634}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0779845464860416, "sim_physics": 0.02310058048793248, "survival_time": 6.999999999999983, "driven_lanedir": 1.0494101139404726, "sim_render-ego": 0.05109184639794486, "in-drivable-lane": 0, "agent_compute-ego": 0.05561222859791347, "deviation-heading": 1.3240471487517858, "set_robot_commands": 0.07017819370542254, "deviation-center-line": 0.6224996164639154, "driven_lanedir_consec": 1.0494101139404726, "sim_compute_sim_state": 0.03092080695288522, "sim_compute_performance-ego": 0.05252840689250401, "sim_compute_robot_state-ego": 0.05464540209089007, "sim_compute_robot_state-npc0": 0.05518579993929182, "sim_compute_robot_state-npc1": 0.05383493900299072, "sim_compute_robot_state-npc2": 0.05294177872794015, "sim_compute_robot_state-npc3": 0.053218431132180354}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3190227089550843, "sim_physics": 0.02350615894093233, "survival_time": 8.499999999999986, "driven_lanedir": 1.193822852502422, "sim_render-ego": 0.05136822532205021, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.055868214719435746, "deviation-heading": 2.1176976665979463, "set_robot_commands": 0.07247818217558019, "deviation-center-line": 0.47241153838467104, "driven_lanedir_consec": 1.193822852502422, "sim_compute_sim_state": 0.030094431428348316, "sim_compute_performance-ego": 0.05325909081627341, "sim_compute_robot_state-ego": 0.0546905798070571, "sim_compute_robot_state-npc0": 0.05562842873965992, "sim_compute_robot_state-npc1": 0.054597208079169776, "sim_compute_robot_state-npc2": 0.05449595170862535, "sim_compute_robot_state-npc3": 0.053436749121722055}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.3270581137113913, "sim_physics": 0.022095883798878096, "survival_time": 8.549999999999986, "driven_lanedir": 1.2414388188003094, "sim_render-ego": 0.05293096854672794, "in-drivable-lane": 0, "agent_compute-ego": 0.056817793706704305, "deviation-heading": 2.3335945552420543, "set_robot_commands": 0.07224065936796846, "deviation-center-line": 0.4114452923747232, "driven_lanedir_consec": 1.2414388188003094, "sim_compute_sim_state": 0.030615014639514233, "sim_compute_performance-ego": 0.0539181065141109, "sim_compute_robot_state-ego": 0.054751242810522606, "sim_compute_robot_state-npc0": 0.05813365651850115, "sim_compute_robot_state-npc1": 0.05505394099051492, "sim_compute_robot_state-npc2": 0.05499884259631062, "sim_compute_robot_state-npc3": 0.05403708714490745}}
set_robot_commands_max0.07247818217558019
set_robot_commands_mean0.07161626767347021
set_robot_commands_median0.0721786898725173
set_robot_commands_min0.07017819370542254
sim_compute_performance-ego_max0.0544653710197
sim_compute_performance-ego_mean0.053705588678362816
sim_compute_performance-ego_median0.0539181065141109
sim_compute_performance-ego_min0.05252840689250401
sim_compute_robot_state-ego_max0.05606660772772396
sim_compute_robot_state-ego_mean0.05511814452243915
sim_compute_robot_state-ego_median0.054751242810522606
sim_compute_robot_state-ego_min0.05464540209089007
sim_compute_robot_state-npc0_max0.05844837076523725
sim_compute_robot_state-npc0_mean0.05686093616542283
sim_compute_robot_state-npc0_median0.05690842486442404
sim_compute_robot_state-npc0_min0.05518579993929182
sim_compute_robot_state-npc1_max0.05609311075771556
sim_compute_robot_state-npc1_mean0.05492769947725854
sim_compute_robot_state-npc1_median0.05505394099051492
sim_compute_robot_state-npc1_min0.05383493900299072
sim_compute_robot_state-npc2_max0.05499884259631062
sim_compute_robot_state-npc2_mean0.054319755950257495
sim_compute_robot_state-npc2_median0.05453406242614097
sim_compute_robot_state-npc2_min0.05294177872794015
sim_compute_robot_state-npc3_max0.05491023905137006
sim_compute_robot_state-npc3_mean0.05409628471928325
sim_compute_robot_state-npc3_median0.05403708714490745
sim_compute_robot_state-npc3_min0.053218431132180354
sim_compute_sim_state_max0.031239902271943933
sim_compute_sim_state_mean0.030804808941053457
sim_compute_sim_state_median0.03092080695288522
sim_compute_sim_state_min0.030094431428348316
sim_physics_max0.025568471235387465
sim_physics_mean0.023853490244866455
sim_physics_median0.02350615894093233
sim_physics_min0.022095883798878096
sim_render-ego_max0.053299622332796136
sim_render-ego_mean0.05225090174216336
sim_render-ego_median0.05256384611129761
sim_render-ego_min0.05109184639794486
simulation-passed1
survival_time_max8.549999999999986
survival_time_mean6.429999999999988
survival_time_min3.399999999999996
186862680RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationhost-errorno-0:20:29
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 481, in get_cr
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1016, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1171, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1217, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2680/step1-simulation-idsc-rudolf-10292-job18686/tmp/tmprqk4zam5/attempts/ETHZ_autolab_technical_track-4-0.attempt4/log.gs2.cbor.tmp']' returned non-zero exit status 1.
(hidden)
183472680RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationerrorno-0:21:05
Waited 1202 seconds [...]
Waited 1202 seconds for container to finish. Giving up. 
(hidden)
180742680RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationsuccessno-0:11:42(hidden)
driven_lanedir_consec_median0.9738777234932487
survival_time_median3.599999999999995
deviation-center-line_median0.28509960091124803
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.08523661248824176
agent_compute-ego_mean0.07525906944547893
agent_compute-ego_median0.07502581996302451
agent_compute-ego_min0.06497703454433343
deviation-center-line_max0.5007139222697288
deviation-center-line_mean0.2896042238267137
deviation-center-line_min0.11520184107741996
deviation-heading_max2.777035135011222
deviation-heading_mean1.08576320922346
deviation-heading_median0.8425319562697337
deviation-heading_min0.40497288239352863
driven_any_max2.180495896693587
driven_any_mean1.2196590722948502
driven_any_median1.1559605849856132
driven_any_min0.5141049501600283
driven_lanedir_consec_max1.1357767333776798
driven_lanedir_consec_mean0.8396026986559288
driven_lanedir_consec_min0.4708240794697187
driven_lanedir_max1.1357767333776798
driven_lanedir_mean0.9481919716449828
driven_lanedir_median1.0542455106795117
driven_lanedir_min0.4708240794697187
in-drivable-lane_max2.1499999999999946
in-drivable-lane_mean0.4899999999999988
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5141049501600283, "sim_physics": 0.02507142459644991, "survival_time": 1.7000000000000008, "driven_lanedir": 0.4708240794697187, "sim_render-ego": 0.07435384918661679, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.08523661248824176, "deviation-heading": 0.40497288239352863, "set_robot_commands": 0.08641878997578341, "deviation-center-line": 0.11520184107741996, "driven_lanedir_consec": 0.4708240794697187, "sim_compute_sim_state": 0.044600178213680494, "sim_compute_performance-ego": 0.07089534927816953, "sim_compute_robot_state-ego": 0.07035524704877068, "sim_compute_robot_state-npc0": 0.07680846663082347, "sim_compute_robot_state-npc1": 0.07116347901961383, "sim_compute_robot_state-npc2": 0.07245571473065544, "sim_compute_robot_state-npc3": 0.07261917170356302}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.180495896693587, "sim_physics": 0.024982869625091553, "survival_time": 6.799999999999984, "driven_lanedir": 1.1062358112047552, "sim_render-ego": 0.07496342939489029, "in-drivable-lane": 2.1499999999999946, "agent_compute-ego": 0.07875131684191086, "deviation-heading": 2.777035135011222, "set_robot_commands": 0.08030551496674032, "deviation-center-line": 0.5007139222697288, "driven_lanedir_consec": 0.5632894462594856, "sim_compute_sim_state": 0.04158072787172654, "sim_compute_performance-ego": 0.07263136085341959, "sim_compute_robot_state-ego": 0.06752695406184477, "sim_compute_robot_state-npc0": 0.07844826053170596, "sim_compute_robot_state-npc1": 0.0740544270066654, "sim_compute_robot_state-npc2": 0.07388144731521606, "sim_compute_robot_state-npc3": 0.07529474531902987}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.2518274290256792, "sim_physics": 0.023537146739470653, "survival_time": 3.899999999999994, "driven_lanedir": 1.1357767333776798, "sim_render-ego": 0.0627513573719905, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.06497703454433343, "deviation-heading": 0.8726129546083947, "set_robot_commands": 0.07226217098725148, "deviation-center-line": 0.24411427794255192, "driven_lanedir_consec": 1.1357767333776798, "sim_compute_sim_state": 0.03483851139362042, "sim_compute_performance-ego": 0.06165999938280155, "sim_compute_robot_state-ego": 0.06377064264737643, "sim_compute_robot_state-npc0": 0.06640772941784981, "sim_compute_robot_state-npc1": 0.06083713739346235, "sim_compute_robot_state-npc2": 0.06088194174644274, "sim_compute_robot_state-npc3": 0.06179149028582451}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9959065006093434, "sim_physics": 0.024269869250635945, "survival_time": 3.099999999999997, "driven_lanedir": 0.9738777234932487, "sim_render-ego": 0.0705898307984875, "in-drivable-lane": 0, "agent_compute-ego": 0.07502581996302451, "deviation-heading": 0.5316631178344208, "set_robot_commands": 0.07849968248798002, "deviation-center-line": 0.28509960091124803, "driven_lanedir_consec": 0.9738777234932487, "sim_compute_sim_state": 0.037878401817814, "sim_compute_performance-ego": 0.06909478864362163, "sim_compute_robot_state-ego": 0.06581108031734344, "sim_compute_robot_state-npc0": 0.07628117453667425, "sim_compute_robot_state-npc1": 0.06912250288071171, "sim_compute_robot_state-npc2": 0.06717621895574755, "sim_compute_robot_state-npc3": 0.0665852677437567}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.1559605849856132, "sim_physics": 0.024753640095392864, "survival_time": 3.599999999999995, "driven_lanedir": 1.0542455106795117, "sim_render-ego": 0.06831526425149706, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.0723045633898841, "deviation-heading": 0.8425319562697337, "set_robot_commands": 0.07522475057178074, "deviation-center-line": 0.30289147693262, "driven_lanedir_consec": 1.0542455106795117, "sim_compute_sim_state": 0.03890577620930142, "sim_compute_performance-ego": 0.06649747490882874, "sim_compute_robot_state-ego": 0.06748959753248426, "sim_compute_robot_state-npc0": 0.07301195462544759, "sim_compute_robot_state-npc1": 0.06861430406570435, "sim_compute_robot_state-npc2": 0.06681454181671143, "sim_compute_robot_state-npc3": 0.06756975915696886}}
set_robot_commands_max0.08641878997578341
set_robot_commands_mean0.07854218179790719
set_robot_commands_median0.07849968248798002
set_robot_commands_min0.07226217098725148
sim_compute_performance-ego_max0.07263136085341959
sim_compute_performance-ego_mean0.06815579461336821
sim_compute_performance-ego_median0.06909478864362163
sim_compute_performance-ego_min0.06165999938280155
sim_compute_robot_state-ego_max0.07035524704877068
sim_compute_robot_state-ego_mean0.06699070432156391
sim_compute_robot_state-ego_median0.06748959753248426
sim_compute_robot_state-ego_min0.06377064264737643
sim_compute_robot_state-npc0_max0.07844826053170596
sim_compute_robot_state-npc0_mean0.07419151714850021
sim_compute_robot_state-npc0_median0.07628117453667425
sim_compute_robot_state-npc0_min0.06640772941784981
sim_compute_robot_state-npc1_max0.0740544270066654
sim_compute_robot_state-npc1_mean0.06875837007323152
sim_compute_robot_state-npc1_median0.06912250288071171
sim_compute_robot_state-npc1_min0.06083713739346235
sim_compute_robot_state-npc2_max0.07388144731521606
sim_compute_robot_state-npc2_mean0.06824197291295464
sim_compute_robot_state-npc2_median0.06717621895574755
sim_compute_robot_state-npc2_min0.06088194174644274
sim_compute_robot_state-npc3_max0.07529474531902987
sim_compute_robot_state-npc3_mean0.06877208684182859
sim_compute_robot_state-npc3_median0.06756975915696886
sim_compute_robot_state-npc3_min0.06179149028582451
sim_compute_sim_state_max0.044600178213680494
sim_compute_sim_state_mean0.039560719101228575
sim_compute_sim_state_median0.03890577620930142
sim_compute_sim_state_min0.03483851139362042
sim_physics_max0.02507142459644991
sim_physics_mean0.024522990061408186
sim_physics_median0.024753640095392864
sim_physics_min0.023537146739470653
sim_render-ego_max0.07496342939489029
sim_render-ego_mean0.07019474620069643
sim_render-ego_median0.0705898307984875
sim_render-ego_min0.0627513573719905
simulation-passed1
survival_time_max6.799999999999984
survival_time_mean3.819999999999994
survival_time_min1.7000000000000008
180672680RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationtimeoutno-0:25:05
I can see how the jo [...]
I can see how the job 18067 is timeout because passed 1505 seconds and the timeout is 1200.0.
(hidden)