Duckietown Challenges Home Challenges Submissions

Submission 2680

Submission2680
Competingyes
Challengeaido2-LFV-sim-testing
UserRami Al-Naim 🇷🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22829
Next
User labelchallenge-aido_LF-baseline-duckietown
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
22829step1-simulationsuccessyes0:46:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8978797544254031
survival_time_median14.950000000000076
deviation-center-line_median0.9053887635539783
in-drivable-lane_median1.8500000000000183


other stats
agent_compute-ego_max0.0410152276357015
agent_compute-ego_mean0.03902189303630465
agent_compute-ego_median0.03871884584426879
agent_compute-ego_min0.038430514335632326
deviation-center-line_max1.1827260995852698
deviation-center-line_mean0.7986541810975463
deviation-center-line_min0.3265371245987829
deviation-heading_max7.287015811488866
deviation-heading_mean4.666623975752733
deviation-heading_median5.24216003320387
deviation-heading_min0.7992649948727001
driven_any_max2.349068078523283
driven_any_mean1.7996518530968126
driven_any_median2.34856485195945
driven_any_min0.6446759124755118
driven_lanedir_consec_max2.022275049294276
driven_lanedir_consec_mean0.9983701823540848
driven_lanedir_consec_min0.24750745880541647
driven_lanedir_max2.022275049294276
driven_lanedir_mean1.2452160723074783
driven_lanedir_median1.2939518100970635
driven_lanedir_min0.4639779886949782
in-drivable-lane_max4.600000000000008
in-drivable-lane_mean1.83666666666667
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6446759124755118, "sim_physics": 0.07152023476161314, "survival_time": 4.449999999999992, "driven_lanedir": 0.5085655977799672, "sim_render-ego": 0.03475114468778117, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.04037911972303069, "deviation-heading": 1.4529882919224093, "set_robot_commands": 0.051434168654881166, "deviation-center-line": 0.3265371245987829, "driven_lanedir_consec": 0.5085655977799672, "sim_compute_sim_state": 0.021465130066603756, "sim_compute_performance-ego": 0.03671217232607723, "sim_compute_robot_state-ego": 0.0388655448227786, "sim_compute_robot_state-npc0": 0.037628476539354645, "sim_compute_robot_state-npc1": 0.037997476170572, "sim_compute_robot_state-npc2": 0.037983546096287416, "sim_compute_robot_state-npc3": 0.03745567396785436}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3486643617000205, "sim_physics": 0.07059879144032796, "survival_time": 14.950000000000076, "driven_lanedir": 1.6486043873428429, "sim_render-ego": 0.0341278338432312, "in-drivable-lane": 1.8500000000000183, "agent_compute-ego": 0.03871884584426879, "deviation-heading": 7.129794909194173, "set_robot_commands": 0.05224060455958048, "deviation-center-line": 0.9648410879914784, "driven_lanedir_consec": 1.241300151966395, "sim_compute_sim_state": 0.02162352164586385, "sim_compute_performance-ego": 0.037071423530578615, "sim_compute_robot_state-ego": 0.03855469783147176, "sim_compute_robot_state-npc0": 0.03772365172704061, "sim_compute_robot_state-npc1": 0.03797820011774699, "sim_compute_robot_state-npc2": 0.03778666734695434, "sim_compute_robot_state-npc3": 0.037799630959828696}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3486169895288564, "sim_physics": 0.07009765227635702, "survival_time": 14.950000000000076, "driven_lanedir": 1.2939518100970635, "sim_render-ego": 0.0339020037651062, "in-drivable-lane": 3.6000000000000068, "agent_compute-ego": 0.03865463813145956, "deviation-heading": 7.287015811488866, "set_robot_commands": 0.05201335430145264, "deviation-center-line": 0.8795195010110861, "driven_lanedir_consec": 0.8589812116333073, "sim_compute_sim_state": 0.02135192632675171, "sim_compute_performance-ego": 0.037140968640645346, "sim_compute_robot_state-ego": 0.03826268513997396, "sim_compute_robot_state-npc0": 0.03766241312026977, "sim_compute_robot_state-npc1": 0.037969391345977786, "sim_compute_robot_state-npc2": 0.03790225505828857, "sim_compute_robot_state-npc3": 0.03786034901936849}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3485874889438167, "sim_physics": 0.07178265810012817, "survival_time": 14.950000000000076, "driven_lanedir": 1.2931001153650192, "sim_render-ego": 0.033975416819254554, "in-drivable-lane": 4.600000000000008, "agent_compute-ego": 0.03949803511301676, "deviation-heading": 5.370937819382867, "set_robot_commands": 0.05218669732411702, "deviation-center-line": 1.006528047271139, "driven_lanedir_consec": 0.8939800674811287, "sim_compute_sim_state": 0.02141225814819336, "sim_compute_performance-ego": 0.037219637235005695, "sim_compute_robot_state-ego": 0.03861245393753051, "sim_compute_robot_state-npc0": 0.037773265838623046, "sim_compute_robot_state-npc1": 0.03796491543451945, "sim_compute_robot_state-npc2": 0.03787972132364909, "sim_compute_robot_state-npc3": 0.037599267164866126}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6454831015144277, "sim_physics": 0.06520662362548127, "survival_time": 4.3499999999999925, "driven_lanedir": 0.6333644034153836, "sim_render-ego": 0.03432203709394082, "in-drivable-lane": 0, "agent_compute-ego": 0.038747395592174314, "deviation-heading": 0.7992649948727001, "set_robot_commands": 0.05194716892023196, "deviation-center-line": 0.3583495808721403, "driven_lanedir_consec": 0.6333644034153836, "sim_compute_sim_state": 0.0214436465296252, "sim_compute_performance-ego": 0.03692472118070756, "sim_compute_robot_state-ego": 0.038184683898399616, "sim_compute_robot_state-npc0": 0.03824785111964434, "sim_compute_robot_state-npc1": 0.037701946565474584, "sim_compute_robot_state-npc2": 0.03785560048859695, "sim_compute_robot_state-npc3": 0.03727758067777787}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.071188250223395, "sim_physics": 0.07013532263892037, "survival_time": 6.999999999999983, "driven_lanedir": 0.5566436956560228, "sim_render-ego": 0.03421661513192313, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.03853212084089007, "deviation-heading": 3.3917851165100856, "set_robot_commands": 0.05223367043903896, "deviation-center-line": 0.5658477439972391, "driven_lanedir_consec": 0.28889244118302204, "sim_compute_sim_state": 0.02150033371789115, "sim_compute_performance-ego": 0.03702266727175031, "sim_compute_robot_state-ego": 0.03955997228622436, "sim_compute_robot_state-npc0": 0.037786456516810826, "sim_compute_robot_state-npc1": 0.03810385465621948, "sim_compute_robot_state-npc2": 0.03775852067129953, "sim_compute_robot_state-npc3": 0.03770705461502075}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9106108218985782, "sim_physics": 0.07075324654579163, "survival_time": 5.999999999999987, "driven_lanedir": 0.8619235094803662, "sim_render-ego": 0.034204667806625365, "in-drivable-lane": 0, "agent_compute-ego": 0.03856101234753927, "deviation-heading": 1.4794498745455007, "set_robot_commands": 0.05223226348559062, "deviation-center-line": 0.4781765916297879, "driven_lanedir_consec": 0.8619235094803662, "sim_compute_sim_state": 0.021222678820292155, "sim_compute_performance-ego": 0.03742044369379679, "sim_compute_robot_state-ego": 0.038370126485824586, "sim_compute_robot_state-npc0": 0.038155738512674967, "sim_compute_robot_state-npc1": 0.03773999015490214, "sim_compute_robot_state-npc2": 0.03849217096964518, "sim_compute_robot_state-npc3": 0.03814038435618083}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.7658832312059227, "sim_physics": 0.07007530623791265, "survival_time": 5.09999999999999, "driven_lanedir": 0.4639779886949782, "sim_render-ego": 0.034153386658313224, "in-drivable-lane": 0.55, "agent_compute-ego": 0.0410152276357015, "deviation-heading": 2.9457570883426687, "set_robot_commands": 0.05136306379355636, "deviation-center-line": 0.4726268180199212, "driven_lanedir_consec": 0.24750745880541647, "sim_compute_sim_state": 0.021163631887996897, "sim_compute_performance-ego": 0.03677391772176705, "sim_compute_robot_state-ego": 0.0386196117775113, "sim_compute_robot_state-npc0": 0.0377655076045616, "sim_compute_robot_state-npc1": 0.03828177966323553, "sim_compute_robot_state-npc2": 0.03792843397925882, "sim_compute_robot_state-npc3": 0.03819968653660195}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.3488046627326997, "sim_physics": 0.06894954919815063, "survival_time": 14.950000000000076, "driven_lanedir": 1.948707000596421, "sim_render-ego": 0.0339596144358317, "in-drivable-lane": 0.7000000000000031, "agent_compute-ego": 0.038630271752675374, "deviation-heading": 5.829305210448549, "set_robot_commands": 0.05206413427988688, "deviation-center-line": 1.1081301352868396, "driven_lanedir_consec": 1.4215317188111218, "sim_compute_sim_state": 0.02140802303949992, "sim_compute_performance-ego": 0.0367464025815328, "sim_compute_robot_state-ego": 0.03812904755274455, "sim_compute_robot_state-npc0": 0.037823726336161295, "sim_compute_robot_state-npc1": 0.037701642513275145, "sim_compute_robot_state-npc2": 0.037548521359761555, "sim_compute_robot_state-npc3": 0.03755371809005737}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.348675149610332, "sim_physics": 0.07312440554300945, "survival_time": 14.950000000000076, "driven_lanedir": 1.375361041512425, "sim_render-ego": 0.03416662931442261, "in-drivable-lane": 3.3000000000000114, "agent_compute-ego": 0.038430514335632326, "deviation-heading": 7.070502895800575, "set_robot_commands": 0.05176014423370361, "deviation-center-line": 0.787762859460344, "driven_lanedir_consec": 1.1917471920683638, "sim_compute_sim_state": 0.02143421729405721, "sim_compute_performance-ego": 0.03715886036554973, "sim_compute_robot_state-ego": 0.038602335453033446, "sim_compute_robot_state-npc0": 0.03778303225835165, "sim_compute_robot_state-npc1": 0.03799190203348795, "sim_compute_robot_state-npc2": 0.03770037015279134, "sim_compute_robot_state-npc3": 0.03789130846659342}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.349068078523283, "sim_physics": 0.0679710292816162, "survival_time": 14.950000000000076, "driven_lanedir": 1.8444163179922024, "sim_render-ego": 0.034144775072733564, "in-drivable-lane": 1.900000000000003, "agent_compute-ego": 0.0387628165880839, "deviation-heading": 5.24216003320387, "set_robot_commands": 0.05228164037068685, "deviation-center-line": 0.9985419346867458, "driven_lanedir_consec": 1.8444163179922024, "sim_compute_sim_state": 0.021434213320414227, "sim_compute_performance-ego": 0.03699474414189657, "sim_compute_robot_state-ego": 0.03842739661534627, "sim_compute_robot_state-npc0": 0.03781946023305257, "sim_compute_robot_state-npc1": 0.037896774609883624, "sim_compute_robot_state-npc2": 0.03782220602035522, "sim_compute_robot_state-npc3": 0.037617974281311035}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.3490417922239817, "sim_physics": 0.06689083258310954, "survival_time": 14.950000000000076, "driven_lanedir": 2.022275049294276, "sim_render-ego": 0.03363688309987386, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.03905247767766317, "deviation-heading": 4.1972179821626705, "set_robot_commands": 0.051466715335845944, "deviation-center-line": 1.0386131686552715, "driven_lanedir_consec": 2.022275049294276, "sim_compute_sim_state": 0.02125149647394816, "sim_compute_performance-ego": 0.03679918845494588, "sim_compute_robot_state-ego": 0.038499943415323895, "sim_compute_robot_state-npc0": 0.03752013921737671, "sim_compute_robot_state-npc1": 0.03754080931345622, "sim_compute_robot_state-npc2": 0.03782504717508952, "sim_compute_robot_state-npc3": 0.0378455909093221}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.8183701846397415, "sim_physics": 0.06720255884489788, "survival_time": 11.65000000000003, "driven_lanedir": 1.254122761820048, "sim_render-ego": 0.03446632802742233, "in-drivable-lane": 1.7999999999999952, "agent_compute-ego": 0.038507359222281136, "deviation-heading": 4.736929297442443, "set_robot_commands": 0.05190430792616161, "deviation-center-line": 0.9053887635539783, "driven_lanedir_consec": 1.0799769557365442, "sim_compute_sim_state": 0.02147573053581009, "sim_compute_performance-ego": 0.037211633035553374, "sim_compute_robot_state-ego": 0.0384113716976837, "sim_compute_robot_state-npc0": 0.038171670979184655, "sim_compute_robot_state-npc1": 0.03806118596776872, "sim_compute_robot_state-npc2": 0.03799399899822448, "sim_compute_robot_state-npc3": 0.037845064130463825}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.34856485195945, "sim_physics": 0.06996794859568278, "survival_time": 14.950000000000076, "driven_lanedir": 1.362205116595515, "sim_render-ego": 0.033998185793558754, "in-drivable-lane": 3.90000000000001, "agent_compute-ego": 0.03921487967173259, "deviation-heading": 5.909834507439167, "set_robot_commands": 0.05122409184773763, "deviation-center-line": 0.906223259843169, "driven_lanedir_consec": 0.9832109052383768, "sim_compute_sim_state": 0.02130258083343506, "sim_compute_performance-ego": 0.03670088132222493, "sim_compute_robot_state-ego": 0.038633507092793784, "sim_compute_robot_state-npc0": 0.0376745859781901, "sim_compute_robot_state-npc1": 0.03781512896219889, "sim_compute_robot_state-npc2": 0.03762899080912272, "sim_compute_robot_state-npc3": 0.03756457567214966}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.3485429192721696, "sim_physics": 0.07104145447413127, "survival_time": 14.950000000000076, "driven_lanedir": 1.6110222889696435, "sim_render-ego": 0.03418943723042806, "in-drivable-lane": 2.0000000000000107, "agent_compute-ego": 0.03862368106842041, "deviation-heading": 7.156415803534466, "set_robot_commands": 0.05231973965962728, "deviation-center-line": 1.1827260995852698, "driven_lanedir_consec": 0.8978797544254031, "sim_compute_sim_state": 0.021568671862284346, "sim_compute_performance-ego": 0.037292234897613526, "sim_compute_robot_state-ego": 0.03868702173233032, "sim_compute_robot_state-npc0": 0.03792251348495483, "sim_compute_robot_state-npc1": 0.038045072555541994, "sim_compute_robot_state-npc2": 0.038802358309427895, "sim_compute_robot_state-npc3": 0.038144535223642986}}
set_robot_commands_max0.05231973965962728
set_robot_commands_mean0.05191145100880659
set_robot_commands_median0.05201335430145264
set_robot_commands_min0.05122409184773763
sim_compute_performance-ego_max0.03742044369379679
sim_compute_performance-ego_mean0.03701265975997636
sim_compute_performance-ego_median0.03702266727175031
sim_compute_performance-ego_min0.03670088132222493
sim_compute_robot_state-ego_max0.03955997228622436
sim_compute_robot_state-ego_mean0.03856135998259804
sim_compute_robot_state-ego_median0.03855469783147176
sim_compute_robot_state-ego_min0.03812904755274455
sim_compute_robot_state-npc0_max0.03824785111964434
sim_compute_robot_state-npc0_mean0.03783056596441677
sim_compute_robot_state-npc0_median0.03778303225835165
sim_compute_robot_state-npc0_min0.03752013921737671
sim_compute_robot_state-npc1_max0.03828177966323553
sim_compute_robot_state-npc1_mean0.037919338004284035
sim_compute_robot_state-npc1_median0.037969391345977786
sim_compute_robot_state-npc1_min0.03754080931345622
sim_compute_robot_state-npc2_max0.038802358309427895
sim_compute_robot_state-npc2_mean0.037927227250583506
sim_compute_robot_state-npc2_median0.03785560048859695
sim_compute_robot_state-npc2_min0.037548521359761555
sim_compute_robot_state-npc3_max0.03819968653660195
sim_compute_robot_state-npc3_mean0.03776682627140263
sim_compute_robot_state-npc3_median0.037799630959828696
sim_compute_robot_state-npc3_min0.03727758067777787
sim_compute_sim_state_max0.02162352164586385
sim_compute_sim_state_mean0.021403870700177803
sim_compute_sim_state_median0.021434213320414227
sim_compute_sim_state_min0.021163631887996897
sim_physics_max0.07312440554300945
sim_physics_mean0.06968784094314201
sim_physics_median0.07009765227635702
sim_physics_min0.06520662362548127
sim_render-ego_max0.03475114468778117
sim_render-ego_mean0.03414766391869643
sim_render-ego_median0.034153386658313224
sim_render-ego_min0.03363688309987386
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.540000000000044
survival_time_min4.3499999999999925
No reset possible