Duckietown Challenges Home Challenges Submissions

Submission 4317

Submission4317
Competingyes
Challengeaido3-LFV-sim-testing
UserTanli Chou 🇹🇼
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 27585
Next
User labelchallenge-aido_LF-template-random
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
27585step1-simulationsuccessyes0:14:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.589083599962416
survival_time_median2.499999999999999
deviation-center-line_median0.10394712677689665
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.02939630879296197
agent_compute-ego_mean0.025073146164804848
agent_compute-ego_median0.02465394431469487
agent_compute-ego_min0.023394055988477623
deviation-center-line_max0.21987764564000128
deviation-center-line_mean0.11513253205557164
deviation-center-line_min0.05814541708622475
deviation-heading_max0.8045266837904589
deviation-heading_mean0.39336027445136423
deviation-heading_median0.358997137510946
deviation-heading_min0.1882128425868148
driven_any_max1.0848350093870085
driven_any_mean0.803850154643931
driven_any_median1.0028751755303635
driven_any_min0.28821608451855396
driven_lanedir_consec_max0.9094271662452732
driven_lanedir_consec_mean0.5442692575816761
driven_lanedir_consec_min0.2384328100932288
driven_lanedir_max0.9094271662452732
driven_lanedir_mean0.5442692575816761
driven_lanedir_median0.589083599962416
driven_lanedir_min0.2384328100932288
in-drivable-lane_max1.3999999999999997
in-drivable-lane_mean0.49666666666666576
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0078896084088962, "sim_physics": 0.17645128415181086, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6642632200434848, "sim_render-ego": 0.01363201324756329, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.024772190130673923, "deviation-heading": 0.5050851849885492, "set_robot_commands": 0.009443402290344238, "deviation-center-line": 0.07065220523066396, "driven_lanedir_consec": 0.6642632200434848, "sim_compute_sim_state": 0.0055465193895193245, "sim_compute_performance-ego": 0.007808575263390174, "sim_compute_robot_state-ego": 0.00918673093502338, "sim_compute_robot_state-npc0": 0.010210624107947716, "sim_compute_robot_state-npc1": 0.009741182510669414, "sim_compute_robot_state-npc2": 0.010668694972991943, "sim_compute_robot_state-npc3": 0.009298384189605711}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0132908922270336, "sim_physics": 0.17044550764794444, "survival_time": 2.549999999999999, "driven_lanedir": 0.6920556363090382, "sim_render-ego": 0.01359417391758339, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.023702607435338637, "deviation-heading": 0.37637669020263664, "set_robot_commands": 0.009215555939019897, "deviation-center-line": 0.07530023298116417, "driven_lanedir_consec": 0.6920556363090382, "sim_compute_sim_state": 0.006006530686920765, "sim_compute_performance-ego": 0.008574766271254596, "sim_compute_robot_state-ego": 0.010021466834872378, "sim_compute_robot_state-npc0": 0.00927135523627786, "sim_compute_robot_state-npc1": 0.009388437458113129, "sim_compute_robot_state-npc2": 0.009299937416525447, "sim_compute_robot_state-npc3": 0.009563282424328374}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.8741778194087728, "sim_physics": 0.17729391222414764, "survival_time": 2.3, "driven_lanedir": 0.2384328100932288, "sim_render-ego": 0.014480881069017492, "in-drivable-lane": 1.3999999999999997, "agent_compute-ego": 0.02794617155323858, "deviation-heading": 0.23890637906938705, "set_robot_commands": 0.01025217512379522, "deviation-center-line": 0.10394712677689665, "driven_lanedir_consec": 0.2384328100932288, "sim_compute_sim_state": 0.005695850952811863, "sim_compute_performance-ego": 0.008866501891094706, "sim_compute_robot_state-ego": 0.009346459222876509, "sim_compute_robot_state-npc0": 0.009919347970382028, "sim_compute_robot_state-npc1": 0.009130156558492909, "sim_compute_robot_state-npc2": 0.009904799254044245, "sim_compute_robot_state-npc3": 0.00975049578625223}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3128706606735367, "sim_physics": 0.20534470081329345, "survival_time": 1.0000000000000002, "driven_lanedir": 0.29198509228963654, "sim_render-ego": 0.01231355667114258, "in-drivable-lane": 0, "agent_compute-ego": 0.024646854400634764, "deviation-heading": 0.358997137510946, "set_robot_commands": 0.008799552917480469, "deviation-center-line": 0.05814541708622475, "driven_lanedir_consec": 0.29198509228963654, "sim_compute_sim_state": 0.006425046920776367, "sim_compute_performance-ego": 0.008783876895904541, "sim_compute_robot_state-ego": 0.009480142593383789, "sim_compute_robot_state-npc0": 0.010036098957061769, "sim_compute_robot_state-npc1": 0.009826791286468508, "sim_compute_robot_state-npc2": 0.010818099975585938, "sim_compute_robot_state-npc3": 0.008937644958496093}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0329853511679177, "sim_physics": 0.18208928827969537, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5740093707976381, "sim_render-ego": 0.013743256622890256, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.024310813759857754, "deviation-heading": 0.38611619731107066, "set_robot_commands": 0.00914132370139068, "deviation-center-line": 0.10855323755564342, "driven_lanedir_consec": 0.5740093707976381, "sim_compute_sim_state": 0.005141159273543448, "sim_compute_performance-ego": 0.008082992625686358, "sim_compute_robot_state-ego": 0.00929576945754717, "sim_compute_robot_state-npc0": 0.00907601500457188, "sim_compute_robot_state-npc1": 0.00895744449687454, "sim_compute_robot_state-npc2": 0.009136280923519494, "sim_compute_robot_state-npc3": 0.008840821823983823}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0093722066717894, "sim_physics": 0.15723266968360314, "survival_time": 2.5999999999999988, "driven_lanedir": 0.5897896409204744, "sim_render-ego": 0.0142783706004803, "in-drivable-lane": 0.949999999999998, "agent_compute-ego": 0.02468624023290781, "deviation-heading": 0.32726405081166476, "set_robot_commands": 0.00929585786966177, "deviation-center-line": 0.10959907909937194, "driven_lanedir_consec": 0.5897896409204744, "sim_compute_sim_state": 0.005211958518395057, "sim_compute_performance-ego": 0.008534761575552134, "sim_compute_robot_state-ego": 0.009824876601879414, "sim_compute_robot_state-npc0": 0.009174791666177604, "sim_compute_robot_state-npc1": 0.00888283894612239, "sim_compute_robot_state-npc2": 0.009330235994779147, "sim_compute_robot_state-npc3": 0.009023909385387717}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.28821608451855396, "sim_physics": 0.1904404414327521, "survival_time": 0.9500000000000004, "driven_lanedir": 0.27925052723936306, "sim_render-ego": 0.014603376388549805, "in-drivable-lane": 0, "agent_compute-ego": 0.025871502725701583, "deviation-heading": 0.2202042086876065, "set_robot_commands": 0.00860192901209781, "deviation-center-line": 0.08350947933924269, "driven_lanedir_consec": 0.27925052723936306, "sim_compute_sim_state": 0.005825444271689967, "sim_compute_performance-ego": 0.008388017353258635, "sim_compute_robot_state-ego": 0.009279288743671616, "sim_compute_robot_state-npc0": 0.009125132309763057, "sim_compute_robot_state-npc1": 0.00872458909687243, "sim_compute_robot_state-npc2": 0.00888589808815404, "sim_compute_robot_state-npc3": 0.00968372194390548}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.0028751755303635, "sim_physics": 0.16196182662365485, "survival_time": 2.549999999999999, "driven_lanedir": 0.589083599962416, "sim_render-ego": 0.01489893595377604, "in-drivable-lane": 0.8499999999999981, "agent_compute-ego": 0.02465394431469487, "deviation-heading": 0.34154347845828836, "set_robot_commands": 0.009661342583450616, "deviation-center-line": 0.0989171276835034, "driven_lanedir_consec": 0.589083599962416, "sim_compute_sim_state": 0.005215593412810681, "sim_compute_performance-ego": 0.00843640869739009, "sim_compute_robot_state-ego": 0.01299730936686198, "sim_compute_robot_state-npc0": 0.009210689395081764, "sim_compute_robot_state-npc1": 0.009902383766922295, "sim_compute_robot_state-npc2": 0.00985860824584961, "sim_compute_robot_state-npc3": 0.009245189965939989}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0052678246450475, "sim_physics": 0.14485066077288458, "survival_time": 2.549999999999999, "driven_lanedir": 0.8169200609869163, "sim_render-ego": 0.013518202538583792, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.025246821197808956, "deviation-heading": 0.5031800143488017, "set_robot_commands": 0.009866793950398764, "deviation-center-line": 0.21987764564000128, "driven_lanedir_consec": 0.8169200609869163, "sim_compute_sim_state": 0.006148132623410693, "sim_compute_performance-ego": 0.008277163786046645, "sim_compute_robot_state-ego": 0.009947575774847292, "sim_compute_robot_state-npc0": 0.009891968147427427, "sim_compute_robot_state-npc1": 0.009870459051693188, "sim_compute_robot_state-npc2": 0.009902150023217296, "sim_compute_robot_state-npc3": 0.00908361229242063}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0848350093870085, "sim_physics": 0.1359539341043543, "survival_time": 2.6999999999999984, "driven_lanedir": 0.4403016734098912, "sim_render-ego": 0.014099399248758951, "in-drivable-lane": 1.1500000000000004, "agent_compute-ego": 0.02939630879296197, "deviation-heading": 0.8045266837904589, "set_robot_commands": 0.009035543159202294, "deviation-center-line": 0.1574967504892399, "driven_lanedir_consec": 0.4403016734098912, "sim_compute_sim_state": 0.0057855358830204715, "sim_compute_performance-ego": 0.008246461550394693, "sim_compute_robot_state-ego": 0.009597416277284975, "sim_compute_robot_state-npc0": 0.010036194766009296, "sim_compute_robot_state-npc1": 0.009680553718849464, "sim_compute_robot_state-npc2": 0.00939002301957872, "sim_compute_robot_state-npc3": 0.009469544446026835}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.4264377555317492, "sim_physics": 0.15132610614483172, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4137491306771582, "sim_render-ego": 0.012639806820796086, "in-drivable-lane": 0, "agent_compute-ego": 0.0243759246972891, "deviation-heading": 0.3207236980821958, "set_robot_commands": 0.00903168091407189, "deviation-center-line": 0.08121382878296723, "driven_lanedir_consec": 0.4137491306771582, "sim_compute_sim_state": 0.004910762493426983, "sim_compute_performance-ego": 0.007768988609313965, "sim_compute_robot_state-ego": 0.00927429932814378, "sim_compute_robot_state-npc0": 0.01006456521841196, "sim_compute_robot_state-npc1": 0.008269227468050443, "sim_compute_robot_state-npc2": 0.008678014461810771, "sim_compute_robot_state-npc3": 0.009496111136216383}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.922294498135926, "sim_physics": 0.1572375446557999, "survival_time": 2.3999999999999995, "driven_lanedir": 0.9094271662452732, "sim_render-ego": 0.013154342770576475, "in-drivable-lane": 0, "agent_compute-ego": 0.02494379381338755, "deviation-heading": 0.31845322864720915, "set_robot_commands": 0.00932493805885315, "deviation-center-line": 0.1538466024680805, "driven_lanedir_consec": 0.9094271662452732, "sim_compute_sim_state": 0.005393559734026591, "sim_compute_performance-ego": 0.00740783413251241, "sim_compute_robot_state-ego": 0.009224161505699158, "sim_compute_robot_state-npc0": 0.00932381550470988, "sim_compute_robot_state-npc1": 0.008799980084101358, "sim_compute_robot_state-npc2": 0.009037246306737265, "sim_compute_robot_state-npc3": 0.008541380365689596}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.7185035020690835, "sim_physics": 0.18830313808039617, "survival_time": 1.900000000000001, "driven_lanedir": 0.7137557371068559, "sim_render-ego": 0.013575660554986251, "in-drivable-lane": 0, "agent_compute-ego": 0.02425961117995413, "deviation-heading": 0.1882128425868148, "set_robot_commands": 0.009185358097678736, "deviation-center-line": 0.14938153418232997, "driven_lanedir_consec": 0.7137557371068559, "sim_compute_sim_state": 0.005954786350852565, "sim_compute_performance-ego": 0.008578739668193617, "sim_compute_robot_state-ego": 0.009513792238737408, "sim_compute_robot_state-npc0": 0.008988029078433388, "sim_compute_robot_state-npc1": 0.009694457054138184, "sim_compute_robot_state-npc2": 0.009517123824671694, "sim_compute_robot_state-npc3": 0.008629184020193}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.35066115709520385, "sim_physics": 0.14012984607530676, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32389369486849695, "sim_render-ego": 0.013516509014627209, "in-drivable-lane": 0, "agent_compute-ego": 0.023394055988477623, "deviation-heading": 0.41625225022180623, "set_robot_commands": 0.00863331297169561, "deviation-center-line": 0.06699354519906157, "driven_lanedir_consec": 0.32389369486849695, "sim_compute_sim_state": 0.0052082953245743465, "sim_compute_performance-ego": 0.007451980010322903, "sim_compute_robot_state-ego": 0.00886809307595958, "sim_compute_robot_state-npc0": 0.008788471636564835, "sim_compute_robot_state-npc1": 0.008484975151393724, "sim_compute_robot_state-npc2": 0.00833836845729662, "sim_compute_robot_state-npc3": 0.008833501649939495}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.0080747741880831, "sim_physics": 0.17360654830932618, "survival_time": 2.499999999999999, "driven_lanedir": 0.6271215027752698, "sim_render-ego": 0.013198833465576171, "in-drivable-lane": 0.5999999999999981, "agent_compute-ego": 0.023890352249145503, "deviation-heading": 0.5945620720530285, "set_robot_commands": 0.009002084732055665, "deviation-center-line": 0.1895541683191835, "driven_lanedir_consec": 0.6271215027752698, "sim_compute_sim_state": 0.006530370712280274, "sim_compute_performance-ego": 0.00784799575805664, "sim_compute_robot_state-ego": 0.009740638732910156, "sim_compute_robot_state-npc0": 0.008802990913391113, "sim_compute_robot_state-npc1": 0.009133801460266114, "sim_compute_robot_state-npc2": 0.00956629753112793, "sim_compute_robot_state-npc3": 0.008650808334350587}}
set_robot_commands_max0.01025217512379522
set_robot_commands_mean0.00923272342141312
set_robot_commands_median0.009185358097678736
set_robot_commands_min0.00860192901209781
sim_compute_performance-ego_max0.008866501891094706
sim_compute_performance-ego_mean0.008203670939224807
sim_compute_performance-ego_median0.008277163786046645
sim_compute_performance-ego_min0.00740783413251241
sim_compute_robot_state-ego_max0.01299730936686198
sim_compute_robot_state-ego_mean0.009706534712646571
sim_compute_robot_state-ego_median0.009480142593383789
sim_compute_robot_state-ego_min0.00886809307595958
sim_compute_robot_state-npc0_max0.010210624107947716
sim_compute_robot_state-npc0_mean0.009461339327480773
sim_compute_robot_state-npc0_median0.00927135523627786
sim_compute_robot_state-npc0_min0.008788471636564835
sim_compute_robot_state-npc1_max0.009902383766922295
sim_compute_robot_state-npc1_mean0.009232485207268538
sim_compute_robot_state-npc1_median0.009133801460266114
sim_compute_robot_state-npc1_min0.008269227468050443
sim_compute_robot_state-npc2_max0.010818099975585938
sim_compute_robot_state-npc2_mean0.009488785233059344
sim_compute_robot_state-npc2_median0.00939002301957872
sim_compute_robot_state-npc2_min0.00833836845729662
sim_compute_robot_state-npc3_max0.00975049578625223
sim_compute_robot_state-npc3_mean0.00913650618151573
sim_compute_robot_state-npc3_median0.00908361229242063
sim_compute_robot_state-npc3_min0.008541380365689596
sim_compute_sim_state_max0.006530370712280274
sim_compute_sim_state_mean0.0056666364365372925
sim_compute_sim_state_median0.005695850952811863
sim_compute_sim_state_min0.004910762493426983
sim_physics_max0.20534470081329345
sim_physics_mean0.16751116059998675
sim_physics_median0.17044550764794444
sim_physics_min0.1359539341043543
sim_render-ego_max0.01489893595377604
sim_render-ego_mean0.013683154592327202
sim_render-ego_median0.01359417391758339
sim_render-ego_min0.01231355667114258
simulation-passed1
survival_time_max2.6999999999999984
survival_time_mean2.113333333333333
survival_time_min0.9500000000000004
No reset possible
25856step1-simulationsuccessno0:14:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
24845step1-simulationsuccessno0:15:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
24774step1-simulationerrorno0:10:34
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
24771step1-simulationerrorno0:10:43
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
24770step1-simulationhost-errorno0:02:18
Error while running [...]

stderr | Pulling evaluator      ... 
stderr | Pulling scenario_maker ... 
stderr | Pulling simulator      ... done
stderr | 
stderr | ERROR: for solution  Cannot overwrite digest sha256:ac0b8e530d8161f169d6b2605c3747d7bf1b2daf22c90609277fa161ab4951f3
stderr | Cannot overwrite digest sha256:ac0b8e530d8161f169d6b2605c3747d7bf1b2daf22c90609277fa161ab4951f3
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible