Duckietown Challenges Home Challenges Submissions

Submission 12778

Submission12778
Competingyes
Challengeaido5-LFV_multi-sim-validation
UserThomas Wiggers 🇳🇱
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 59061
Next
User labelppo_v1
Admin priority50
Blessingn/a
User priority50

59061

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
59061LFVmultibodyv-simsuccessyes0:51:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.972281209789724
survival_time_median33.150000000000254
deviation-center-line_median0.4583130854590689
in-drivable-lane_median10.45000000000011


other stats
agent_compute-ego0_max0.04179204092198669
agent_compute-ego0_mean0.03452872799353853
agent_compute-ego0_median0.03577758533408843
agent_compute-ego0_min0.022762159003487117
agent_compute-ego1_max0.03799607996495033
agent_compute-ego1_mean0.03104845265370521
agent_compute-ego1_median0.03109126233342868
agent_compute-ego1_min0.02013679923890512
complete-iteration_max1.245612295435396
complete-iteration_mean0.7613945123731305
complete-iteration_median0.6963282295738358
complete-iteration_min0.2544435398488105
deviation-center-line_max2.0012479503202134
deviation-center-line_mean0.6773364838800776
deviation-center-line_min0.11179610010037457
deviation-heading_max11.197026928641028
deviation-heading_mean3.0367078051242764
deviation-heading_median1.438222371765082
deviation-heading_min0.9064659401001626
driven_any_max4.820480234306313
driven_any_mean2.486194401331144
driven_any_median1.8014153573498417
driven_any_min0.6974454707339337
driven_lanedir_consec_max2.9745202338879073
driven_lanedir_consec_mean1.299713332809303
driven_lanedir_consec_min0.2278406902758152
driven_lanedir_max2.9745202338879073
driven_lanedir_mean1.3001224170759211
driven_lanedir_median0.972281209789724
driven_lanedir_min0.2278406902758152
get_duckie_state_max1.6050857480101007e-06
get_duckie_state_mean1.41786771793678e-06
get_duckie_state_median1.4272798974829984e-06
get_duckie_state_min1.1687037311022797e-06
get_robot_state_max0.014902374568178398
get_robot_state_mean0.01317053903883284
get_robot_state_median0.014289097287761633
get_robot_state_min0.006331593175477619
get_state_dump_max0.009859204791081
get_state_dump_mean0.008776869400399663
get_state_dump_median0.009075497157538116
get_state_dump_min0.005452781538420086
get_ui_image_max0.04940885779249119
get_ui_image_mean0.042665410698450985
get_ui_image_median0.04684834415654102
get_ui_image_min0.026356094245669207
in-drivable-lane_max34.150000000000105
in-drivable-lane_mean13.43214285714294
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 1.7490273215421674, "get_ui_image": 0.03989368837271163, "step_physics": 0.352289637522911, "survival_time": 16.700000000000102, "driven_lanedir": 0.9012692109160918, "get_state_dump": 0.009075497157538116, "get_robot_state": 0.014289097287761633, "sim_render-ego0": 0.003788062707701726, "sim_render-ego1": 0.0037168168309909193, "sim_render-ego2": 0.0036591672185641616, "sim_render-ego3": 0.003538039904921802, "get_duckie_state": 1.3458195017344915e-06, "in-drivable-lane": 9.50000000000012, "deviation-heading": 1.1665055312737878, "agent_compute-ego0": 0.03189984221956623, "agent_compute-ego1": 0.03109126233342868, "agent_compute-ego2": 0.031176530781076916, "agent_compute-ego3": 0.029298881274550707, "complete-iteration": 0.5957184983723199, "set_robot_commands": 0.0020250313317597803, "deviation-center-line": 0.3446590288970802, "driven_lanedir_consec": 0.9012692109160918, "sim_compute_sim_state": 0.025965220892607277, "sim_compute_performance-ego0": 0.0020260277079112493, "sim_compute_performance-ego1": 0.0018601559880954115, "sim_compute_performance-ego2": 0.0018119171484192805, "sim_compute_performance-ego3": 0.001790863008641485}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 2.0193634824311513, "get_ui_image": 0.03989368837271163, "step_physics": 0.352289637522911, "survival_time": 16.700000000000102, "driven_lanedir": 1.4706339910670057, "get_state_dump": 0.009075497157538116, "get_robot_state": 0.014289097287761633, "sim_render-ego0": 0.003788062707701726, "sim_render-ego1": 0.0037168168309909193, "sim_render-ego2": 0.0036591672185641616, "sim_render-ego3": 0.003538039904921802, "get_duckie_state": 1.3458195017344915e-06, "in-drivable-lane": 4.90000000000007, "deviation-heading": 1.58955996475795, "agent_compute-ego0": 0.03189984221956623, "agent_compute-ego1": 0.03109126233342868, "agent_compute-ego2": 0.031176530781076916, "agent_compute-ego3": 0.029298881274550707, "complete-iteration": 0.5957184983723199, "set_robot_commands": 0.0020250313317597803, "deviation-center-line": 0.5020565381167355, "driven_lanedir_consec": 1.4706339910670057, "sim_compute_sim_state": 0.025965220892607277, "sim_compute_performance-ego0": 0.0020260277079112493, "sim_compute_performance-ego1": 0.0018601559880954115, "sim_compute_performance-ego2": 0.0018119171484192805, "sim_compute_performance-ego3": 0.001790863008641485}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.596021217991937, "get_ui_image": 0.03989368837271163, "step_physics": 0.352289637522911, "survival_time": 16.700000000000102, "driven_lanedir": 1.275410895926812, "get_state_dump": 0.009075497157538116, "get_robot_state": 0.014289097287761633, "sim_render-ego0": 0.003788062707701726, "sim_render-ego1": 0.0037168168309909193, "sim_render-ego2": 0.0036591672185641616, "sim_render-ego3": 0.003538039904921802, "get_duckie_state": 1.3458195017344915e-06, "in-drivable-lane": 1.85000000000002, "deviation-heading": 11.197026928641028, "agent_compute-ego0": 0.03189984221956623, "agent_compute-ego1": 0.03109126233342868, "agent_compute-ego2": 0.031176530781076916, "agent_compute-ego3": 0.029298881274550707, "complete-iteration": 0.5957184983723199, "set_robot_commands": 0.0020250313317597803, "deviation-center-line": 1.5618687087082024, "driven_lanedir_consec": 1.2696837161941577, "sim_compute_sim_state": 0.025965220892607277, "sim_compute_performance-ego0": 0.0020260277079112493, "sim_compute_performance-ego1": 0.0018601559880954115, "sim_compute_performance-ego2": 0.0018119171484192805, "sim_compute_performance-ego3": 0.001790863008641485}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.8423986434638475, "get_ui_image": 0.03989368837271163, "step_physics": 0.352289637522911, "survival_time": 16.700000000000102, "driven_lanedir": 1.0432932086633562, "get_state_dump": 0.009075497157538116, "get_robot_state": 0.014289097287761633, "sim_render-ego0": 0.003788062707701726, "sim_render-ego1": 0.0037168168309909193, "sim_render-ego2": 0.0036591672185641616, "sim_render-ego3": 0.003538039904921802, "get_duckie_state": 1.3458195017344915e-06, "in-drivable-lane": 8.000000000000114, "deviation-heading": 1.1475851398317536, "agent_compute-ego0": 0.03189984221956623, "agent_compute-ego1": 0.03109126233342868, "agent_compute-ego2": 0.031176530781076916, "agent_compute-ego3": 0.029298881274550707, "complete-iteration": 0.5957184983723199, "set_robot_commands": 0.0020250313317597803, "deviation-center-line": 0.4533270898953743, "driven_lanedir_consec": 1.0432932086633562, "sim_compute_sim_state": 0.025965220892607277, "sim_compute_performance-ego0": 0.0020260277079112493, "sim_compute_performance-ego1": 0.0018601559880954115, "sim_compute_performance-ego2": 0.0018119171484192805, "sim_compute_performance-ego3": 0.001790863008641485}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 4.109351299566915, "get_ui_image": 0.04684834415654102, "step_physics": 0.4444957935666464, "survival_time": 33.150000000000254, "driven_lanedir": 2.327048841521265, "get_state_dump": 0.009057950183569669, "get_robot_state": 0.013739618192236108, "sim_render-ego0": 0.003802868975214211, "sim_render-ego1": 0.003662586212158203, "sim_render-ego2": 0.00358338564275259, "sim_render-ego3": 0.003644462809505233, "get_duckie_state": 1.4272798974829984e-06, "in-drivable-lane": 14.300000000000098, "deviation-heading": 3.147041076972134, "agent_compute-ego0": 0.03577758533408843, "agent_compute-ego1": 0.029513842370136673, "agent_compute-ego2": 0.02527181427162814, "agent_compute-ego3": 0.023967092295727094, "complete-iteration": 0.6963282295738358, "set_robot_commands": 0.0020389675375926926, "deviation-center-line": 0.8692464374521588, "driven_lanedir_consec": 2.327048841521265, "sim_compute_sim_state": 0.03712960610906762, "sim_compute_performance-ego0": 0.0020463994468551084, "sim_compute_performance-ego1": 0.001809464520718678, "sim_compute_performance-ego2": 0.0017969281558530878, "sim_compute_performance-ego3": 0.0017943393035107348}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 4.170527549529792, "get_ui_image": 0.04684834415654102, "step_physics": 0.4444957935666464, "survival_time": 33.150000000000254, "driven_lanedir": 1.255092015565073, "get_state_dump": 0.009057950183569669, "get_robot_state": 0.013739618192236108, "sim_render-ego0": 0.003802868975214211, "sim_render-ego1": 0.003662586212158203, "sim_render-ego2": 0.00358338564275259, "sim_render-ego3": 0.003644462809505233, "get_duckie_state": 1.4272798974829984e-06, "in-drivable-lane": 23.050000000000185, "deviation-heading": 5.329681029753658, "agent_compute-ego0": 0.03577758533408843, "agent_compute-ego1": 0.029513842370136673, "agent_compute-ego2": 0.02527181427162814, "agent_compute-ego3": 0.023967092295727094, "complete-iteration": 0.6963282295738358, "set_robot_commands": 0.0020389675375926926, "deviation-center-line": 0.7339042764096877, "driven_lanedir_consec": 1.255092015565073, "sim_compute_sim_state": 0.03712960610906762, "sim_compute_performance-ego0": 0.0020463994468551084, "sim_compute_performance-ego1": 0.001809464520718678, "sim_compute_performance-ego2": 0.0017969281558530878, "sim_compute_performance-ego3": 0.0017943393035107348}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 3.475642063404019, "get_ui_image": 0.04684834415654102, "step_physics": 0.4444957935666464, "survival_time": 33.150000000000254, "driven_lanedir": 2.756020360804861, "get_state_dump": 0.009057950183569669, "get_robot_state": 0.013739618192236108, "sim_render-ego0": 0.003802868975214211, "sim_render-ego1": 0.003662586212158203, "sim_render-ego2": 0.00358338564275259, "sim_render-ego3": 0.003644462809505233, "get_duckie_state": 1.4272798974829984e-06, "in-drivable-lane": 4.200000000000037, "deviation-heading": 4.1185164557195275, "agent_compute-ego0": 0.03577758533408843, "agent_compute-ego1": 0.029513842370136673, "agent_compute-ego2": 0.02527181427162814, "agent_compute-ego3": 0.023967092295727094, "complete-iteration": 0.6963282295738358, "set_robot_commands": 0.0020389675375926926, "deviation-center-line": 1.3136216454061234, "driven_lanedir_consec": 2.756020360804861, "sim_compute_sim_state": 0.03712960610906762, "sim_compute_performance-ego0": 0.0020463994468551084, "sim_compute_performance-ego1": 0.001809464520718678, "sim_compute_performance-ego2": 0.0017969281558530878, "sim_compute_performance-ego3": 0.0017943393035107348}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 4.710772198237632, "get_ui_image": 0.04684834415654102, "step_physics": 0.4444957935666464, "survival_time": 33.150000000000254, "driven_lanedir": 0.8728973493053128, "get_state_dump": 0.009057950183569669, "get_robot_state": 0.013739618192236108, "sim_render-ego0": 0.003802868975214211, "sim_render-ego1": 0.003662586212158203, "sim_render-ego2": 0.00358338564275259, "sim_render-ego3": 0.003644462809505233, "get_duckie_state": 1.4272798974829984e-06, "in-drivable-lane": 27.100000000000225, "deviation-heading": 3.4229012892843484, "agent_compute-ego0": 0.03577758533408843, "agent_compute-ego1": 0.029513842370136673, "agent_compute-ego2": 0.02527181427162814, "agent_compute-ego3": 0.023967092295727094, "complete-iteration": 0.6963282295738358, "set_robot_commands": 0.0020389675375926926, "deviation-center-line": 0.4632990810227635, "driven_lanedir_consec": 0.8728973493053128, "sim_compute_sim_state": 0.03712960610906762, "sim_compute_performance-ego0": 0.0020463994468551084, "sim_compute_performance-ego1": 0.001809464520718678, "sim_compute_performance-ego2": 0.0017969281558530878, "sim_compute_performance-ego3": 0.0017943393035107348}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.7558373843754532, "get_ui_image": 0.04940885779249119, "step_physics": 0.9714468306909878, "survival_time": 35.800000000000104, "driven_lanedir": 0.2278406902758152, "get_state_dump": 0.009859204791081, "get_robot_state": 0.014902374568178398, "sim_render-ego0": 0.003971731978646548, "sim_render-ego1": 0.0039607414474380894, "sim_render-ego2": 0.0038512218613671128, "sim_render-ego3": 0.003782250392387103, "get_duckie_state": 1.6050857480101007e-06, "in-drivable-lane": 34.150000000000105, "deviation-heading": 0.947162113264172, "agent_compute-ego0": 0.04179204092198669, "agent_compute-ego1": 0.03799607996495033, "agent_compute-ego2": 0.03424715230986995, "agent_compute-ego3": 0.03464946121684012, "complete-iteration": 1.245612295435396, "set_robot_commands": 0.0024309687035851896, "deviation-center-line": 0.11179610010037457, "driven_lanedir_consec": 0.2278406902758152, "sim_compute_sim_state": 0.01769441407760982, "sim_compute_performance-ego0": 0.002104689054076808, "sim_compute_performance-ego1": 0.002049846130434938, "sim_compute_performance-ego2": 0.001960555546120786, "sim_compute_performance-ego3": 0.002042267944357219}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 4.820480234306313, "get_ui_image": 0.04940885779249119, "step_physics": 0.9714468306909878, "survival_time": 35.800000000000104, "driven_lanedir": 2.9745202338879073, "get_state_dump": 0.009859204791081, "get_robot_state": 0.014902374568178398, "sim_render-ego0": 0.003971731978646548, "sim_render-ego1": 0.0039607414474380894, "sim_render-ego2": 0.0038512218613671128, "sim_render-ego3": 0.003782250392387103, "get_duckie_state": 1.6050857480101007e-06, "in-drivable-lane": 11.449999999999893, "deviation-heading": 6.141004439947946, "agent_compute-ego0": 0.04179204092198669, "agent_compute-ego1": 0.03799607996495033, "agent_compute-ego2": 0.03424715230986995, "agent_compute-ego3": 0.03464946121684012, "complete-iteration": 1.245612295435396, "set_robot_commands": 0.0024309687035851896, "deviation-center-line": 2.0012479503202134, "driven_lanedir_consec": 2.9745202338879073, "sim_compute_sim_state": 0.01769441407760982, "sim_compute_performance-ego0": 0.002104689054076808, "sim_compute_performance-ego1": 0.002049846130434938, "sim_compute_performance-ego2": 0.001960555546120786, "sim_compute_performance-ego3": 0.002042267944357219}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 0.6974454707339337, "get_ui_image": 0.04940885779249119, "step_physics": 0.9714468306909878, "survival_time": 35.800000000000104, "driven_lanedir": 0.695680401319015, "get_state_dump": 0.009859204791081, "get_robot_state": 0.014902374568178398, "sim_render-ego0": 0.003971731978646548, "sim_render-ego1": 0.0039607414474380894, "sim_render-ego2": 0.0038512218613671128, "sim_render-ego3": 0.003782250392387103, "get_duckie_state": 1.6050857480101007e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.9064659401001626, "agent_compute-ego0": 0.04179204092198669, "agent_compute-ego1": 0.03799607996495033, "agent_compute-ego2": 0.03424715230986995, "agent_compute-ego3": 0.03464946121684012, "complete-iteration": 1.245612295435396, "set_robot_commands": 0.0024309687035851896, "deviation-center-line": 0.20341791160662875, "driven_lanedir_consec": 0.695680401319015, "sim_compute_sim_state": 0.01769441407760982, "sim_compute_performance-ego0": 0.002104689054076808, "sim_compute_performance-ego1": 0.002049846130434938, "sim_compute_performance-ego2": 0.001960555546120786, "sim_compute_performance-ego3": 0.002042267944357219}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 1.6780752016100065, "get_ui_image": 0.04940885779249119, "step_physics": 0.9714468306909878, "survival_time": 35.800000000000104, "driven_lanedir": 0.8542752641907689, "get_state_dump": 0.009859204791081, "get_robot_state": 0.014902374568178398, "sim_render-ego0": 0.003971731978646548, "sim_render-ego1": 0.0039607414474380894, "sim_render-ego2": 0.0038512218613671128, "sim_render-ego3": 0.003782250392387103, "get_duckie_state": 1.6050857480101007e-06, "in-drivable-lane": 29.700000000000117, "deviation-heading": 1.0089794742076013, "agent_compute-ego0": 0.04179204092198669, "agent_compute-ego1": 0.03799607996495033, "agent_compute-ego2": 0.03424715230986995, "agent_compute-ego3": 0.03464946121684012, "complete-iteration": 1.245612295435396, "set_robot_commands": 0.0024309687035851896, "deviation-center-line": 0.25332088181383217, "driven_lanedir_consec": 0.8542752641907689, "sim_compute_sim_state": 0.01769441407760982, "sim_compute_performance-ego0": 0.002104689054076808, "sim_compute_performance-ego1": 0.002049846130434938, "sim_compute_performance-ego2": 0.001960555546120786, "sim_compute_performance-ego3": 0.002042267944357219}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.7604320712358357, "get_ui_image": 0.026356094245669207, "step_physics": 0.15271978589552868, "survival_time": 15.750000000000089, "driven_lanedir": 0.8970722564872331, "get_state_dump": 0.005452781538420086, "get_robot_state": 0.006331593175477619, "sim_render-ego0": 0.0033364069612720343, "sim_render-ego1": 0.00325428458708751, "get_duckie_state": 1.1687037311022797e-06, "in-drivable-lane": 8.450000000000106, "deviation-heading": 1.104595109213587, "agent_compute-ego0": 0.022762159003487117, "agent_compute-ego1": 0.02013679923890512, "complete-iteration": 0.2544435398488105, "set_robot_commands": 0.0018574074853824664, "deviation-center-line": 0.38150462689083864, "driven_lanedir_consec": 0.8970722564872331, "sim_compute_sim_state": 0.00708044405224957, "sim_compute_performance-ego0": 0.0016700248175029514, "sim_compute_performance-ego1": 0.0015986003453218483}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.421347480207017, "get_ui_image": 0.026356094245669207, "step_physics": 0.15271978589552868, "survival_time": 15.750000000000089, "driven_lanedir": 0.6506591191323764, "get_state_dump": 0.005452781538420086, "get_robot_state": 0.006331593175477619, "sim_render-ego0": 0.0033364069612720343, "sim_render-ego1": 0.00325428458708751, "get_duckie_state": 1.1687037311022797e-06, "in-drivable-lane": 11.400000000000096, "deviation-heading": 1.2868847787722135, "agent_compute-ego0": 0.022762159003487117, "agent_compute-ego1": 0.02013679923890512, "complete-iteration": 0.2544435398488105, "set_robot_commands": 0.0018574074853824664, "deviation-center-line": 0.28944049768107194, "driven_lanedir_consec": 0.6506591191323764, "sim_compute_sim_state": 0.00708044405224957, "sim_compute_performance-ego0": 0.0016700248175029514, "sim_compute_performance-ego1": 0.0015986003453218483}}
set_robot_commands_max0.0024309687035851896
set_robot_commands_mean0.002121048947322541
set_robot_commands_median0.0020389675375926926
set_robot_commands_min0.0018574074853824664
sim_compute_performance-ego0_max0.002104689054076808
sim_compute_performance-ego0_mean0.002003465319312755
sim_compute_performance-ego0_median0.0020463994468551084
sim_compute_performance-ego0_min0.0016700248175029514
sim_compute_performance-ego1_max0.002049846130434938
sim_compute_performance-ego1_mean0.0018625048034028437
sim_compute_performance-ego1_median0.0018601559880954115
sim_compute_performance-ego1_min0.0015986003453218483
sim_compute_sim_state_max0.03712960610906762
sim_compute_sim_state_mean0.024094132315831285
sim_compute_sim_state_median0.025965220892607277
sim_compute_sim_state_min0.00708044405224957
sim_render-ego0_max0.003971731978646548
sim_render-ego0_mean0.003780247754913858
sim_render-ego0_median0.003802868975214211
sim_render-ego0_min0.0033364069612720343
sim_render-ego1_max0.0039607414474380894
sim_render-ego1_mean0.003704939081180277
sim_render-ego1_median0.0037168168309909193
sim_render-ego1_min0.00325428458708751
simulation-passed1
step_physics_max0.9714468306909878
step_physics_mean0.5270263299223741
step_physics_median0.4444957935666464
step_physics_min0.15271978589552868
survival_time_max35.800000000000104
survival_time_mean26.72142857142872
survival_time_min15.750000000000089
No reset possible
59056LFVmultibodyv-simsuccessyes1:10:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible