Duckietown Challenges Home Challenges Submissions

Submission 12644

Submission12644
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 53969
Next
User labeltemplate-pytorch
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
53969LFVmultibodyv-simsuccessyes2:10:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5482572865997812
survival_time_median59.99999999999873
deviation-center-line_median0.48908197119536806
in-drivable-lane_median54.99999999999872


other stats
agent_compute-ego0_max0.015692049815791732
agent_compute-ego0_mean0.01408536859282957
agent_compute-ego0_median0.01491167324965046
agent_compute-ego0_min0.011634425259351136
agent_compute-ego1_max0.012709016903155452
agent_compute-ego1_mean0.012025766683501127
agent_compute-ego1_median0.012474702061661872
agent_compute-ego1_min0.010987574611476418
agent_compute-ego2_max0.01233591763403493
agent_compute-ego2_mean0.011618719741499426
agent_compute-ego2_median0.01132575578236957
agent_compute-ego2_min0.01119448580809378
agent_compute-ego3_max0.012176437639971756
agent_compute-ego3_mean0.011741497170551266
agent_compute-ego3_median0.01158225605827287
agent_compute-ego3_min0.011465797813409177
complete-iteration_max1.303675835575291
complete-iteration_mean1.0939845702757915
complete-iteration_median1.229151197913088
complete-iteration_min0.4101242763017437
deviation-center-line_max1.886463674433613
deviation-center-line_mean0.7894874077094801
deviation-center-line_min0.07032012472510785
deviation-heading_max16.613547557195222
deviation-heading_mean6.776038452013834
deviation-heading_median4.089277326573538
deviation-heading_min0.6182685772099469
driven_any_max12.548787111322453
driven_any_mean5.263663435750637
driven_any_median4.8138467184246325
driven_any_min0.17384220550911303
driven_lanedir_consec_max2.5721680945111616
driven_lanedir_consec_mean0.7492611535118575
driven_lanedir_consec_min0.06868086921458616
driven_lanedir_max2.5721680945111616
driven_lanedir_mean0.8118556780556254
driven_lanedir_median0.6966477770815822
driven_lanedir_min0.06868086921458616
get_duckie_state_max1.391800714472152e-06
get_duckie_state_mean1.3503390798050311e-06
get_duckie_state_median1.33105459856451e-06
get_duckie_state_min1.3276798143474189e-06
get_robot_state_max0.014225606219556111
get_robot_state_mean0.012993136101136582
get_robot_state_median0.01391565313347174
get_robot_state_min0.007027882719714874
get_state_dump_max0.009342918189538706
get_state_dump_mean0.008854810811824715
get_state_dump_median0.009334424850247882
get_state_dump_min0.00599497164615882
get_ui_image_max0.05070119495693591
get_ui_image_mean0.04447153999389415
get_ui_image_median0.04648839524147612
get_ui_image_min0.02980290721794846
in-drivable-lane_max58.99999999999873
in-drivable-lane_mean51.62142857142736
in-drivable-lane_min37.14999999999904
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 0.7594283890537241, "get_ui_image": 0.0435593461712433, "step_physics": 0.9258994669044742, "survival_time": 59.99999999999873, "driven_lanedir": 0.23790481177222889, "get_state_dump": 0.009334424850247882, "get_robot_state": 0.01382077564109275, "sim_render-ego0": 0.0038010190666764106, "sim_render-ego1": 0.003537334867758517, "sim_render-ego2": 0.003628192396584796, "sim_render-ego3": 0.0035767356720097752, "get_duckie_state": 1.33105459856451e-06, "in-drivable-lane": 55.999999999998735, "deviation-heading": 2.6971316675518744, "agent_compute-ego0": 0.01491167324965046, "agent_compute-ego1": 0.01141267712169841, "agent_compute-ego2": 0.01119448580809378, "agent_compute-ego3": 0.011465797813409177, "complete-iteration": 1.0910568243260188, "set_robot_commands": 0.002166720254534389, "deviation-center-line": 0.3694733818024503, "driven_lanedir_consec": 0.23790481177222889, "sim_compute_sim_state": 0.018609787800429167, "sim_compute_performance-ego0": 0.001889708040159608, "sim_compute_performance-ego1": 0.001886883345769903, "sim_compute_performance-ego2": 0.0018602449828440896, "sim_compute_performance-ego3": 0.0018350444765114764}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 9.761835698934451, "get_ui_image": 0.0435593461712433, "step_physics": 0.9258994669044742, "survival_time": 59.99999999999873, "driven_lanedir": 1.177562192822179, "get_state_dump": 0.009334424850247882, "get_robot_state": 0.01382077564109275, "sim_render-ego0": 0.0038010190666764106, "sim_render-ego1": 0.003537334867758517, "sim_render-ego2": 0.003628192396584796, "sim_render-ego3": 0.0035767356720097752, "get_duckie_state": 1.33105459856451e-06, "in-drivable-lane": 45.0999999999989, "deviation-heading": 14.23951157909658, "agent_compute-ego0": 0.01491167324965046, "agent_compute-ego1": 0.01141267712169841, "agent_compute-ego2": 0.01119448580809378, "agent_compute-ego3": 0.011465797813409177, "complete-iteration": 1.0910568243260188, "set_robot_commands": 0.002166720254534389, "deviation-center-line": 1.680552125281341, "driven_lanedir_consec": 0.8005067941000679, "sim_compute_sim_state": 0.018609787800429167, "sim_compute_performance-ego0": 0.001889708040159608, "sim_compute_performance-ego1": 0.001886883345769903, "sim_compute_performance-ego2": 0.0018602449828440896, "sim_compute_performance-ego3": 0.0018350444765114764}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 7.954868950638018, "get_ui_image": 0.0435593461712433, "step_physics": 0.9258994669044742, "survival_time": 59.99999999999873, "driven_lanedir": 1.029443463523104, "get_state_dump": 0.009334424850247882, "get_robot_state": 0.01382077564109275, "sim_render-ego0": 0.0038010190666764106, "sim_render-ego1": 0.003537334867758517, "sim_render-ego2": 0.003628192396584796, "sim_render-ego3": 0.0035767356720097752, "get_duckie_state": 1.33105459856451e-06, "in-drivable-lane": 50.24999999999869, "deviation-heading": 8.9831393501878, "agent_compute-ego0": 0.01491167324965046, "agent_compute-ego1": 0.01141267712169841, "agent_compute-ego2": 0.01119448580809378, "agent_compute-ego3": 0.011465797813409177, "complete-iteration": 1.0910568243260188, "set_robot_commands": 0.002166720254534389, "deviation-center-line": 0.8368336949413437, "driven_lanedir_consec": 0.6870561763513174, "sim_compute_sim_state": 0.018609787800429167, "sim_compute_performance-ego0": 0.001889708040159608, "sim_compute_performance-ego1": 0.001886883345769903, "sim_compute_performance-ego2": 0.0018602449828440896, "sim_compute_performance-ego3": 0.0018350444765114764}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 3.834215122239704, "get_ui_image": 0.0435593461712433, "step_physics": 0.9258994669044742, "survival_time": 59.99999999999873, "driven_lanedir": 0.9219489366761884, "get_state_dump": 0.009334424850247882, "get_robot_state": 0.01382077564109275, "sim_render-ego0": 0.0038010190666764106, "sim_render-ego1": 0.003537334867758517, "sim_render-ego2": 0.003628192396584796, "sim_render-ego3": 0.0035767356720097752, "get_duckie_state": 1.33105459856451e-06, "in-drivable-lane": 54.8499999999987, "deviation-heading": 2.6488211517159796, "agent_compute-ego0": 0.01491167324965046, "agent_compute-ego1": 0.01141267712169841, "agent_compute-ego2": 0.01119448580809378, "agent_compute-ego3": 0.011465797813409177, "complete-iteration": 1.0910568243260188, "set_robot_commands": 0.002166720254534389, "deviation-center-line": 0.49885710215880674, "driven_lanedir_consec": 0.9219489366761884, "sim_compute_sim_state": 0.018609787800429167, "sim_compute_performance-ego0": 0.001889708040159608, "sim_compute_performance-ego1": 0.001886883345769903, "sim_compute_performance-ego2": 0.0018602449828440896, "sim_compute_performance-ego3": 0.0018350444765114764}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 0.8100402168737983, "get_ui_image": 0.05070119495693591, "step_physics": 1.120631117507083, "survival_time": 59.99999999999873, "driven_lanedir": 0.3424422480073219, "get_state_dump": 0.009342918189538706, "get_robot_state": 0.014225606219556111, "sim_render-ego0": 0.003732632240784555, "sim_render-ego1": 0.003659306914482783, "sim_render-ego2": 0.00366498488966968, "sim_render-ego3": 0.0036796211303024864, "get_duckie_state": 1.3276798143474189e-06, "in-drivable-lane": 55.14999999999874, "deviation-heading": 3.4043970129579253, "agent_compute-ego0": 0.012877854379785746, "agent_compute-ego1": 0.012474702061661872, "agent_compute-ego2": 0.01233591763403493, "agent_compute-ego3": 0.012176437639971756, "complete-iteration": 1.303675835575291, "set_robot_commands": 0.0022690826212734506, "deviation-center-line": 0.3134446591074457, "driven_lanedir_consec": 0.3424422480073219, "sim_compute_sim_state": 0.027235567718620204, "sim_compute_performance-ego0": 0.0019336058436385003, "sim_compute_performance-ego1": 0.0019410911150320087, "sim_compute_performance-ego2": 0.0019406567604515971, "sim_compute_performance-ego3": 0.0019327260175414328}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 8.975573738406133, "get_ui_image": 0.05070119495693591, "step_physics": 1.120631117507083, "survival_time": 59.99999999999873, "driven_lanedir": 1.194415638290458, "get_state_dump": 0.009342918189538706, "get_robot_state": 0.014225606219556111, "sim_render-ego0": 0.003732632240784555, "sim_render-ego1": 0.003659306914482783, "sim_render-ego2": 0.00366498488966968, "sim_render-ego3": 0.0036796211303024864, "get_duckie_state": 1.3276798143474189e-06, "in-drivable-lane": 48.3499999999987, "deviation-heading": 7.890734283372645, "agent_compute-ego0": 0.012877854379785746, "agent_compute-ego1": 0.012474702061661872, "agent_compute-ego2": 0.01233591763403493, "agent_compute-ego3": 0.012176437639971756, "complete-iteration": 1.303675835575291, "set_robot_commands": 0.0022690826212734506, "deviation-center-line": 1.250815663741457, "driven_lanedir_consec": 1.194415638290458, "sim_compute_sim_state": 0.027235567718620204, "sim_compute_performance-ego0": 0.0019336058436385003, "sim_compute_performance-ego1": 0.0019410911150320087, "sim_compute_performance-ego2": 0.0019406567604515971, "sim_compute_performance-ego3": 0.0019327260175414328}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 11.775462645610958, "get_ui_image": 0.05070119495693591, "step_physics": 1.120631117507083, "survival_time": 59.99999999999873, "driven_lanedir": 1.6576682549140411, "get_state_dump": 0.009342918189538706, "get_robot_state": 0.014225606219556111, "sim_render-ego0": 0.003732632240784555, "sim_render-ego1": 0.003659306914482783, "sim_render-ego2": 0.00366498488966968, "sim_render-ego3": 0.0036796211303024864, "get_duckie_state": 1.3276798143474189e-06, "in-drivable-lane": 44.149999999998954, "deviation-heading": 15.08953624515464, "agent_compute-ego0": 0.012877854379785746, "agent_compute-ego1": 0.012474702061661872, "agent_compute-ego2": 0.01233591763403493, "agent_compute-ego3": 0.012176437639971756, "complete-iteration": 1.303675835575291, "set_robot_commands": 0.0022690826212734506, "deviation-center-line": 1.5187342935996018, "driven_lanedir_consec": 1.5670746727645657, "sim_compute_sim_state": 0.027235567718620204, "sim_compute_performance-ego0": 0.0019336058436385003, "sim_compute_performance-ego1": 0.0019410911150320087, "sim_compute_performance-ego2": 0.0019406567604515971, "sim_compute_performance-ego3": 0.0019327260175414328}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 0.5957862294723684, "get_ui_image": 0.05070119495693591, "step_physics": 1.120631117507083, "survival_time": 59.99999999999873, "driven_lanedir": 0.29775120056439164, "get_state_dump": 0.009342918189538706, "get_robot_state": 0.014225606219556111, "sim_render-ego0": 0.003732632240784555, "sim_render-ego1": 0.003659306914482783, "sim_render-ego2": 0.00366498488966968, "sim_render-ego3": 0.0036796211303024864, "get_duckie_state": 1.3276798143474189e-06, "in-drivable-lane": 58.19999999999872, "deviation-heading": 0.7903205282751903, "agent_compute-ego0": 0.012877854379785746, "agent_compute-ego1": 0.012474702061661872, "agent_compute-ego2": 0.01233591763403493, "agent_compute-ego3": 0.012176437639971756, "complete-iteration": 1.303675835575291, "set_robot_commands": 0.0022690826212734506, "deviation-center-line": 0.08932871472392008, "driven_lanedir_consec": 0.29775120056439164, "sim_compute_sim_state": 0.027235567718620204, "sim_compute_performance-ego0": 0.0019336058436385003, "sim_compute_performance-ego1": 0.0019410911150320087, "sim_compute_performance-ego2": 0.0019406567604515971, "sim_compute_performance-ego3": 0.0019327260175414328}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.17384220550911303, "get_ui_image": 0.04648839524147612, "step_physics": 1.0526259122144968, "survival_time": 59.99999999999873, "driven_lanedir": 0.06868086921458616, "get_state_dump": 0.009317008978520504, "get_robot_state": 0.01391565313347174, "sim_render-ego0": 0.003681660294036484, "sim_render-ego1": 0.003589182273235845, "sim_render-ego2": 0.003590259424951253, "sim_render-ego3": 0.0035935512291799475, "get_duckie_state": 1.391800714472152e-06, "in-drivable-lane": 58.89999999999873, "deviation-heading": 0.9271971325356244, "agent_compute-ego0": 0.015692049815791732, "agent_compute-ego1": 0.012709016903155452, "agent_compute-ego2": 0.01132575578236957, "agent_compute-ego3": 0.01158225605827287, "complete-iteration": 1.229151197913088, "set_robot_commands": 0.0021590769638328328, "deviation-center-line": 0.07280774845102436, "driven_lanedir_consec": 0.06868086921458616, "sim_compute_sim_state": 0.024686598360885888, "sim_compute_performance-ego0": 0.001879967817358927, "sim_compute_performance-ego1": 0.0019096168848398223, "sim_compute_performance-ego2": 0.0018757245224977311, "sim_compute_performance-ego3": 0.0018585965000124}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 10.026442667965744, "get_ui_image": 0.04648839524147612, "step_physics": 1.0526259122144968, "survival_time": 59.99999999999873, "driven_lanedir": 2.5721680945111616, "get_state_dump": 0.009317008978520504, "get_robot_state": 0.01391565313347174, "sim_render-ego0": 0.003681660294036484, "sim_render-ego1": 0.003589182273235845, "sim_render-ego2": 0.003590259424951253, "sim_render-ego3": 0.0035935512291799475, "get_duckie_state": 1.391800714472152e-06, "in-drivable-lane": 37.14999999999904, "deviation-heading": 16.613547557195222, "agent_compute-ego0": 0.015692049815791732, "agent_compute-ego1": 0.012709016903155452, "agent_compute-ego2": 0.01132575578236957, "agent_compute-ego3": 0.01158225605827287, "complete-iteration": 1.229151197913088, "set_robot_commands": 0.0021590769638328328, "deviation-center-line": 1.886463674433613, "driven_lanedir_consec": 2.5721680945111616, "sim_compute_sim_state": 0.024686598360885888, "sim_compute_performance-ego0": 0.001879967817358927, "sim_compute_performance-ego1": 0.0019096168848398223, "sim_compute_performance-ego2": 0.0018757245224977311, "sim_compute_performance-ego3": 0.0018585965000124}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 12.548787111322453, "get_ui_image": 0.04648839524147612, "step_physics": 1.0526259122144968, "survival_time": 59.99999999999873, "driven_lanedir": 0.471346617486976, "get_state_dump": 0.009317008978520504, "get_robot_state": 0.01391565313347174, "sim_render-ego0": 0.003681660294036484, "sim_render-ego1": 0.003589182273235845, "sim_render-ego2": 0.003590259424951253, "sim_render-ego3": 0.0035935512291799475, "get_duckie_state": 1.391800714472152e-06, "in-drivable-lane": 55.19999999999894, "deviation-heading": 4.77415764018915, "agent_compute-ego0": 0.015692049815791732, "agent_compute-ego1": 0.012709016903155452, "agent_compute-ego2": 0.01132575578236957, "agent_compute-ego3": 0.01158225605827287, "complete-iteration": 1.229151197913088, "set_robot_commands": 0.0021590769638328328, "deviation-center-line": 0.4793068402319294, "driven_lanedir_consec": 0.40945839684824503, "sim_compute_sim_state": 0.024686598360885888, "sim_compute_performance-ego0": 0.001879967817358927, "sim_compute_performance-ego1": 0.0019096168848398223, "sim_compute_performance-ego2": 0.0018757245224977311, "sim_compute_performance-ego3": 0.0018585965000124}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 0.3882280886221076, "get_ui_image": 0.04648839524147612, "step_physics": 1.0526259122144968, "survival_time": 59.99999999999873, "driven_lanedir": 0.25482178191944405, "get_state_dump": 0.009317008978520504, "get_robot_state": 0.01391565313347174, "sim_render-ego0": 0.003681660294036484, "sim_render-ego1": 0.003589182273235845, "sim_render-ego2": 0.003590259424951253, "sim_render-ego3": 0.0035935512291799475, "get_duckie_state": 1.391800714472152e-06, "in-drivable-lane": 58.04999999999873, "deviation-heading": 1.096182249417187, "agent_compute-ego0": 0.015692049815791732, "agent_compute-ego1": 0.012709016903155452, "agent_compute-ego2": 0.01132575578236957, "agent_compute-ego3": 0.01158225605827287, "complete-iteration": 1.229151197913088, "set_robot_commands": 0.0021590769638328328, "deviation-center-line": 0.12324640462494246, "driven_lanedir_consec": 0.25482178191944405, "sim_compute_sim_state": 0.024686598360885888, "sim_compute_performance-ego0": 0.001879967817358927, "sim_compute_performance-ego1": 0.0019096168848398223, "sim_compute_performance-ego2": 0.0018757245224977311, "sim_compute_performance-ego3": 0.0018585965000124}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 5.793478314609561, "get_ui_image": 0.02980290721794846, "step_physics": 0.3225102944735385, "survival_time": 59.99999999999873, "driven_lanedir": 1.032553567048866, "get_state_dump": 0.00599497164615882, "get_robot_state": 0.007027882719714874, "sim_render-ego0": 0.003668829364443103, "sim_render-ego1": 0.003568086497094808, "get_duckie_state": 1.3513033038670571e-06, "in-drivable-lane": 42.34999999999868, "deviation-heading": 15.091593353333923, "agent_compute-ego0": 0.011634425259351136, "agent_compute-ego1": 0.010987574611476418, "complete-iteration": 0.4101242763017437, "set_robot_commands": 0.0022555681986177493, "deviation-center-line": 1.862639280109739, "driven_lanedir_consec": 1.0281547121182208, "sim_compute_sim_state": 0.006646283758768531, "sim_compute_performance-ego0": 0.0018970420418135032, "sim_compute_performance-ego1": 0.001859463621039474}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 0.29329872125077594, "get_ui_image": 0.02980290721794846, "step_physics": 0.3225102944735385, "survival_time": 59.99999999999873, "driven_lanedir": 0.10727181602780722, "get_state_dump": 0.00599497164615882, "get_robot_state": 0.007027882719714874, "sim_render-ego0": 0.003668829364443103, "sim_render-ego1": 0.003568086497094808, "get_duckie_state": 1.3513033038670571e-06, "in-drivable-lane": 58.99999999999873, "deviation-heading": 0.6182685772099469, "agent_compute-ego0": 0.011634425259351136, "agent_compute-ego1": 0.010987574611476418, "complete-iteration": 0.4101242763017437, "set_robot_commands": 0.0022555681986177493, "deviation-center-line": 0.07032012472510785, "driven_lanedir_consec": 0.10727181602780722, "sim_compute_sim_state": 0.006646283758768531, "sim_compute_performance-ego0": 0.0018970420418135032, "sim_compute_performance-ego1": 0.001859463621039474}}
set_robot_commands_max0.0022690826212734506
set_robot_commands_mean0.0022064754111284423
set_robot_commands_median0.002166720254534389
set_robot_commands_min0.0021590769638328328
sim_compute_performance-ego0_max0.0019336058436385003
sim_compute_performance-ego0_mean0.0019005150634467964
sim_compute_performance-ego0_median0.001889708040159608
sim_compute_performance-ego0_min0.001879967817358927
sim_compute_performance-ego1_max0.0019410911150320087
sim_compute_performance-ego1_mean0.001904949473188992
sim_compute_performance-ego1_median0.0019096168848398223
sim_compute_performance-ego1_min0.001859463621039474
sim_compute_performance-ego2_max0.0019406567604515971
sim_compute_performance-ego2_mean0.0018922087552644727
sim_compute_performance-ego2_median0.0018757245224977311
sim_compute_performance-ego2_min0.0018602449828440896
sim_compute_performance-ego3_max0.0019327260175414328
sim_compute_performance-ego3_mean0.0018754556646884365
sim_compute_performance-ego3_median0.0018585965000124
sim_compute_performance-ego3_min0.0018350444765114764
sim_compute_sim_state_max0.027235567718620204
sim_compute_sim_state_mean0.021101455931234147
sim_compute_sim_state_median0.024686598360885888
sim_compute_sim_state_min0.006646283758768531
sim_render-ego0_max0.0038010190666764106
sim_render-ego0_mean0.003728493223919715
sim_render-ego0_median0.003732632240784555
sim_render-ego0_min0.003668829364443103
sim_render-ego1_max0.003659306914482783
sim_render-ego1_mean0.0035913906582927288
sim_render-ego1_median0.003589182273235845
sim_render-ego1_min0.003537334867758517
sim_render-ego2_max0.00366498488966968
sim_render-ego2_mean0.003627812237068576
sim_render-ego2_median0.003628192396584796
sim_render-ego2_min0.003590259424951253
sim_render-ego3_max0.0036796211303024864
sim_render-ego3_mean0.003616636010497403
sim_render-ego3_median0.0035935512291799475
sim_render-ego3_min0.0035767356720097752
simulation-passed1
step_physics_max1.120631117507083
step_physics_mean0.9315461839608068
step_physics_median1.0526259122144968
step_physics_min0.3225102944735385
survival_time_max59.99999999999873
survival_time_mean59.999999999998735
survival_time_min59.99999999999873
No reset possible
53869LFVmultibodyv-simtimeoutyes----No reset possible