Duckietown Challenges Home Challenges Submissions

Submission 12644

Submission12644
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 53969
Next
User labeltemplate-pytorch
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
53969LFVmultibodyv-simsuccessyes2:10:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5482572865997812
survival_time_median59.99999999999873
deviation-center-line_median0.48908197119536806
in-drivable-lane_median54.99999999999872


other stats
agent_compute-ego0_max0.015692049815791732
agent_compute-ego0_mean0.01408536859282957
agent_compute-ego0_median0.01491167324965046
agent_compute-ego0_min0.011634425259351136
agent_compute-ego1_max0.012709016903155452
agent_compute-ego1_mean0.012025766683501127
agent_compute-ego1_median0.012474702061661872
agent_compute-ego1_min0.010987574611476418
agent_compute-ego2_max0.01233591763403493
agent_compute-ego2_mean0.011618719741499426
agent_compute-ego2_median0.01132575578236957
agent_compute-ego2_min0.01119448580809378
agent_compute-ego3_max0.012176437639971756
agent_compute-ego3_mean0.011741497170551266
agent_compute-ego3_median0.01158225605827287
agent_compute-ego3_min0.011465797813409177
complete-iteration_max1.303675835575291
complete-iteration_mean1.0939845702757915
complete-iteration_median1.229151197913088
complete-iteration_min0.4101242763017437
deviation-center-line_max1.886463674433613
deviation-center-line_mean0.7894874077094801
deviation-center-line_min0.07032012472510785
deviation-heading_max16.613547557195222
deviation-heading_mean6.776038452013834
deviation-heading_median4.089277326573538
deviation-heading_min0.6182685772099469
driven_any_max12.548787111322453
driven_any_mean5.263663435750637
driven_any_median4.8138467184246325
driven_any_min0.17384220550911303
driven_lanedir_consec_max2.5721680945111616
driven_lanedir_consec_mean0.7492611535118575
driven_lanedir_consec_min0.06868086921458616
driven_lanedir_max2.5721680945111616
driven_lanedir_mean0.8118556780556254
driven_lanedir_median0.6966477770815822
driven_lanedir_min0.06868086921458616
get_duckie_state_max1.391800714472152e-06
get_duckie_state_mean1.3503390798050311e-06
get_duckie_state_median1.33105459856451e-06
get_duckie_state_min1.3276798143474189e-06
get_robot_state_max0.014225606219556111
get_robot_state_mean0.012993136101136582
get_robot_state_median0.01391565313347174
get_robot_state_min0.007027882719714874
get_state_dump_max0.009342918189538706
get_state_dump_mean0.008854810811824715
get_state_dump_median0.009334424850247882
get_state_dump_min0.00599497164615882
get_ui_image_max0.05070119495693591
get_ui_image_mean0.04447153999389415
get_ui_image_median0.04648839524147612
get_ui_image_min0.02980290721794846
in-drivable-lane_max58.99999999999873
in-drivable-lane_mean51.62142857142736
in-drivable-lane_min37.14999999999904
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 0.7594283890537241, "get_ui_image": 0.0435593461712433, "step_physics": 0.9258994669044742, "survival_time": 59.99999999999873, "driven_lanedir": 0.23790481177222889, "get_state_dump": 0.009334424850247882, "get_robot_state": 0.01382077564109275, "sim_render-ego0": 0.0038010190666764106, "sim_render-ego1": 0.003537334867758517, "sim_render-ego2": 0.003628192396584796, "sim_render-ego3": 0.0035767356720097752, "get_duckie_state": 1.33105459856451e-06, "in-drivable-lane": 55.999999999998735, "deviation-heading": 2.6971316675518744, "agent_compute-ego0": 0.01491167324965046, "agent_compute-ego1": 0.01141267712169841, "agent_compute-ego2": 0.01119448580809378, "agent_compute-ego3": 0.011465797813409177, "complete-iteration": 1.0910568243260188, "set_robot_commands": 0.002166720254534389, "deviation-center-line": 0.3694733818024503, "driven_lanedir_consec": 0.23790481177222889, "sim_compute_sim_state": 0.018609787800429167, "sim_compute_performance-ego0": 0.001889708040159608, "sim_compute_performance-ego1": 0.001886883345769903, "sim_compute_performance-ego2": 0.0018602449828440896, "sim_compute_performance-ego3": 0.0018350444765114764}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 9.761835698934451, "get_ui_image": 0.0435593461712433, "step_physics": 0.9258994669044742, "survival_time": 59.99999999999873, "driven_lanedir": 1.177562192822179, "get_state_dump": 0.009334424850247882, "get_robot_state": 0.01382077564109275, "sim_render-ego0": 0.0038010190666764106, "sim_render-ego1": 0.003537334867758517, "sim_render-ego2": 0.003628192396584796, "sim_render-ego3": 0.0035767356720097752, "get_duckie_state": 1.33105459856451e-06, "in-drivable-lane": 45.0999999999989, "deviation-heading": 14.23951157909658, "agent_compute-ego0": 0.01491167324965046, "agent_compute-ego1": 0.01141267712169841, "agent_compute-ego2": 0.01119448580809378, "agent_compute-ego3": 0.011465797813409177, "complete-iteration": 1.0910568243260188, "set_robot_commands": 0.002166720254534389, "deviation-center-line": 1.680552125281341, "driven_lanedir_consec": 0.8005067941000679, "sim_compute_sim_state": 0.018609787800429167, "sim_compute_performance-ego0": 0.001889708040159608, "sim_compute_performance-ego1": 0.001886883345769903, "sim_compute_performance-ego2": 0.0018602449828440896, "sim_compute_performance-ego3": 0.0018350444765114764}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 7.954868950638018, "get_ui_image": 0.0435593461712433, "step_physics": 0.9258994669044742, "survival_time": 59.99999999999873, "driven_lanedir": 1.029443463523104, "get_state_dump": 0.009334424850247882, "get_robot_state": 0.01382077564109275, "sim_render-ego0": 0.0038010190666764106, "sim_render-ego1": 0.003537334867758517, "sim_render-ego2": 0.003628192396584796, "sim_render-ego3": 0.0035767356720097752, "get_duckie_state": 1.33105459856451e-06, "in-drivable-lane": 50.24999999999869, "deviation-heading": 8.9831393501878, "agent_compute-ego0": 0.01491167324965046, "agent_compute-ego1": 0.01141267712169841, "agent_compute-ego2": 0.01119448580809378, "agent_compute-ego3": 0.011465797813409177, "complete-iteration": 1.0910568243260188, "set_robot_commands": 0.002166720254534389, "deviation-center-line": 0.8368336949413437, "driven_lanedir_consec": 0.6870561763513174, "sim_compute_sim_state": 0.018609787800429167, "sim_compute_performance-ego0": 0.001889708040159608, "sim_compute_performance-ego1": 0.001886883345769903, "sim_compute_performance-ego2": 0.0018602449828440896, "sim_compute_performance-ego3": 0.0018350444765114764}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 3.834215122239704, "get_ui_image": 0.0435593461712433, "step_physics": 0.9258994669044742, "survival_time": 59.99999999999873, "driven_lanedir": 0.9219489366761884, "get_state_dump": 0.009334424850247882, "get_robot_state": 0.01382077564109275, "sim_render-ego0": 0.0038010190666764106, "sim_render-ego1": 0.003537334867758517, "sim_render-ego2": 0.003628192396584796, "sim_render-ego3": 0.0035767356720097752, "get_duckie_state": 1.33105459856451e-06, "in-drivable-lane": 54.8499999999987, "deviation-heading": 2.6488211517159796, "agent_compute-ego0": 0.01491167324965046, "agent_compute-ego1": 0.01141267712169841, "agent_compute-ego2": 0.01119448580809378, "agent_compute-ego3": 0.011465797813409177, "complete-iteration": 1.0910568243260188, "set_robot_commands": 0.002166720254534389, "deviation-center-line": 0.49885710215880674, "driven_lanedir_consec": 0.9219489366761884, "sim_compute_sim_state": 0.018609787800429167, "sim_compute_performance-ego0": 0.001889708040159608, "sim_compute_performance-ego1": 0.001886883345769903, "sim_compute_performance-ego2": 0.0018602449828440896, "sim_compute_performance-ego3": 0.0018350444765114764}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 0.8100402168737983, "get_ui_image": 0.05070119495693591, "step_physics": 1.120631117507083, "survival_time": 59.99999999999873, "driven_lanedir": 0.3424422480073219, "get_state_dump": 0.009342918189538706, "get_robot_state": 0.014225606219556111, "sim_render-ego0": 0.003732632240784555, "sim_render-ego1": 0.003659306914482783, "sim_render-ego2": 0.00366498488966968, "sim_render-ego3": 0.0036796211303024864, "get_duckie_state": 1.3276798143474189e-06, "in-drivable-lane": 55.14999999999874, "deviation-heading": 3.4043970129579253, "agent_compute-ego0": 0.012877854379785746, "agent_compute-ego1": 0.012474702061661872, "agent_compute-ego2": 0.01233591763403493, "agent_compute-ego3": 0.012176437639971756, "complete-iteration": 1.303675835575291, "set_robot_commands": 0.0022690826212734506, "deviation-center-line": 0.3134446591074457, "driven_lanedir_consec": 0.3424422480073219, "sim_compute_sim_state": 0.027235567718620204, "sim_compute_performance-ego0": 0.0019336058436385003, "sim_compute_performance-ego1": 0.0019410911150320087, "sim_compute_performance-ego2": 0.0019406567604515971, "sim_compute_performance-ego3": 0.0019327260175414328}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 8.975573738406133, "get_ui_image": 0.05070119495693591, "step_physics": 1.120631117507083, "survival_time": 59.99999999999873, "driven_lanedir": 1.194415638290458, "get_state_dump": 0.009342918189538706, "get_robot_state": 0.014225606219556111, "sim_render-ego0": 0.003732632240784555, "sim_render-ego1": 0.003659306914482783, "sim_render-ego2": 0.00366498488966968, "sim_render-ego3": 0.0036796211303024864, "get_duckie_state": 1.3276798143474189e-06, "in-drivable-lane": 48.3499999999987, "deviation-heading": 7.890734283372645, "agent_compute-ego0": 0.012877854379785746, "agent_compute-ego1": 0.012474702061661872, "agent_compute-ego2": 0.01233591763403493, "agent_compute-ego3": 0.012176437639971756, "complete-iteration": 1.303675835575291, "set_robot_commands": 0.0022690826212734506, "deviation-center-line": 1.250815663741457, "driven_lanedir_consec": 1.194415638290458, "sim_compute_sim_state": 0.027235567718620204, "sim_compute_performance-ego0": 0.0019336058436385003, "sim_compute_performance-ego1": 0.0019410911150320087, "sim_compute_performance-ego2": 0.0019406567604515971, "sim_compute_performance-ego3": 0.0019327260175414328}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 11.775462645610958, "get_ui_image": 0.05070119495693591, "step_physics": 1.120631117507083, "survival_time": 59.99999999999873, "driven_lanedir": 1.6576682549140411, "get_state_dump": 0.009342918189538706, "get_robot_state": 0.014225606219556111, "sim_render-ego0": 0.003732632240784555, "sim_render-ego1": 0.003659306914482783, "sim_render-ego2": 0.00366498488966968, "sim_render-ego3": 0.0036796211303024864, "get_duckie_state": 1.3276798143474189e-06, "in-drivable-lane": 44.149999999998954, "deviation-heading": 15.08953624515464, "agent_compute-ego0": 0.012877854379785746, "agent_compute-ego1": 0.012474702061661872, "agent_compute-ego2": 0.01233591763403493, "agent_compute-ego3": 0.012176437639971756, "complete-iteration": 1.303675835575291, "set_robot_commands": 0.0022690826212734506, "deviation-center-line": 1.5187342935996018, "driven_lanedir_consec": 1.5670746727645657, "sim_compute_sim_state": 0.027235567718620204, "sim_compute_performance-ego0": 0.0019336058436385003, "sim_compute_performance-ego1": 0.0019410911150320087, "sim_compute_performance-ego2": 0.0019406567604515971, "sim_compute_performance-ego3": 0.0019327260175414328}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 0.5957862294723684, "get_ui_image": 0.05070119495693591, "step_physics": 1.120631117507083, "survival_time": 59.99999999999873, "driven_lanedir": 0.29775120056439164, "get_state_dump": 0.009342918189538706, "get_robot_state": 0.014225606219556111, "sim_render-ego0": 0.003732632240784555, "sim_render-ego1": 0.003659306914482783, "sim_render-ego2": 0.00366498488966968, "sim_render-ego3": 0.0036796211303024864, "get_duckie_state": 1.3276798143474189e-06, "in-drivable-lane": 58.19999999999872, "deviation-heading": 0.7903205282751903, "agent_compute-ego0": 0.012877854379785746, "agent_compute-ego1": 0.012474702061661872, "agent_compute-ego2": 0.01233591763403493, "agent_compute-ego3": 0.012176437639971756, "complete-iteration": 1.303675835575291, "set_robot_commands": 0.0022690826212734506, "deviation-center-line": 0.08932871472392008, "driven_lanedir_consec": 0.29775120056439164, "sim_compute_sim_state": 0.027235567718620204, "sim_compute_performance-ego0": 0.0019336058436385003, "sim_compute_performance-ego1": 0.0019410911150320087, "sim_compute_performance-ego2": 0.0019406567604515971, "sim_compute_performance-ego3": 0.0019327260175414328}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.17384220550911303, "get_ui_image": 0.04648839524147612, "step_physics": 1.0526259122144968, "survival_time": 59.99999999999873, "driven_lanedir": 0.06868086921458616, "get_state_dump": 0.009317008978520504, "get_robot_state": 0.01391565313347174, "sim_render-ego0": 0.003681660294036484, "sim_render-ego1": 0.003589182273235845, "sim_render-ego2": 0.003590259424951253, "sim_render-ego3": 0.0035935512291799475, "get_duckie_state": 1.391800714472152e-06, "in-drivable-lane": 58.89999999999873, "deviation-heading": 0.9271971325356244, "agent_compute-ego0": 0.015692049815791732, "agent_compute-ego1": 0.012709016903155452, "agent_compute-ego2": 0.01132575578236957, "agent_compute-ego3": 0.01158225605827287, "complete-iteration": 1.229151197913088, "set_robot_commands": 0.0021590769638328328, "deviation-center-line": 0.07280774845102436, "driven_lanedir_consec": 0.06868086921458616, "sim_compute_sim_state": 0.024686598360885888, "sim_compute_performance-ego0": 0.001879967817358927, "sim_compute_performance-ego1": 0.0019096168848398223, "sim_compute_performance-ego2": 0.0018757245224977311, "sim_compute_performance-ego3": 0.0018585965000124}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 10.026442667965744, "get_ui_image": 0.04648839524147612, "step_physics": 1.0526259122144968, "survival_time": 59.99999999999873, "driven_lanedir": 2.5721680945111616, "get_state_dump": 0.009317008978520504, "get_robot_state": 0.01391565313347174, "sim_render-ego0": 0.003681660294036484, "sim_render-ego1": 0.003589182273235845, "sim_render-ego2": 0.003590259424951253, "sim_render-ego3": 0.0035935512291799475, "get_duckie_state": 1.391800714472152e-06, "in-drivable-lane": 37.14999999999904, "deviation-heading": 16.613547557195222, "agent_compute-ego0": 0.015692049815791732, "agent_compute-ego1": 0.012709016903155452, "agent_compute-ego2": 0.01132575578236957, "agent_compute-ego3": 0.01158225605827287, "complete-iteration": 1.229151197913088, "set_robot_commands": 0.0021590769638328328, "deviation-center-line": 1.886463674433613, "driven_lanedir_consec": 2.5721680945111616, "sim_compute_sim_state": 0.024686598360885888, "sim_compute_performance-ego0": 0.001879967817358927, "sim_compute_performance-ego1": 0.0019096168848398223, "sim_compute_performance-ego2": 0.0018757245224977311, "sim_compute_performance-ego3": 0.0018585965000124}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 12.548787111322453, "get_ui_image": 0.04648839524147612, "step_physics": 1.0526259122144968, "survival_time": 59.99999999999873, "driven_lanedir": 0.471346617486976, "get_state_dump": 0.009317008978520504, "get_robot_state": 0.01391565313347174, "sim_render-ego0": 0.003681660294036484, "sim_render-ego1": 0.003589182273235845, "sim_render-ego2": 0.003590259424951253, "sim_render-ego3": 0.0035935512291799475, "get_duckie_state": 1.391800714472152e-06, "in-drivable-lane": 55.19999999999894, "deviation-heading": 4.77415764018915, "agent_compute-ego0": 0.015692049815791732, "agent_compute-ego1": 0.012709016903155452, "agent_compute-ego2": 0.01132575578236957, "agent_compute-ego3": 0.01158225605827287, "complete-iteration": 1.229151197913088, "set_robot_commands": 0.0021590769638328328, "deviation-center-line": 0.4793068402319294, "driven_lanedir_consec": 0.40945839684824503, "sim_compute_sim_state": 0.024686598360885888, "sim_compute_performance-ego0": 0.001879967817358927, "sim_compute_performance-ego1": 0.0019096168848398223, "sim_compute_performance-ego2": 0.0018757245224977311, "sim_compute_performance-ego3": 0.0018585965000124}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 0.3882280886221076, "get_ui_image": 0.04648839524147612, "step_physics": 1.0526259122144968, "survival_time": 59.99999999999873, "driven_lanedir": 0.25482178191944405, "get_state_dump": 0.009317008978520504, "get_robot_state": 0.01391565313347174, "sim_render-ego0": 0.003681660294036484, "sim_render-ego1": 0.003589182273235845, "sim_render-ego2": 0.003590259424951253, "sim_render-ego3": 0.0035935512291799475, "get_duckie_state": 1.391800714472152e-06, "in-drivable-lane": 58.04999999999873, "deviation-heading": 1.096182249417187, "agent_compute-ego0": 0.015692049815791732, "agent_compute-ego1": 0.012709016903155452, "agent_compute-ego2": 0.01132575578236957, "agent_compute-ego3": 0.01158225605827287, "complete-iteration": 1.229151197913088, "set_robot_commands": 0.0021590769638328328, "deviation-center-line": 0.12324640462494246, "driven_lanedir_consec": 0.25482178191944405, "sim_compute_sim_state": 0.024686598360885888, "sim_compute_performance-ego0": 0.001879967817358927, "sim_compute_performance-ego1": 0.0019096168848398223, "sim_compute_performance-ego2": 0.0018757245224977311, "sim_compute_performance-ego3": 0.0018585965000124}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 5.793478314609561, "get_ui_image": 0.02980290721794846, "step_physics": 0.3225102944735385, "survival_time": 59.99999999999873, "driven_lanedir": 1.032553567048866, "get_state_dump": 0.00599497164615882, "get_robot_state": 0.007027882719714874, "sim_render-ego0": 0.003668829364443103, "sim_render-ego1": 0.003568086497094808, "get_duckie_state": 1.3513033038670571e-06, "in-drivable-lane": 42.34999999999868, "deviation-heading": 15.091593353333923, "agent_compute-ego0": 0.011634425259351136, "agent_compute-ego1": 0.010987574611476418, "complete-iteration": 0.4101242763017437, "set_robot_commands": 0.0022555681986177493, "deviation-center-line": 1.862639280109739, "driven_lanedir_consec": 1.0281547121182208, "sim_compute_sim_state": 0.006646283758768531, "sim_compute_performance-ego0": 0.0018970420418135032, "sim_compute_performance-ego1": 0.001859463621039474}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 0.29329872125077594, "get_ui_image": 0.02980290721794846, "step_physics": 0.3225102944735385, "survival_time": 59.99999999999873, "driven_lanedir": 0.10727181602780722, "get_state_dump": 0.00599497164615882, "get_robot_state": 0.007027882719714874, "sim_render-ego0": 0.003668829364443103, "sim_render-ego1": 0.003568086497094808, "get_duckie_state": 1.3513033038670571e-06, "in-drivable-lane": 58.99999999999873, "deviation-heading": 0.6182685772099469, "agent_compute-ego0": 0.011634425259351136, "agent_compute-ego1": 0.010987574611476418, "complete-iteration": 0.4101242763017437, "set_robot_commands": 0.0022555681986177493, "deviation-center-line": 0.07032012472510785, "driven_lanedir_consec": 0.10727181602780722, "sim_compute_sim_state": 0.006646283758768531, "sim_compute_performance-ego0": 0.0018970420418135032, "sim_compute_performance-ego1": 0.001859463621039474}}
set_robot_commands_max0.0022690826212734506
set_robot_commands_mean0.0022064754111284423
set_robot_commands_median0.002166720254534389
set_robot_commands_min0.0021590769638328328
sim_compute_performance-ego0_max0.0019336058436385003
sim_compute_performance-ego0_mean0.0019005150634467964
sim_compute_performance-ego0_median0.001889708040159608
sim_compute_performance-ego0_min0.001879967817358927
sim_compute_performance-ego1_max0.0019410911150320087
sim_compute_performance-ego1_mean0.001904949473188992
sim_compute_performance-ego1_median0.0019096168848398223
sim_compute_performance-ego1_min0.001859463621039474
sim_compute_performance-ego2_max0.0019406567604515971
sim_compute_performance-ego2_mean0.0018922087552644727
sim_compute_performance-ego2_median0.0018757245224977311
sim_compute_performance-ego2_min0.0018602449828440896
sim_compute_performance-ego3_max0.0019327260175414328
sim_compute_performance-ego3_mean0.0018754556646884365
sim_compute_performance-ego3_median0.0018585965000124
sim_compute_performance-ego3_min0.0018350444765114764
sim_compute_sim_state_max0.027235567718620204
sim_compute_sim_state_mean0.021101455931234147
sim_compute_sim_state_median0.024686598360885888
sim_compute_sim_state_min0.006646283758768531
sim_render-ego0_max0.0038010190666764106
sim_render-ego0_mean0.003728493223919715
sim_render-ego0_median0.003732632240784555
sim_render-ego0_min0.003668829364443103
sim_render-ego1_max0.003659306914482783
sim_render-ego1_mean0.0035913906582927288
sim_render-ego1_median0.003589182273235845
sim_render-ego1_min0.003537334867758517
sim_render-ego2_max0.00366498488966968
sim_render-ego2_mean0.003627812237068576
sim_render-ego2_median0.003628192396584796
sim_render-ego2_min0.003590259424951253
sim_render-ego3_max0.0036796211303024864
sim_render-ego3_mean0.003616636010497403
sim_render-ego3_median0.0035935512291799475
sim_render-ego3_min0.0035767356720097752
simulation-passed1
step_physics_max1.120631117507083
step_physics_mean0.9315461839608068
step_physics_median1.0526259122144968
step_physics_min0.3225102944735385
survival_time_max59.99999999999873
survival_time_mean59.999999999998735
survival_time_min59.99999999999873
No reset possible
53869LFVmultibodyv-simtimeoutyes----No reset possible