Duckietown Challenges Home Challenges Submissions

Submission 13231

Submission13231
Competingyes
Challengeaido5-LFV_multi-sim-validation
UserAndras Beres
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 61707
Next
User label212-1-real
Admin priority50
Blessingn/a
User priority50

61707

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
61707LFVmultibodyv-simsuccessyes0:43:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.276064476275375
survival_time_median17.25000000000011
deviation-center-line_median1.3669315471290404
in-drivable-lane_median1.124999999999996


other stats
agent_compute-ego0_max0.016161302096164065
agent_compute-ego0_mean0.01502180952857102
agent_compute-ego0_median0.014742000254592456
agent_compute-ego0_min0.014318608102344333
agent_compute-ego1_max0.015208922899686374
agent_compute-ego1_mean0.01459675829744444
agent_compute-ego1_median0.014565278339937242
agent_compute-ego1_min0.014139520270483834
agent_compute-ego2_max0.014991950125715851
agent_compute-ego2_mean0.014789506847099648
agent_compute-ego2_median0.014743949636558578
agent_compute-ego2_min0.0146326207790245
agent_compute-ego3_max0.015524813492373644
agent_compute-ego3_mean0.014576359625980327
agent_compute-ego3_median0.014182666822665
agent_compute-ego3_min0.014021598562902334
complete-iteration_max1.3974400600256949
complete-iteration_mean1.149751503776002
complete-iteration_median1.347069789920997
complete-iteration_min0.3649879381770179
deviation-center-line_max3.019144637103232
deviation-center-line_mean1.5995432067719253
deviation-center-line_min0.505244757784758
deviation-heading_max11.992751403559073
deviation-heading_mean3.1347185501358372
deviation-heading_median2.308341046723795
deviation-heading_min0.49878271378667505
driven_any_max9.686925644693796
driven_any_mean3.623179682002756
driven_any_median3.223994023673591
driven_any_min0.6671615960244043
driven_lanedir_consec_max7.623171197781492
driven_lanedir_consec_mean2.848205708322193
driven_lanedir_consec_min0.6474961532137566
driven_lanedir_max7.623171197781492
driven_lanedir_mean2.848205708322193
driven_lanedir_median2.276064476275375
driven_lanedir_min0.6474961532137566
get_duckie_state_max1.196147633247635e-06
get_duckie_state_mean1.1837327326339122e-06
get_duckie_state_median1.192632304057816e-06
get_duckie_state_min1.1381648835681731e-06
get_robot_state_max0.013970537962417255
get_robot_state_mean0.012907375909734734
get_robot_state_median0.013882580520100676
get_robot_state_min0.006912180355616978
get_state_dump_max0.009485895277687869
get_state_dump_mean0.008940680261054103
get_state_dump_median0.009389402549390849
get_state_dump_min0.006066591966719855
get_ui_image_max0.05053036892575915
get_ui_image_mean0.04497538238621973
get_ui_image_median0.047909261863355694
get_ui_image_min0.02982361117998759
in-drivable-lane_max4.050000000000032
in-drivable-lane_mean1.510714285714291
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 0.9811439107654668, "get_ui_image": 0.044062401972660405, "step_physics": 0.9251066973420228, "survival_time": 14.650000000000071, "driven_lanedir": 0.965677708403674, "get_state_dump": 0.009383787103250723, "get_robot_state": 0.013866607023745169, "sim_render-ego0": 0.003625281814004288, "sim_render-ego1": 0.003581240063621884, "sim_render-ego2": 0.0035912463454162184, "sim_render-ego3": 0.0035664848729866703, "get_duckie_state": 1.196147633247635e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.218689802469321, "agent_compute-ego0": 0.014513726948069875, "agent_compute-ego1": 0.014244692666190013, "agent_compute-ego2": 0.0146326207790245, "agent_compute-ego3": 0.014021598562902334, "complete-iteration": 1.0971264441808064, "set_robot_commands": 0.002086877822875977, "deviation-center-line": 2.249714287418461, "driven_lanedir_consec": 0.965677708403674, "sim_compute_sim_state": 0.01648475118234855, "sim_compute_performance-ego0": 0.001869871502830869, "sim_compute_performance-ego1": 0.0018941366753610625, "sim_compute_performance-ego2": 0.0018692146353170176, "sim_compute_performance-ego3": 0.001897345594808358}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.199715310453122, "get_ui_image": 0.044062401972660405, "step_physics": 0.9251066973420228, "survival_time": 14.650000000000071, "driven_lanedir": 2.3758433518488498, "get_state_dump": 0.009383787103250723, "get_robot_state": 0.013866607023745169, "sim_render-ego0": 0.003625281814004288, "sim_render-ego1": 0.003581240063621884, "sim_render-ego2": 0.0035912463454162184, "sim_render-ego3": 0.0035664848729866703, "get_duckie_state": 1.196147633247635e-06, "in-drivable-lane": 1.649999999999994, "deviation-heading": 0.7048091724528852, "agent_compute-ego0": 0.014513726948069875, "agent_compute-ego1": 0.014244692666190013, "agent_compute-ego2": 0.0146326207790245, "agent_compute-ego3": 0.014021598562902334, "complete-iteration": 1.0971264441808064, "set_robot_commands": 0.002086877822875977, "deviation-center-line": 1.0852442487691634, "driven_lanedir_consec": 2.3758433518488498, "sim_compute_sim_state": 0.01648475118234855, "sim_compute_performance-ego0": 0.001869871502830869, "sim_compute_performance-ego1": 0.0018941366753610625, "sim_compute_performance-ego2": 0.0018692146353170176, "sim_compute_performance-ego3": 0.001897345594808358}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.0523922139610025, "get_ui_image": 0.044062401972660405, "step_physics": 0.9251066973420228, "survival_time": 14.650000000000071, "driven_lanedir": 1.0322646694631592, "get_state_dump": 0.009383787103250723, "get_robot_state": 0.013866607023745169, "sim_render-ego0": 0.003625281814004288, "sim_render-ego1": 0.003581240063621884, "sim_render-ego2": 0.0035912463454162184, "sim_render-ego3": 0.0035664848729866703, "get_duckie_state": 1.196147633247635e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.237544280990635, "agent_compute-ego0": 0.014513726948069875, "agent_compute-ego1": 0.014244692666190013, "agent_compute-ego2": 0.0146326207790245, "agent_compute-ego3": 0.014021598562902334, "complete-iteration": 1.0971264441808064, "set_robot_commands": 0.002086877822875977, "deviation-center-line": 1.5699169350877178, "driven_lanedir_consec": 1.0322646694631592, "sim_compute_sim_state": 0.01648475118234855, "sim_compute_performance-ego0": 0.001869871502830869, "sim_compute_performance-ego1": 0.0018941366753610625, "sim_compute_performance-ego2": 0.0018692146353170176, "sim_compute_performance-ego3": 0.001897345594808358}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 6.578327388828051, "get_ui_image": 0.044062401972660405, "step_physics": 0.9251066973420228, "survival_time": 14.650000000000071, "driven_lanedir": 4.639934328229577, "get_state_dump": 0.009383787103250723, "get_robot_state": 0.013866607023745169, "sim_render-ego0": 0.003625281814004288, "sim_render-ego1": 0.003581240063621884, "sim_render-ego2": 0.0035912463454162184, "sim_render-ego3": 0.0035664848729866703, "get_duckie_state": 1.196147633247635e-06, "in-drivable-lane": 3.850000000000021, "deviation-heading": 1.928775146951344, "agent_compute-ego0": 0.014513726948069875, "agent_compute-ego1": 0.014244692666190013, "agent_compute-ego2": 0.0146326207790245, "agent_compute-ego3": 0.014021598562902334, "complete-iteration": 1.0971264441808064, "set_robot_commands": 0.002086877822875977, "deviation-center-line": 1.2850919256397686, "driven_lanedir_consec": 4.639934328229577, "sim_compute_sim_state": 0.01648475118234855, "sim_compute_performance-ego0": 0.001869871502830869, "sim_compute_performance-ego1": 0.0018941366753610625, "sim_compute_performance-ego2": 0.0018692146353170176, "sim_compute_performance-ego3": 0.001897345594808358}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 1.915186386986437, "get_ui_image": 0.05053036892575915, "step_physics": 1.15592360118935, "survival_time": 22.05000000000018, "driven_lanedir": 1.614586082878829, "get_state_dump": 0.009485895277687869, "get_robot_state": 0.013970537962417255, "sim_render-ego0": 0.0037447402919579416, "sim_render-ego1": 0.0036468624529256, "sim_render-ego2": 0.003639336085427401, "sim_render-ego3": 0.00364539687989524, "get_duckie_state": 1.192632304057816e-06, "in-drivable-lane": 0.5999999999999979, "deviation-heading": 11.992751403559073, "agent_compute-ego0": 0.016161302096164065, "agent_compute-ego1": 0.015208922899686374, "agent_compute-ego2": 0.014991950125715851, "agent_compute-ego3": 0.015524813492373644, "complete-iteration": 1.347069789920997, "set_robot_commands": 0.0022501578697791467, "deviation-center-line": 1.1202467086956032, "driven_lanedir_consec": 1.614586082878829, "sim_compute_sim_state": 0.02386785200818092, "sim_compute_performance-ego0": 0.0019260806735284727, "sim_compute_performance-ego1": 0.0019505374571856331, "sim_compute_performance-ego2": 0.0019188968304595256, "sim_compute_performance-ego3": 0.00191952955668868}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 6.317892959996211, "get_ui_image": 0.05053036892575915, "step_physics": 1.15592360118935, "survival_time": 22.05000000000018, "driven_lanedir": 5.296976653167243, "get_state_dump": 0.009485895277687869, "get_robot_state": 0.013970537962417255, "sim_render-ego0": 0.0037447402919579416, "sim_render-ego1": 0.0036468624529256, "sim_render-ego2": 0.003639336085427401, "sim_render-ego3": 0.00364539687989524, "get_duckie_state": 1.192632304057816e-06, "in-drivable-lane": 1.9000000000000163, "deviation-heading": 5.168936622558168, "agent_compute-ego0": 0.016161302096164065, "agent_compute-ego1": 0.015208922899686374, "agent_compute-ego2": 0.014991950125715851, "agent_compute-ego3": 0.015524813492373644, "complete-iteration": 1.347069789920997, "set_robot_commands": 0.0022501578697791467, "deviation-center-line": 1.3751861434907529, "driven_lanedir_consec": 5.296976653167243, "sim_compute_sim_state": 0.02386785200818092, "sim_compute_performance-ego0": 0.0019260806735284727, "sim_compute_performance-ego1": 0.0019505374571856331, "sim_compute_performance-ego2": 0.0019188968304595256, "sim_compute_performance-ego3": 0.00191952955668868}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 9.686925644693796, "get_ui_image": 0.05053036892575915, "step_physics": 1.15592360118935, "survival_time": 22.05000000000018, "driven_lanedir": 7.623171197781492, "get_state_dump": 0.009485895277687869, "get_robot_state": 0.013970537962417255, "sim_render-ego0": 0.0037447402919579416, "sim_render-ego1": 0.0036468624529256, "sim_render-ego2": 0.003639336085427401, "sim_render-ego3": 0.00364539687989524, "get_duckie_state": 1.192632304057816e-06, "in-drivable-lane": 4.050000000000032, "deviation-heading": 4.373137111446241, "agent_compute-ego0": 0.016161302096164065, "agent_compute-ego1": 0.015208922899686374, "agent_compute-ego2": 0.014991950125715851, "agent_compute-ego3": 0.015524813492373644, "complete-iteration": 1.347069789920997, "set_robot_commands": 0.0022501578697791467, "deviation-center-line": 1.6332709209876293, "driven_lanedir_consec": 7.623171197781492, "sim_compute_sim_state": 0.02386785200818092, "sim_compute_performance-ego0": 0.0019260806735284727, "sim_compute_performance-ego1": 0.0019505374571856331, "sim_compute_performance-ego2": 0.0019188968304595256, "sim_compute_performance-ego3": 0.00191952955668868}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 1.9088821330177923, "get_ui_image": 0.05053036892575915, "step_physics": 1.15592360118935, "survival_time": 22.05000000000018, "driven_lanedir": 1.5597723140704245, "get_state_dump": 0.009485895277687869, "get_robot_state": 0.013970537962417255, "sim_render-ego0": 0.0037447402919579416, "sim_render-ego1": 0.0036468624529256, "sim_render-ego2": 0.003639336085427401, "sim_render-ego3": 0.00364539687989524, "get_duckie_state": 1.192632304057816e-06, "in-drivable-lane": 0.5999999999999979, "deviation-heading": 1.611308588315468, "agent_compute-ego0": 0.016161302096164065, "agent_compute-ego1": 0.015208922899686374, "agent_compute-ego2": 0.014991950125715851, "agent_compute-ego3": 0.015524813492373644, "complete-iteration": 1.347069789920997, "set_robot_commands": 0.0022501578697791467, "deviation-center-line": 3.019144637103232, "driven_lanedir_consec": 1.5597723140704245, "sim_compute_sim_state": 0.02386785200818092, "sim_compute_performance-ego0": 0.0019260806735284727, "sim_compute_performance-ego1": 0.0019505374571856331, "sim_compute_performance-ego2": 0.0019188968304595256, "sim_compute_performance-ego3": 0.00191952955668868}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.6671615960244043, "get_ui_image": 0.047909261863355694, "step_physics": 1.2200541620309642, "survival_time": 17.25000000000011, "driven_lanedir": 0.6474961532137566, "get_state_dump": 0.009389402549390849, "get_robot_state": 0.013882580520100676, "sim_render-ego0": 0.0036274050012489274, "sim_render-ego1": 0.003574061255923585, "sim_render-ego2": 0.003557072898556042, "sim_render-ego3": 0.0035479385728780935, "get_duckie_state": 1.1852021851291546e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.9675669246268923, "agent_compute-ego0": 0.014742000254592456, "agent_compute-ego1": 0.014565278339937242, "agent_compute-ego2": 0.014743949636558578, "agent_compute-ego3": 0.014182666822665, "complete-iteration": 1.3974400600256949, "set_robot_commands": 0.0021587362179177343, "deviation-center-line": 2.5852477225493793, "driven_lanedir_consec": 0.6474961532137566, "sim_compute_sim_state": 0.017061259705207252, "sim_compute_performance-ego0": 0.0018833069443013628, "sim_compute_performance-ego1": 0.0019174097590363784, "sim_compute_performance-ego2": 0.001864165239940489, "sim_compute_performance-ego3": 0.0019123533557605192}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 7.3744418974010735, "get_ui_image": 0.047909261863355694, "step_physics": 1.2200541620309642, "survival_time": 17.25000000000011, "driven_lanedir": 5.703633940518879, "get_state_dump": 0.009389402549390849, "get_robot_state": 0.013882580520100676, "sim_render-ego0": 0.0036274050012489274, "sim_render-ego1": 0.003574061255923585, "sim_render-ego2": 0.003557072898556042, "sim_render-ego3": 0.0035479385728780935, "get_duckie_state": 1.1852021851291546e-06, "in-drivable-lane": 3.0000000000000293, "deviation-heading": 3.845642004607906, "agent_compute-ego0": 0.014742000254592456, "agent_compute-ego1": 0.014565278339937242, "agent_compute-ego2": 0.014743949636558578, "agent_compute-ego3": 0.014182666822665, "complete-iteration": 1.3974400600256949, "set_robot_commands": 0.0021587362179177343, "deviation-center-line": 1.18018105790636, "driven_lanedir_consec": 5.703633940518879, "sim_compute_sim_state": 0.017061259705207252, "sim_compute_performance-ego0": 0.0018833069443013628, "sim_compute_performance-ego1": 0.0019174097590363784, "sim_compute_performance-ego2": 0.001864165239940489, "sim_compute_performance-ego3": 0.0019123533557605192}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 0.779690133168336, "get_ui_image": 0.047909261863355694, "step_physics": 1.2200541620309642, "survival_time": 17.25000000000011, "driven_lanedir": 0.7752833606017766, "get_state_dump": 0.009389402549390849, "get_robot_state": 0.013882580520100676, "sim_render-ego0": 0.0036274050012489274, "sim_render-ego1": 0.003574061255923585, "sim_render-ego2": 0.003557072898556042, "sim_render-ego3": 0.0035479385728780935, "get_duckie_state": 1.1852021851291546e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.49878271378667505, "agent_compute-ego0": 0.014742000254592456, "agent_compute-ego1": 0.014565278339937242, "agent_compute-ego2": 0.014743949636558578, "agent_compute-ego3": 0.014182666822665, "complete-iteration": 1.3974400600256949, "set_robot_commands": 0.0021587362179177343, "deviation-center-line": 2.791656192169441, "driven_lanedir_consec": 0.7752833606017766, "sim_compute_sim_state": 0.017061259705207252, "sim_compute_performance-ego0": 0.0018833069443013628, "sim_compute_performance-ego1": 0.0019174097590363784, "sim_compute_performance-ego2": 0.001864165239940489, "sim_compute_performance-ego3": 0.0019123533557605192}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 3.4634630763626353, "get_ui_image": 0.047909261863355694, "step_physics": 1.2200541620309642, "survival_time": 17.25000000000011, "driven_lanedir": 2.1762856007019016, "get_state_dump": 0.009389402549390849, "get_robot_state": 0.013882580520100676, "sim_render-ego0": 0.0036274050012489274, "sim_render-ego1": 0.003574061255923585, "sim_render-ego2": 0.003557072898556042, "sim_render-ego3": 0.0035479385728780935, "get_duckie_state": 1.1852021851291546e-06, "in-drivable-lane": 2.5999999999999908, "deviation-heading": 1.7377306447948062, "agent_compute-ego0": 0.014742000254592456, "agent_compute-ego1": 0.014565278339937242, "agent_compute-ego2": 0.014743949636558578, "agent_compute-ego3": 0.014182666822665, "complete-iteration": 1.3974400600256949, "set_robot_commands": 0.0021587362179177343, "deviation-center-line": 1.358676950767328, "driven_lanedir_consec": 2.1762856007019016, "sim_compute_sim_state": 0.017061259705207252, "sim_compute_performance-ego0": 0.0018833069443013628, "sim_compute_performance-ego1": 0.0019174097590363784, "sim_compute_performance-ego2": 0.001864165239940489, "sim_compute_performance-ego3": 0.0019123533557605192}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 3.5510201594861814, "get_ui_image": 0.02982361117998759, "step_physics": 0.2685289822873615, "survival_time": 8.349999999999984, "driven_lanedir": 2.4152804116800493, "get_state_dump": 0.006066591966719855, "get_robot_state": 0.006912180355616978, "sim_render-ego0": 0.003645523673012143, "sim_render-ego1": 0.0035768960203443256, "get_duckie_state": 1.1381648835681731e-06, "in-drivable-lane": 2.899999999999995, "deviation-heading": 0.9512701165216136, "agent_compute-ego0": 0.014318608102344333, "agent_compute-ego1": 0.014139520270483834, "complete-iteration": 0.3649879381770179, "set_robot_commands": 0.002164978356588454, "deviation-center-line": 0.505244757784758, "driven_lanedir_consec": 2.4152804116800493, "sim_compute_sim_state": 0.009722190243857247, "sim_compute_performance-ego0": 0.001895058722723098, "sim_compute_performance-ego1": 0.0018937956719171432}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 3.2482727368940596, "get_ui_image": 0.02982361117998759, "step_physics": 0.2685289822873615, "survival_time": 8.349999999999984, "driven_lanedir": 3.04867414395109, "get_state_dump": 0.006066591966719855, "get_robot_state": 0.006912180355616978, "sim_render-ego0": 0.003645523673012143, "sim_render-ego1": 0.0035768960203443256, "get_duckie_state": 1.1381648835681731e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.649115168820698, "agent_compute-ego0": 0.014318608102344333, "agent_compute-ego1": 0.014139520270483834, "complete-iteration": 0.3649879381770179, "set_robot_commands": 0.002164978356588454, "deviation-center-line": 0.6347824064373597, "driven_lanedir_consec": 3.04867414395109, "sim_compute_sim_state": 0.009722190243857247, "sim_compute_performance-ego0": 0.001895058722723098, "sim_compute_performance-ego1": 0.0018937956719171432}}
set_robot_commands_max0.0022501578697791467
set_robot_commands_mean0.0021652174539620243
set_robot_commands_median0.0021587362179177343
set_robot_commands_min0.002086877822875977
sim_compute_performance-ego0_max0.0019260806735284727
sim_compute_performance-ego0_mean0.001893368137720644
sim_compute_performance-ego0_median0.0018833069443013628
sim_compute_performance-ego0_min0.001869871502830869
sim_compute_performance-ego1_max0.0019505374571856331
sim_compute_performance-ego1_mean0.001916851922154756
sim_compute_performance-ego1_median0.0019174097590363784
sim_compute_performance-ego1_min0.0018937956719171432
sim_compute_performance-ego2_max0.0019188968304595256
sim_compute_performance-ego2_mean0.0018840922352390108
sim_compute_performance-ego2_median0.0018692146353170176
sim_compute_performance-ego2_min0.001864165239940489
sim_compute_performance-ego3_max0.00191952955668868
sim_compute_performance-ego3_mean0.0019097428357525191
sim_compute_performance-ego3_median0.0019123533557605192
sim_compute_performance-ego3_min0.001897345594808358
sim_compute_sim_state_max0.02386785200818092
sim_compute_sim_state_mean0.01779284514790438
sim_compute_sim_state_median0.017061259705207252
sim_compute_sim_state_min0.009722190243857247
sim_render-ego0_max0.0037447402919579416
sim_render-ego0_mean0.0036629111267763503
sim_render-ego0_median0.0036274050012489274
sim_render-ego0_min0.003625281814004288
sim_render-ego1_max0.0036468624529256
sim_render-ego1_mean0.003597317652183781
sim_render-ego1_median0.003581240063621884
sim_render-ego1_min0.003574061255923585
sim_render-ego2_max0.003639336085427401
sim_render-ego2_mean0.0035958851097998876
sim_render-ego2_median0.0035912463454162184
sim_render-ego2_min0.003557072898556042
sim_render-ego3_max0.00364539687989524
sim_render-ego3_mean0.0035866067752533346
sim_render-ego3_median0.0035664848729866703
sim_render-ego3_min0.0035479385728780935
simulation-passed1
step_physics_max1.2200541620309642
step_physics_mean0.981528271916005
step_physics_median1.15592360118935
step_physics_min0.2685289822873615
survival_time_max22.05000000000018
survival_time_mean16.607142857142957
survival_time_min8.349999999999984
No reset possible