Duckietown Challenges Home Challenges Submissions

Evaluator 1297

ID1297
evaluatorip-172-31-25-98-2470
ownerI don't have one 😀
machineip-172-31-25-98
processip-172-31-25-98-2470
versiond-c:4.0.30;d-c-r:4.0.46;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success7 23233
# timeout1 23569
# failed
# error7 23159
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
237513763Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-validationstep1-simulationsuccessyesip-172-31-25-98-24700:30:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7479264288909717
survival_time_median10.95000000000002
deviation-center-line_median0.5886185081006583
in-drivable-lane_median2.050000000000007


other stats
agent_compute-ego_max0.2781982592173985
agent_compute-ego_mean0.24166401721068712
agent_compute-ego_median0.267357546488444
agent_compute-ego_min0.19478694200515748
deviation-center-line_max1.1625269770392834
deviation-center-line_mean0.6846893464445036
deviation-center-line_min0.2976927336903722
deviation-heading_max3.222975037541269
deviation-heading_mean2.004972189375123
deviation-heading_median1.96227188141608
deviation-heading_min1.0585869009074445
driven_any_max2.0182543223289313
driven_any_mean1.444799037751476
driven_any_median1.153925125671078
driven_any_min1.0035073036510953
driven_lanedir_consec_max1.9924894737943957
driven_lanedir_consec_mean1.1383679319739264
driven_lanedir_consec_min0.6223787010957684
driven_lanedir_max1.9924894737943957
driven_lanedir_mean1.2301825547668492
driven_lanedir_median0.8278499330827351
driven_lanedir_min0.6223787010957684
in-drivable-lane_max2.84999999999999
in-drivable-lane_mean1.4200000000000057
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.913020080806084, "sim_physics": 0.21249692837397255, "survival_time": 14.950000000000076, "driven_lanedir": 1.886423459506574, "sim_render-ego": 0.06776728789011638, "in-drivable-lane": 0, "agent_compute-ego": 0.267357546488444, "deviation-heading": 1.9983639888276192, "set_robot_commands": 0.10301228761672972, "deviation-center-line": 1.1625269770392834, "driven_lanedir_consec": 1.6093919993899573, "sim_compute_sim_state": 0.046784003575642906, "sim_compute_performance-ego": 0.07608541250228881, "sim_compute_robot_state-ego": 0.08201472997665406, "sim_compute_robot_state-npc0": 0.07287071386973064, "sim_compute_robot_state-npc1": 0.07391141653060913, "sim_compute_robot_state-npc2": 0.07544902801513671, "sim_compute_robot_state-npc3": 0.07530245383580526}, "udem1-1-0": {"driven_any": 1.0035073036510953, "sim_physics": 0.215740476335798, "survival_time": 7.699999999999981, "driven_lanedir": 0.6223787010957684, "sim_render-ego": 0.06769708534339805, "in-drivable-lane": 2.84999999999999, "agent_compute-ego": 0.2781982592173985, "deviation-heading": 1.0585869009074445, "set_robot_commands": 0.10906680992671422, "deviation-center-line": 0.2976927336903722, "driven_lanedir_consec": 0.6223787010957684, "sim_compute_sim_state": 0.04353408844440014, "sim_compute_performance-ego": 0.07556418164983972, "sim_compute_robot_state-ego": 0.0823798721486872, "sim_compute_robot_state-npc0": 0.07643300836736505, "sim_compute_robot_state-npc1": 0.07920088396443949, "sim_compute_robot_state-npc2": 0.07635842515276624, "sim_compute_robot_state-npc3": 0.07655263721168816}, "udem1-2-0": {"driven_any": 1.153925125671078, "sim_physics": 0.21577338444984565, "survival_time": 8.84999999999999, "driven_lanedir": 0.8278499330827351, "sim_render-ego": 0.06710114452124989, "in-drivable-lane": 2.050000000000007, "agent_compute-ego": 0.2688023626467602, "deviation-heading": 1.96227188141608, "set_robot_commands": 0.10445930998204118, "deviation-center-line": 0.5886185081006583, "driven_lanedir_consec": 0.7479264288909717, "sim_compute_sim_state": 0.04012203351252497, "sim_compute_performance-ego": 0.07370385072999082, "sim_compute_robot_state-ego": 0.07850259172040863, "sim_compute_robot_state-npc0": 0.07306319710898534, "sim_compute_robot_state-npc1": 0.07373806042859783, "sim_compute_robot_state-npc2": 0.07113763168033234, "sim_compute_robot_state-npc3": 0.07113845873687227}, "udem1-3-0": {"driven_any": 1.1352883563001914, "sim_physics": 0.15878873981841624, "survival_time": 10.95000000000002, "driven_lanedir": 0.8217712063547732, "sim_render-ego": 0.05028851391517953, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.19917497569567535, "deviation-heading": 3.222975037541269, "set_robot_commands": 0.07844100586355549, "deviation-center-line": 0.8186518837547767, "driven_lanedir_consec": 0.7196530566985391, "sim_compute_sim_state": 0.03177278771248038, "sim_compute_performance-ego": 0.05575924485785776, "sim_compute_robot_state-ego": 0.05833789855922194, "sim_compute_robot_state-npc0": 0.05860048995170419, "sim_compute_robot_state-npc1": 0.05834191357164078, "sim_compute_robot_state-npc2": 0.05556053549187368, "sim_compute_robot_state-npc3": 0.05475617217146643}, "udem1-4-0": {"driven_any": 2.0182543223289313, "sim_physics": 0.15415446281433107, "survival_time": 14.950000000000076, "driven_lanedir": 1.9924894737943957, "sim_render-ego": 0.05183819691340129, "in-drivable-lane": 0, "agent_compute-ego": 0.19478694200515748, "deviation-heading": 1.7826631381832037, "set_robot_commands": 0.07456193765004476, "deviation-center-line": 0.5559566296374276, "driven_lanedir_consec": 1.9924894737943957, "sim_compute_sim_state": 0.03163607676823934, "sim_compute_performance-ego": 0.055955603917439777, "sim_compute_robot_state-ego": 0.058884843190511064, "sim_compute_robot_state-npc0": 0.057220946153004965, "sim_compute_robot_state-npc1": 0.05628637870152791, "sim_compute_robot_state-npc2": 0.055389941533406574, "sim_compute_robot_state-npc3": 0.05555848757425944}}
set_robot_commands_max0.10906680992671422
set_robot_commands_mean0.09390827020781709
set_robot_commands_median0.10301228761672972
set_robot_commands_min0.07456193765004476
sim_compute_performance-ego_max0.07608541250228881
sim_compute_performance-ego_mean0.06741365873148338
sim_compute_performance-ego_median0.07370385072999082
sim_compute_performance-ego_min0.05575924485785776
sim_compute_robot_state-ego_max0.0823798721486872
sim_compute_robot_state-ego_mean0.07202398711909658
sim_compute_robot_state-ego_median0.07850259172040863
sim_compute_robot_state-ego_min0.05833789855922194
sim_compute_robot_state-npc0_max0.07643300836736505
sim_compute_robot_state-npc0_mean0.06763767109015803
sim_compute_robot_state-npc0_median0.07287071386973064
sim_compute_robot_state-npc0_min0.057220946153004965
sim_compute_robot_state-npc1_max0.07920088396443949
sim_compute_robot_state-npc1_mean0.06829573063936303
sim_compute_robot_state-npc1_median0.07373806042859783
sim_compute_robot_state-npc1_min0.05628637870152791
sim_compute_robot_state-npc2_max0.07635842515276624
sim_compute_robot_state-npc2_mean0.0667791123747031
sim_compute_robot_state-npc2_median0.07113763168033234
sim_compute_robot_state-npc2_min0.055389941533406574
sim_compute_robot_state-npc3_max0.07655263721168816
sim_compute_robot_state-npc3_mean0.06666164190601832
sim_compute_robot_state-npc3_median0.07113845873687227
sim_compute_robot_state-npc3_min0.05475617217146643
sim_compute_sim_state_max0.046784003575642906
sim_compute_sim_state_mean0.03876979800265755
sim_compute_sim_state_median0.04012203351252497
sim_compute_sim_state_min0.03163607676823934
sim_physics_max0.21577338444984565
sim_physics_mean0.1913907983584727
sim_physics_median0.21249692837397255
sim_physics_min0.15415446281433107
sim_render-ego_max0.06776728789011638
sim_render-ego_mean0.06093844571666903
sim_render-ego_median0.06710114452124989
sim_render-ego_min0.05028851391517953
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.480000000000029
survival_time_min7.699999999999981
No reset possible
237393746sebastian glatzaido2-LF-sim-testingstep1-simulationsuccessyesip-172-31-25-98-24700:15:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.10099507669212504
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.17149024963378906
agent_compute-ego_mean0.1449559364604134
agent_compute-ego_median0.1516740807032181
agent_compute-ego_min0.1216250704480456
deviation-center-line_max0.2838635700333795
deviation-center-line_mean0.12786165368054708
deviation-center-line_min0.07112529346797256
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3391682685652287
deviation-heading_median0.32928385103533875
deviation-heading_min0.19401296908406307
driven_any_max2.1706243860917107
driven_any_mean0.9759490378276146
driven_any_median1.0117660515775693
driven_any_min0.23626560261560617
driven_lanedir_consec_max1.919400421063832
driven_lanedir_consec_mean0.6896171461819246
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max1.919400421063832
driven_lanedir_mean0.6896171461819246
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.5899999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.09528273123281972, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05423478726987486, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.13734135804352937, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08127616952966761, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03428763371926767, "sim_compute_performance-ego": 0.06082529933364303, "sim_compute_robot_state-ego": 0.06081612463350649}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.12024382516449574, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06404764979493384, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.16856020572138766, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.10648715729806936, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.04220694654128131, "sim_compute_performance-ego": 0.07147582839517032, "sim_compute_robot_state-ego": 0.07744977520961388}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.13239446808310115, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.0660087501301485, "in-drivable-lane": 0, "agent_compute-ego": 0.15381654571084416, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.10036008498247932, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.04024867450489717, "sim_compute_performance-ego": 0.07073723568635829, "sim_compute_robot_state-ego": 0.07242528130026425}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.14975594520568847, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06763975143432617, "in-drivable-lane": 0, "agent_compute-ego": 0.17149024963378906, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.10223420143127442, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.043757543563842774, "sim_compute_performance-ego": 0.07194437026977539, "sim_compute_robot_state-ego": 0.0863063907623291}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.13220209109632275, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.0677516732034804, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.15815309331386904, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.10157939150363585, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.04089456570299366, "sim_compute_performance-ego": 0.07422839538960517, "sim_compute_robot_state-ego": 0.08573909650875043}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.13446317400251115, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.06467423147084761, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.15886642008411642, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.10297318867274692, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.04243036192290637, "sim_compute_performance-ego": 0.07462888834427814, "sim_compute_robot_state-ego": 0.08225123736323142}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.13706873570169725, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.06602168934685844, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.16572027121271407, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.10715426291738238, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.04302382469177246, "sim_compute_performance-ego": 0.07507902383804321, "sim_compute_robot_state-ego": 0.08414862837110247}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.1320756957644508, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.06748075712294806, "in-drivable-lane": 0, "agent_compute-ego": 0.158934752146403, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.10401615642365956, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.04276806967599051, "sim_compute_performance-ego": 0.08193926584152948, "sim_compute_robot_state-ego": 0.07643164907182966}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.12748344469878634, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.06284615144891254, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.1516740807032181, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.10147768360073284, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.04051634820841127, "sim_compute_performance-ego": 0.06865509485794326, "sim_compute_robot_state-ego": 0.07268029552395061}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.09565956809303976, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.04988867152820934, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.12273856509815564, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.0731417569247159, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.03162201101129705, "sim_compute_performance-ego": 0.055742467533458365, "sim_compute_robot_state-ego": 0.05735806551846591}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.0928365626892486, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.04972286348219042, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.1216250704480456, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.07683439068980032, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.031415128088616705, "sim_compute_performance-ego": 0.053813906459065225, "sim_compute_robot_state-ego": 0.06051455225263323}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.0980530721800668, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.05250028201511928, "in-drivable-lane": 0, "agent_compute-ego": 0.1255253723689488, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.07212696756635394, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.03063648087637765, "sim_compute_performance-ego": 0.05666169098445347, "sim_compute_robot_state-ego": 0.0604052117892674}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.09506671568926645, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.05315854970146628, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.13161071609048283, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.07909706527111578, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.03422039630366307, "sim_compute_performance-ego": 0.05865072269065707, "sim_compute_robot_state-ego": 0.06103634366802141}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.09708976745605467, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.05115221164844654, "in-drivable-lane": 0, "agent_compute-ego": 0.12487820342735008, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.07787088994626645, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.03567220546581127, "sim_compute_performance-ego": 0.05643271516870569, "sim_compute_robot_state-ego": 0.06099110179477268}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.09471563030691708, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.05121883925269632, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.12340414290334664, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.0768276382895077, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.03218267711938596, "sim_compute_performance-ego": 0.059119526077719295, "sim_compute_robot_state-ego": 0.06152835313011618}}
set_robot_commands_max0.10715426291738238
set_robot_commands_mean0.0908971336698272
set_robot_commands_median0.10036008498247932
set_robot_commands_min0.07212696756635394
sim_compute_performance-ego_max0.08193926584152948
sim_compute_performance-ego_mean0.06599562872469371
sim_compute_performance-ego_median0.06865509485794326
sim_compute_performance-ego_min0.053813906459065225
sim_compute_robot_state-ego_max0.0863063907623291
sim_compute_robot_state-ego_mean0.07067214045985701
sim_compute_robot_state-ego_median0.07242528130026425
sim_compute_robot_state-ego_min0.05735806551846591
sim_compute_sim_state_max0.043757543563842774
sim_compute_sim_state_mean0.037725524493100994
sim_compute_sim_state_median0.04024867450489717
sim_compute_sim_state_min0.03063648087637765
sim_physics_max0.14975594520568847
sim_physics_mean0.11562609515763111
sim_physics_median0.12024382516449574
sim_physics_min0.0928365626892486
sim_render-ego_max0.0677516732034804
sim_render-ego_mean0.05922312392336391
sim_render-ego_median0.06284615144891254
sim_render-ego_min0.04972286348219042
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.503333333333331
survival_time_min0.8500000000000002
No reset possible
236683714jiang pengfinal test - whaido2-LF-sim-testingstep1-simulationerroryesip-172-31-25-98-24700:20:43
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
235693687Tony Hsu 🇹🇼Baseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationtimeoutyesip-172-31-25-98-24700:36:48
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
235633688FANG MEIYI 🇸🇬testaido2-LFV-sim-testingstep1-simulationerroryesip-172-31-25-98-24700:15:16
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
235573682Anastasiya Nikolskaya 🇷🇺Submission 01aido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-25-98-24700:09:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.884261610367866
survival_time_median5.04999999999999
deviation-center-line_median0.5705132461978037
in-drivable-lane_median0.04999999999999982


other stats
agent_compute-ego_max0.06037108968980241
agent_compute-ego_mean0.05547068945569601
agent_compute-ego_median0.055156528714146065
agent_compute-ego_min0.05278388282956456
deviation-center-line_max1.0291182277457886
deviation-center-line_mean0.5885054294785383
deviation-center-line_min0.2818003278322461
deviation-heading_max2.767253801350219
deviation-heading_mean1.706704615623546
deviation-heading_median1.520619934851932
deviation-heading_min0.5196885864203139
driven_any_max2.3236850528003874
driven_any_mean1.257773734243394
driven_any_median0.8898251136786706
driven_any_min0.6633927884647012
driven_lanedir_consec_max2.258962672474665
driven_lanedir_consec_mean1.1872084023834588
driven_lanedir_consec_min0.6074715391467832
driven_lanedir_max2.258962672474665
driven_lanedir_mean1.1872084023834588
driven_lanedir_median0.884261610367866
driven_lanedir_min0.6074715391467832
in-drivable-lane_max0.09999999999999964
in-drivable-lane_mean0.04000000000000003
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8807419387358698, "sim_physics": 0.07985236621139073, "survival_time": 5.04999999999999, "driven_lanedir": 0.7656698217882517, "sim_render-ego": 0.03929810476775217, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.06037108968980241, "deviation-heading": 1.520619934851932, "set_robot_commands": 0.07319051440399472, "deviation-center-line": 0.4612305358866037, "driven_lanedir_consec": 0.7656698217882517, "sim_compute_sim_state": 0.02975472129217469, "sim_compute_performance-ego": 0.04875366522534059, "sim_compute_robot_state-ego": 0.053676305430950505}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6633927884647012, "sim_physics": 0.08000039125417734, "survival_time": 3.8499999999999943, "driven_lanedir": 0.6074715391467832, "sim_render-ego": 0.038724304793717024, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.05625012633088347, "deviation-heading": 1.3180553597631797, "set_robot_commands": 0.07830381703067135, "deviation-center-line": 0.2818003278322461, "driven_lanedir_consec": 0.6074715391467832, "sim_compute_sim_state": 0.03053139401720716, "sim_compute_performance-ego": 0.049170453827102466, "sim_compute_robot_state-ego": 0.054752408684074105}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.8898251136786706, "sim_physics": 0.07174541690562031, "survival_time": 5.04999999999999, "driven_lanedir": 0.884261610367866, "sim_render-ego": 0.0382858668223466, "in-drivable-lane": 0, "agent_compute-ego": 0.05279181971408353, "deviation-heading": 0.5196885864203139, "set_robot_commands": 0.06625588813630662, "deviation-center-line": 0.5705132461978037, "driven_lanedir_consec": 0.884261610367866, "sim_compute_sim_state": 0.028406596419834857, "sim_compute_performance-ego": 0.04438596432751949, "sim_compute_robot_state-ego": 0.04965179745513614}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5312237775373416, "sim_physics": 0.07086200826972194, "survival_time": 8.449999999999985, "driven_lanedir": 1.4196763681397278, "sim_render-ego": 0.03920539455300957, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.05278388282956456, "deviation-heading": 2.767253801350219, "set_robot_commands": 0.06742224326500526, "deviation-center-line": 0.5998648097302492, "driven_lanedir_consec": 1.4196763681397278, "sim_compute_sim_state": 0.0277276702181122, "sim_compute_performance-ego": 0.04689673841352293, "sim_compute_robot_state-ego": 0.05076953645288591}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3236850528003874, "sim_physics": 0.08021914534889191, "survival_time": 12.650000000000045, "driven_lanedir": 2.258962672474665, "sim_render-ego": 0.03889943300028564, "in-drivable-lane": 0, "agent_compute-ego": 0.055156528714146065, "deviation-heading": 2.407905395732085, "set_robot_commands": 0.07285133369355333, "deviation-center-line": 1.0291182277457886, "driven_lanedir_consec": 2.258962672474665, "sim_compute_sim_state": 0.030825421744184532, "sim_compute_performance-ego": 0.04844636785183029, "sim_compute_robot_state-ego": 0.05484642341674081}}
set_robot_commands_max0.07830381703067135
set_robot_commands_mean0.07160475930590626
set_robot_commands_median0.07285133369355333
set_robot_commands_min0.06625588813630662
sim_compute_performance-ego_max0.049170453827102466
sim_compute_performance-ego_mean0.04753063792906315
sim_compute_performance-ego_median0.04844636785183029
sim_compute_performance-ego_min0.04438596432751949
sim_compute_robot_state-ego_max0.05484642341674081
sim_compute_robot_state-ego_mean0.0527392942879575
sim_compute_robot_state-ego_median0.053676305430950505
sim_compute_robot_state-ego_min0.04965179745513614
sim_compute_sim_state_max0.030825421744184532
sim_compute_sim_state_mean0.02944916073830269
sim_compute_sim_state_median0.02975472129217469
sim_compute_sim_state_min0.0277276702181122
sim_physics_max0.08021914534889191
sim_physics_mean0.07653586559796045
sim_physics_median0.07985236621139073
sim_physics_min0.07086200826972194
sim_render-ego_max0.03929810476775217
sim_render-ego_mean0.03888262078742221
sim_render-ego_median0.03889943300028564
sim_render-ego_min0.0382858668223466
simulation-passed1
survival_time_max12.650000000000045
survival_time_mean7.010000000000001
survival_time_min3.8499999999999943
No reset possible
235493680FANG MEIYI 🇸🇬testaido2-LFVI-sim-testingstep1-simulationerroryesip-172-31-25-98-24700:28:38
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
235443676Tony Hsu 🇹🇼Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-25-98-24700:18:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6950573847640089
survival_time_median14.950000000000076
deviation-center-line_median0.44374302000365046
in-drivable-lane_median7.200000000000037


other stats
agent_compute-ego_max0.24391366799672445
agent_compute-ego_mean0.24244079081217448
agent_compute-ego_median0.24237067778905233
agent_compute-ego_min0.24127625544865927
deviation-center-line_max0.7337965812416224
deviation-center-line_mean0.4812214119502003
deviation-center-line_min0.29799505396684733
deviation-heading_max5.990117020581061
deviation-heading_mean5.864380088201328
deviation-heading_median5.951617305849203
deviation-heading_min5.613995197946513
driven_any_max2.1853065485311514
driven_any_mean2.185306548531142
driven_any_median2.1853065485311407
driven_any_min2.1853065485311367
driven_lanedir_consec_max0.6964859913423234
driven_lanedir_consec_mean0.6949286260456211
driven_lanedir_consec_min0.6933707706415575
driven_lanedir_max0.6964859913423234
driven_lanedir_mean0.6949286260456211
driven_lanedir_median0.6950573847640089
driven_lanedir_min0.6933707706415575
in-drivable-lane_max7.400000000000038
in-drivable-lane_mean7.260000000000038
in-drivable-lane_min7.200000000000037
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.1853065485311434, "sim_physics": 0.060014106432596845, "survival_time": 14.950000000000076, "driven_lanedir": 0.6964859913423234, "sim_render-ego": 0.03822591145833333, "in-drivable-lane": 7.400000000000038, "agent_compute-ego": 0.24391366799672445, "deviation-heading": 5.613995197946513, "set_robot_commands": 0.05662880420684815, "deviation-center-line": 0.7337965812416224, "driven_lanedir_consec": 0.6964859913423234, "sim_compute_sim_state": 0.024633073012034094, "sim_compute_performance-ego": 0.04170809666315715, "sim_compute_robot_state-ego": 0.04321765740712484}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.1853065485311514, "sim_physics": 0.05565581957499186, "survival_time": 14.950000000000076, "driven_lanedir": 0.694222936176982, "sim_render-ego": 0.037640389601389566, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.24271422783533733, "deviation-heading": 5.990117020581061, "set_robot_commands": 0.056205401420593264, "deviation-center-line": 0.29799505396684733, "driven_lanedir_consec": 0.694222936176982, "sim_compute_sim_state": 0.024405479431152344, "sim_compute_performance-ego": 0.04086261987686157, "sim_compute_robot_state-ego": 0.04306917349497477}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.185306548531138, "sim_physics": 0.05949503819147746, "survival_time": 14.950000000000076, "driven_lanedir": 0.6950573847640089, "sim_render-ego": 0.03723544041315714, "in-drivable-lane": 7.300000000000038, "agent_compute-ego": 0.24127625544865927, "deviation-heading": 5.796667795845188, "set_robot_commands": 0.05612116813659668, "deviation-center-line": 0.307138938696771, "driven_lanedir_consec": 0.6950573847640089, "sim_compute_sim_state": 0.024573467572530112, "sim_compute_performance-ego": 0.041544706026713056, "sim_compute_robot_state-ego": 0.0427200977007548}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.1853065485311367, "sim_physics": 0.05831480662027995, "survival_time": 14.950000000000076, "driven_lanedir": 0.6955060473032337, "sim_render-ego": 0.037372442881266274, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.24192912499109903, "deviation-heading": 5.969503120784673, "set_robot_commands": 0.05574620962142944, "deviation-center-line": 0.6234334658421105, "driven_lanedir_consec": 0.6955060473032337, "sim_compute_sim_state": 0.02468371868133545, "sim_compute_performance-ego": 0.041584471066792805, "sim_compute_robot_state-ego": 0.04324496587117513}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.1853065485311407, "sim_physics": 0.0580613629023234, "survival_time": 14.950000000000076, "driven_lanedir": 0.6933707706415575, "sim_render-ego": 0.037051753997802736, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.24237067778905233, "deviation-heading": 5.951617305849203, "set_robot_commands": 0.05610112190246582, "deviation-center-line": 0.44374302000365046, "driven_lanedir_consec": 0.6933707706415575, "sim_compute_sim_state": 0.024428693453470863, "sim_compute_performance-ego": 0.04079530795415243, "sim_compute_robot_state-ego": 0.04273587306340536}}
set_robot_commands_max0.05662880420684815
set_robot_commands_mean0.056160541057586666
set_robot_commands_median0.05612116813659668
set_robot_commands_min0.05574620962142944
sim_compute_performance-ego_max0.04170809666315715
sim_compute_performance-ego_mean0.0412990403175354
sim_compute_performance-ego_median0.041544706026713056
sim_compute_performance-ego_min0.04079530795415243
sim_compute_robot_state-ego_max0.04324496587117513
sim_compute_robot_state-ego_mean0.04299755350748698
sim_compute_robot_state-ego_median0.04306917349497477
sim_compute_robot_state-ego_min0.0427200977007548
sim_compute_sim_state_max0.02468371868133545
sim_compute_sim_state_mean0.024544886430104572
sim_compute_sim_state_median0.024573467572530112
sim_compute_sim_state_min0.024405479431152344
sim_physics_max0.060014106432596845
sim_physics_mean0.058308226744333905
sim_physics_median0.05831480662027995
sim_physics_min0.05565581957499186
sim_render-ego_max0.03822591145833333
sim_render-ego_mean0.03750518767038981
sim_render-ego_median0.037372442881266274
sim_render-ego_min0.037051753997802736
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
235333673FANG MEIYI 🇸🇬testaido2-LFVI-sim-validationstep1-simulationsuccessyesip-172-31-25-98-24700:23:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.0066534279467008
survival_time_median14.950000000000076
deviation-center-line_median0.7143616596714497
in-drivable-lane_median0


other stats
agent_compute-ego_max0.09658862988154092
agent_compute-ego_mean0.09609724187850952
agent_compute-ego_median0.09624241511027018
agent_compute-ego_min0.0956540552775065
deviation-center-line_max0.9553777666815064
deviation-center-line_mean0.7547416790193562
deviation-center-line_min0.648705099559962
deviation-heading_max2.303407030598067
deviation-heading_mean1.9639247549619496
deviation-heading_median1.8570762145740192
deviation-heading_min1.7794640123643488
driven_any_max3.2778817336316965
driven_any_mean3.1517458214039413
driven_any_median3.1417654006471767
driven_any_min3.0437104342974113
driven_lanedir_consec_max3.1171340243481565
driven_lanedir_consec_mean2.965885113081215
driven_lanedir_consec_min2.7888809798424603
driven_lanedir_max3.2449234610136677
driven_lanedir_mean3.111252434758915
driven_lanedir_median3.1018874372040153
driven_lanedir_min3.0066534279467008
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 3.1417654006471767, "sim_physics": 0.1051011331876119, "survival_time": 14.950000000000076, "driven_lanedir": 3.1018874372040153, "sim_render-ego": 0.037850689888000486, "in-drivable-lane": 0, "agent_compute-ego": 0.0956540552775065, "deviation-heading": 1.7982584869413147, "set_robot_commands": 0.05782421747843425, "deviation-center-line": 0.7409325555152371, "driven_lanedir_consec": 3.1018874372040153, "sim_compute_sim_state": 0.023955017725626627, "sim_compute_performance-ego": 0.040988264878590905, "sim_compute_robot_state-ego": 0.04327632586161296, "sim_compute_robot_state-npc0": 0.04248622179031372, "sim_compute_robot_state-npc1": 0.0419119930267334, "sim_compute_robot_state-npc2": 0.042729628086090085, "sim_compute_robot_state-npc3": 0.0418430225054423}, "udem1-1-0": {"driven_any": 3.15618731602549, "sim_physics": 0.11114086310068766, "survival_time": 14.950000000000076, "driven_lanedir": 3.1171340243481565, "sim_render-ego": 0.03834749221801758, "in-drivable-lane": 0, "agent_compute-ego": 0.09658862988154092, "deviation-heading": 2.0814180303319976, "set_robot_commands": 0.058612501621246337, "deviation-center-line": 0.7143616596714497, "driven_lanedir_consec": 3.1171340243481565, "sim_compute_sim_state": 0.02361816167831421, "sim_compute_performance-ego": 0.041151140530904136, "sim_compute_robot_state-ego": 0.04329676310221354, "sim_compute_robot_state-npc0": 0.04253971974054972, "sim_compute_robot_state-npc1": 0.041670262813568115, "sim_compute_robot_state-npc2": 0.041247719128926594, "sim_compute_robot_state-npc3": 0.04248509645462036}, "udem1-2-0": {"driven_any": 3.0437104342974113, "sim_physics": 0.11812926371892292, "survival_time": 14.950000000000076, "driven_lanedir": 3.0066534279467008, "sim_render-ego": 0.038241583506266275, "in-drivable-lane": 0, "agent_compute-ego": 0.09625758647918702, "deviation-heading": 1.8570762145740192, "set_robot_commands": 0.05838130553563436, "deviation-center-line": 0.9553777666815064, "driven_lanedir_consec": 3.0066534279467008, "sim_compute_sim_state": 0.023703107833862303, "sim_compute_performance-ego": 0.041167229016621905, "sim_compute_robot_state-ego": 0.04290361245473226, "sim_compute_robot_state-npc0": 0.04275475422541301, "sim_compute_robot_state-npc1": 0.04219453493754069, "sim_compute_robot_state-npc2": 0.041437570254007974, "sim_compute_robot_state-npc3": 0.04207917213439941}, "udem1-3-0": {"driven_any": 3.2778817336316965, "sim_physics": 0.1142471448580424, "survival_time": 14.950000000000076, "driven_lanedir": 3.2449234610136677, "sim_render-ego": 0.03852046966552734, "in-drivable-lane": 0, "agent_compute-ego": 0.09624241511027018, "deviation-heading": 1.7794640123643488, "set_robot_commands": 0.05709574302037557, "deviation-center-line": 0.648705099559962, "driven_lanedir_consec": 2.814869696064744, "sim_compute_sim_state": 0.024050087134043375, "sim_compute_performance-ego": 0.04122813065846761, "sim_compute_robot_state-ego": 0.04317929744720459, "sim_compute_robot_state-npc0": 0.04292547225952149, "sim_compute_robot_state-npc1": 0.043346336682637536, "sim_compute_robot_state-npc2": 0.04194187800089518, "sim_compute_robot_state-npc3": 0.04260432322820028}, "udem1-4-0": {"driven_any": 3.1391842224179327, "sim_physics": 0.10867774724960327, "survival_time": 14.950000000000076, "driven_lanedir": 3.085663823282034, "sim_render-ego": 0.03809222300847371, "in-drivable-lane": 0, "agent_compute-ego": 0.09574352264404296, "deviation-heading": 2.303407030598067, "set_robot_commands": 0.058729511896769206, "deviation-center-line": 0.7143313136686256, "driven_lanedir_consec": 2.7888809798424603, "sim_compute_sim_state": 0.023724094231923423, "sim_compute_performance-ego": 0.04098067998886108, "sim_compute_robot_state-ego": 0.04296870628992717, "sim_compute_robot_state-npc0": 0.042471914291381835, "sim_compute_robot_state-npc1": 0.041794784863789874, "sim_compute_robot_state-npc2": 0.04138726313908895, "sim_compute_robot_state-npc3": 0.04156135559082031}}
set_robot_commands_max0.058729511896769206
set_robot_commands_mean0.05812865591049195
set_robot_commands_median0.05838130553563436
set_robot_commands_min0.05709574302037557
sim_compute_performance-ego_max0.04122813065846761
sim_compute_performance-ego_mean0.041103089014689134
sim_compute_performance-ego_median0.041151140530904136
sim_compute_performance-ego_min0.04098067998886108
sim_compute_robot_state-ego_max0.04329676310221354
sim_compute_robot_state-ego_mean0.043124941031138106
sim_compute_robot_state-ego_median0.04317929744720459
sim_compute_robot_state-ego_min0.04290361245473226
sim_compute_robot_state-npc0_max0.04292547225952149
sim_compute_robot_state-npc0_mean0.04263561646143595
sim_compute_robot_state-npc0_median0.04253971974054972
sim_compute_robot_state-npc0_min0.042471914291381835
sim_compute_robot_state-npc1_max0.043346336682637536
sim_compute_robot_state-npc1_mean0.04218358246485392
sim_compute_robot_state-npc1_median0.0419119930267334
sim_compute_robot_state-npc1_min0.041670262813568115
sim_compute_robot_state-npc2_max0.042729628086090085
sim_compute_robot_state-npc2_mean0.04174881172180176
sim_compute_robot_state-npc2_median0.041437570254007974
sim_compute_robot_state-npc2_min0.041247719128926594
sim_compute_robot_state-npc3_max0.04260432322820028
sim_compute_robot_state-npc3_mean0.042114593982696534
sim_compute_robot_state-npc3_median0.04207917213439941
sim_compute_robot_state-npc3_min0.04156135559082031
sim_compute_sim_state_max0.024050087134043375
sim_compute_sim_state_mean0.023810093720753985
sim_compute_sim_state_median0.023724094231923423
sim_compute_sim_state_min0.02361816167831421
sim_physics_max0.11812926371892292
sim_physics_mean0.11145923042297363
sim_physics_median0.11114086310068766
sim_physics_min0.1051011331876119
sim_render-ego_max0.03852046966552734
sim_render-ego_mean0.038210491657257074
sim_render-ego_median0.038241583506266275
sim_render-ego_min0.037850689888000486
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
235323670FANG MEIYI 🇸🇬testaido2-LFV-sim-testingstep1-simulationerroryesip-172-31-25-98-24700:01:30
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
233343594Victor Adolfo Romero Cano 🇨🇴aido2-LF-sim-testingstep1-simulationsuccessyesip-172-31-25-98-24700:12:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.10099507669212504
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.17204012870788574
agent_compute-ego_mean0.12473540876591842
agent_compute-ego_median0.12288504947315562
agent_compute-ego_min0.0914151668548584
deviation-center-line_max0.2838635700333795
deviation-center-line_mean0.12786165368054708
deviation-center-line_min0.07112529346797256
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3391682685652287
deviation-heading_median0.32928385103533875
deviation-heading_min0.19401296908406307
driven_any_max2.1706243860917107
driven_any_mean0.9759490378276146
driven_any_median1.0117660515775693
driven_any_min0.23626560261560617
driven_lanedir_consec_max1.919400421063832
driven_lanedir_consec_mean0.6896171461819246
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max1.919400421063832
driven_lanedir_mean0.6896171461819246
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.5899999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.11931126647525364, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06423860126071507, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1626886350137216, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10281400327329282, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04125810111010516, "sim_compute_performance-ego": 0.07147652131539804, "sim_compute_robot_state-ego": 0.0834624237484402}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.12588962854123584, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06458226839701335, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15633336702982584, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.09701175315707336, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.04052967651217591, "sim_compute_performance-ego": 0.07443965650072285, "sim_compute_robot_state-ego": 0.08059423110064338}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.13210701942443848, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.06844924477969899, "in-drivable-lane": 0, "agent_compute-ego": 0.14990443341872273, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.09838231872109804, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.03936074761783376, "sim_compute_performance-ego": 0.07616971520816579, "sim_compute_robot_state-ego": 0.08062516941743739}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.13878315925598145, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06658632278442383, "in-drivable-lane": 0, "agent_compute-ego": 0.17204012870788574, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.1075462245941162, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.04205678939819336, "sim_compute_performance-ego": 0.07636987686157226, "sim_compute_robot_state-ego": 0.08754681587219239}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.10954520068591156, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06090230277821987, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.14718954774397838, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.0945880352696286, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03713305992416189, "sim_compute_performance-ego": 0.06652380846723725, "sim_compute_robot_state-ego": 0.07185866862912721}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.0866507608063367, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.04901680654408981, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.12315590041024344, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.0738453670423858, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.03142672655533771, "sim_compute_performance-ego": 0.053476630424966615, "sim_compute_robot_state-ego": 0.05630742773717763}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.0852533493723188, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.04975352116993496, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.11932407106672016, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.07699548346655709, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.031206782375063215, "sim_compute_performance-ego": 0.053576763187135966, "sim_compute_robot_state-ego": 0.0548927869115557}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.09022627558026997, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.04557180404663086, "in-drivable-lane": 0, "agent_compute-ego": 0.11555471874418712, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.07021575882321313, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.03124061084928967, "sim_compute_performance-ego": 0.05102260907491048, "sim_compute_robot_state-ego": 0.05366764749799456}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.08592451224892826, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.05075562202324301, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.12447075520531606, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.07310957019611941, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.03124827449604616, "sim_compute_performance-ego": 0.05574434894626423, "sim_compute_robot_state-ego": 0.05756449295302569}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.09490366849032315, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.04764158942482688, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.12288504947315562, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.07268528504805132, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.03035568757490678, "sim_compute_performance-ego": 0.05461244583129883, "sim_compute_robot_state-ego": 0.05840216983448376}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.07817290045998314, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.043296101805451626, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.106132646659752, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.06439197218263304, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.027582555622249455, "sim_compute_performance-ego": 0.04653447943848449, "sim_compute_robot_state-ego": 0.04901107874783603}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.06688745532717023, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.039088078907557895, "in-drivable-lane": 0, "agent_compute-ego": 0.09308073350361416, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.05730989149638584, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.024793335369655063, "sim_compute_performance-ego": 0.042679974011012485, "sim_compute_robot_state-ego": 0.04400301831109183}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.06192931474423876, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.03828511051103181, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.09392205874125165, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.05844532742219813, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.025055941413430607, "sim_compute_performance-ego": 0.04104703080420401, "sim_compute_robot_state-ego": 0.04376665283651913}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.06669717364841038, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.03741982248094347, "in-drivable-lane": 0, "agent_compute-ego": 0.0914151668548584, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.05650552113850912, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.024352877228348346, "sim_compute_performance-ego": 0.04001696904500326, "sim_compute_robot_state-ego": 0.042656130260891385}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.05872246798347024, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.03742415063521441, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.0929339189155429, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.057245880949730966, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.024291714032491047, "sim_compute_performance-ego": 0.04132733625524184, "sim_compute_robot_state-ego": 0.04287112226673201}}
set_robot_commands_max0.1075462245941162
set_robot_commands_mean0.07740615951873285
set_robot_commands_median0.07310957019611941
set_robot_commands_min0.05650552113850912
sim_compute_performance-ego_max0.07636987686157226
sim_compute_performance-ego_mean0.0563345443581079
sim_compute_performance-ego_median0.053576763187135966
sim_compute_performance-ego_min0.04001696904500326
sim_compute_robot_state-ego_max0.08754681587219239
sim_compute_robot_state-ego_mean0.0604819890750099
sim_compute_robot_state-ego_median0.05630742773717763
sim_compute_robot_state-ego_min0.042656130260891385
sim_compute_sim_state_max0.04205678939819336
sim_compute_sim_state_mean0.032126192005285874
sim_compute_sim_state_median0.03124061084928967
sim_compute_sim_state_min0.024291714032491047
sim_physics_max0.13878315925598145
sim_physics_mean0.09340027686961803
sim_physics_median0.0866507608063367
sim_physics_min0.05872246798347024
sim_render-ego_max0.06844924477969899
sim_render-ego_mean0.050867423169933056
sim_render-ego_median0.04901680654408981
sim_render-ego_min0.03741982248094347
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.503333333333331
survival_time_min0.8500000000000002
No reset possible
232872900Julian ZillyBaseline-IL-logs-tensorflowaido2-LF-sim-validationstep1-simulationerroryesip-172-31-25-98-24700:10:42
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
232333578Andrea Censi 🇨🇭rotationaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-25-98-24700:03:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6618324868125249
survival_time_median2.1000000000000005
deviation-center-line_median0.09250602665006584
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.09571321805318196
agent_compute-ego_mean0.09363224520728988
agent_compute-ego_median0.09379823505878448
agent_compute-ego_min0.09207706866057022
deviation-center-line_max0.21439068356235536
deviation-center-line_mean0.12258369343422797
deviation-center-line_min0.0744010530149505
deviation-heading_max0.5686442582449269
deviation-heading_mean0.3103675930817716
deviation-heading_median0.25395078679676
deviation-heading_min0.17582209342949345
driven_any_max1.575892401948956
driven_any_mean0.8642098067399473
driven_any_median1.0038564958116647
driven_any_min0.26972689326339405
driven_lanedir_consec_max1.1723086623342591
driven_lanedir_consec_mean0.6830346826605466
driven_lanedir_consec_min0.2605911739016977
driven_lanedir_max1.1723086623342591
driven_lanedir_mean0.6830346826605466
driven_lanedir_median0.6618324868125249
driven_lanedir_min0.2605911739016977
in-drivable-lane_max0.6999999999999975
in-drivable-lane_mean0.2699999999999994
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0038564958116647, "sim_physics": 0.0654205424445016, "survival_time": 2.1000000000000005, "driven_lanedir": 0.6618324868125249, "sim_render-ego": 0.03839257785252163, "in-drivable-lane": 0.5499999999999998, "agent_compute-ego": 0.09571321805318196, "deviation-heading": 0.25395078679676, "set_robot_commands": 0.057715143476213725, "deviation-center-line": 0.09250602665006584, "driven_lanedir_consec": 0.6618324868125249, "sim_compute_sim_state": 0.024907600312005906, "sim_compute_performance-ego": 0.04245328903198242, "sim_compute_robot_state-ego": 0.04413047858646938}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0061450567009285, "sim_physics": 0.06236938067844936, "survival_time": 2.1000000000000005, "driven_lanedir": 0.8764382022560809, "sim_render-ego": 0.03812733718327114, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.09414525826772054, "deviation-heading": 0.5686442582449269, "set_robot_commands": 0.05916064126150949, "deviation-center-line": 0.1563855108175075, "driven_lanedir_consec": 0.8764382022560809, "sim_compute_sim_state": 0.0246808926264445, "sim_compute_performance-ego": 0.042295796530587335, "sim_compute_robot_state-ego": 0.043609023094177246}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.26972689326339405, "sim_physics": 0.06486229598522186, "survival_time": 0.8000000000000002, "driven_lanedir": 0.2605911739016977, "sim_render-ego": 0.03715328872203827, "in-drivable-lane": 0, "agent_compute-ego": 0.09379823505878448, "deviation-heading": 0.20274263769041717, "set_robot_commands": 0.05588427186012268, "deviation-center-line": 0.07523519312626054, "driven_lanedir_consec": 0.2605911739016977, "sim_compute_sim_state": 0.024330437183380127, "sim_compute_performance-ego": 0.040615081787109375, "sim_compute_robot_state-ego": 0.04216925799846649}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4654281859747942, "sim_physics": 0.06833005988079568, "survival_time": 1.1500000000000004, "driven_lanedir": 0.4440028879981699, "sim_render-ego": 0.03892249646394149, "in-drivable-lane": 0, "agent_compute-ego": 0.09207706866057022, "deviation-heading": 0.3506781892472603, "set_robot_commands": 0.05744715358899987, "deviation-center-line": 0.0744010530149505, "driven_lanedir_consec": 0.4440028879981699, "sim_compute_sim_state": 0.024804509204366932, "sim_compute_performance-ego": 0.041398659996364426, "sim_compute_robot_state-ego": 0.043762289959451424}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.575892401948956, "sim_physics": 0.061587379824730656, "survival_time": 3.099999999999997, "driven_lanedir": 1.1723086623342591, "sim_render-ego": 0.038858486760047176, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.0924274459961922, "deviation-heading": 0.17582209342949345, "set_robot_commands": 0.05720936867498582, "deviation-center-line": 0.21439068356235536, "driven_lanedir_consec": 1.1723086623342591, "sim_compute_sim_state": 0.025094805225249255, "sim_compute_performance-ego": 0.04227385597844278, "sim_compute_robot_state-ego": 0.04358988808047387}}
set_robot_commands_max0.05916064126150949
set_robot_commands_mean0.05748331577236632
set_robot_commands_median0.05744715358899987
set_robot_commands_min0.05588427186012268
sim_compute_performance-ego_max0.04245328903198242
sim_compute_performance-ego_mean0.04180733666489727
sim_compute_performance-ego_median0.04227385597844278
sim_compute_performance-ego_min0.040615081787109375
sim_compute_robot_state-ego_max0.04413047858646938
sim_compute_robot_state-ego_mean0.04345218754380768
sim_compute_robot_state-ego_median0.043609023094177246
sim_compute_robot_state-ego_min0.04216925799846649
sim_compute_sim_state_max0.025094805225249255
sim_compute_sim_state_mean0.024763648910289347
sim_compute_sim_state_median0.024804509204366932
sim_compute_sim_state_min0.024330437183380127
sim_physics_max0.06833005988079568
sim_physics_mean0.06451393176273984
sim_physics_median0.06486229598522186
sim_physics_min0.061587379824730656
sim_render-ego_max0.03892249646394149
sim_render-ego_mean0.03829083739636394
sim_render-ego_median0.03839257785252163
sim_render-ego_min0.03715328872203827
simulation-passed1
survival_time_max3.099999999999997
survival_time_mean1.8499999999999996
survival_time_min0.8000000000000002
No reset possible
231743572Bhairav Mehtachallenge-aido_LF-template-pytorchaido2-LFV-sim-testingstep1-simulationerroryesip-172-31-25-98-24700:02:46
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
231593560Bhairav MehtaBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationerroryesip-172-31-25-98-24700:01:58
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible