Duckietown Challenges Home Challenges Submissions

Evaluator 1296

ID1296
evaluatorip-172-31-25-98-2062
ownerI don't have one 😀
machineip-172-31-25-98
processip-172-31-25-98-2062
versiond-c:4.0.30;d-c-r:4.0.46;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success4 23335
# timeout
# failed1 23677
# error8 23175
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
237473757Julian ZillyBaseline-IL-logs-tensorflowaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-25-98-20620:18:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8905739050228418
survival_time_median8.299999999999983
deviation-center-line_median0.3827275259217235
in-drivable-lane_median0.8500000000000014


other stats
agent_compute-ego_max0.30193230739006627
agent_compute-ego_mean0.2760076463675967
agent_compute-ego_median0.27948086271026257
agent_compute-ego_min0.25248331334217483
deviation-center-line_max0.5865227354471323
deviation-center-line_mean0.40245736553478784
deviation-center-line_min0.2653504640681014
deviation-heading_max2.357504744296126
deviation-heading_mean1.558790461345485
deviation-heading_median1.4300433593230906
deviation-heading_min0.9153926956686912
driven_any_max1.6182902646474224
driven_any_mean0.9940143951873752
driven_any_median1.0227427352582985
driven_any_min0.23156034419386445
driven_lanedir_consec_max1.2702233519266186
driven_lanedir_consec_mean0.8108772314560104
driven_lanedir_consec_min0.21214861604913837
driven_lanedir_max1.2702233519266186
driven_lanedir_mean0.8108772314560104
driven_lanedir_median0.8905739050228418
driven_lanedir_min0.21214861604913837
in-drivable-lane_max2.950000000000042
in-drivable-lane_mean1.280000000000007
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0059151877595571, "sim_physics": 0.12907397590185463, "survival_time": 7.599999999999981, "driven_lanedir": 0.6335854808690953, "sim_render-ego": 0.06695840546959325, "in-drivable-lane": 2.549999999999991, "agent_compute-ego": 0.26225252057376663, "deviation-heading": 1.4236518871691557, "set_robot_commands": 0.1027414908534602, "deviation-center-line": 0.2653504640681014, "driven_lanedir_consec": 0.6335854808690953, "sim_compute_sim_state": 0.04180649236628884, "sim_compute_performance-ego": 0.07382512563153316, "sim_compute_robot_state-ego": 0.07956794374867489}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0227427352582985, "sim_physics": 0.12119228294096795, "survival_time": 8.299999999999983, "driven_lanedir": 0.8905739050228418, "sim_render-ego": 0.06335446058985698, "in-drivable-lane": 0.8500000000000014, "agent_compute-ego": 0.25248331334217483, "deviation-heading": 1.4300433593230906, "set_robot_commands": 0.10180930775332164, "deviation-center-line": 0.3827275259217235, "driven_lanedir_consec": 0.8905739050228418, "sim_compute_sim_state": 0.04038832704704928, "sim_compute_performance-ego": 0.07061935045632971, "sim_compute_robot_state-ego": 0.07624834560486207}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23156034419386445, "sim_physics": 0.13027661121808565, "survival_time": 2.5999999999999988, "driven_lanedir": 0.21214861604913837, "sim_render-ego": 0.06943290050213154, "in-drivable-lane": 0, "agent_compute-ego": 0.30193230739006627, "deviation-heading": 0.9153926956686912, "set_robot_commands": 0.10683029431563155, "deviation-center-line": 0.26844505816172753, "driven_lanedir_consec": 0.21214861604913837, "sim_compute_sim_state": 0.043772912942446195, "sim_compute_performance-ego": 0.08084243535995483, "sim_compute_robot_state-ego": 0.09004628658294678}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6182902646474224, "sim_physics": 0.1253513946607419, "survival_time": 12.850000000000048, "driven_lanedir": 1.2702233519266186, "sim_render-ego": 0.06723816292759045, "in-drivable-lane": 2.950000000000042, "agent_compute-ego": 0.27948086271026257, "deviation-heading": 2.357504744296126, "set_robot_commands": 0.10650528080268593, "deviation-center-line": 0.5865227354471323, "driven_lanedir_consec": 1.2702233519266186, "sim_compute_sim_state": 0.04179162645154426, "sim_compute_performance-ego": 0.07644399130854625, "sim_compute_robot_state-ego": 0.08271689730395602}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0915634440777335, "sim_physics": 0.1340177956081572, "survival_time": 10.500000000000014, "driven_lanedir": 1.047854803412358, "sim_render-ego": 0.06690790426163447, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.2838892278217134, "deviation-heading": 1.6673596202703618, "set_robot_commands": 0.10714113712310792, "deviation-center-line": 0.5092410440752544, "driven_lanedir_consec": 1.047854803412358, "sim_compute_sim_state": 0.04169876348404657, "sim_compute_performance-ego": 0.0751691012155442, "sim_compute_robot_state-ego": 0.08321764582679385}}
set_robot_commands_max0.10714113712310792
set_robot_commands_mean0.10500550216964148
set_robot_commands_median0.10650528080268593
set_robot_commands_min0.10180930775332164
sim_compute_performance-ego_max0.08084243535995483
sim_compute_performance-ego_mean0.07538000079438163
sim_compute_performance-ego_median0.0751691012155442
sim_compute_performance-ego_min0.07061935045632971
sim_compute_robot_state-ego_max0.09004628658294678
sim_compute_robot_state-ego_mean0.08235942381344673
sim_compute_robot_state-ego_median0.08271689730395602
sim_compute_robot_state-ego_min0.07624834560486207
sim_compute_sim_state_max0.043772912942446195
sim_compute_sim_state_mean0.04189162445827503
sim_compute_sim_state_median0.04179162645154426
sim_compute_sim_state_min0.04038832704704928
sim_physics_max0.1340177956081572
sim_physics_mean0.12798241206596148
sim_physics_median0.12907397590185463
sim_physics_min0.12119228294096795
sim_render-ego_max0.06943290050213154
sim_render-ego_mean0.06677836675016133
sim_render-ego_median0.06695840546959325
sim_render-ego_min0.06335446058985698
simulation-passed1
survival_time_max12.850000000000048
survival_time_mean8.370000000000005
survival_time_min2.5999999999999988
No reset possible
237453746sebastian glatzaido2-LF-sim-testingstep1-simulationsuccessyesip-172-31-25-98-20620:15:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.10099507669212504
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.1746918139634309
agent_compute-ego_mean0.14250362250440285
agent_compute-ego_median0.12717993847735518
agent_compute-ego_min0.11115969930376324
deviation-center-line_max0.2838635700333795
deviation-center-line_mean0.12786165368054708
deviation-center-line_min0.07112529346797256
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3391682685652287
deviation-heading_median0.32928385103533875
deviation-heading_min0.19401296908406307
driven_any_max2.1706243860917107
driven_any_mean0.9759490378276146
driven_any_median1.0117660515775693
driven_any_min0.23626560261560617
driven_lanedir_consec_max1.919400421063832
driven_lanedir_consec_mean0.6896171461819246
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max1.919400421063832
driven_lanedir_mean0.6896171461819246
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.5899999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.13128854168785942, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.07098269462585449, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1746918139634309, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.1040948541076095, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04312584135267469, "sim_compute_performance-ego": 0.0760459061022158, "sim_compute_robot_state-ego": 0.08310554204163728}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.12048848002564672, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06506122327318378, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15893763654372273, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.09673552419625076, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.04085377618378284, "sim_compute_performance-ego": 0.07259392738342285, "sim_compute_robot_state-ego": 0.07618493659823548}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.15508344594170065, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.06849127657273237, "in-drivable-lane": 0, "agent_compute-ego": 0.16684973941129796, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.11037328663994284, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.04576858352212345, "sim_compute_performance-ego": 0.0731964391820571, "sim_compute_robot_state-ego": 0.08601093292236328}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.1373905086517334, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.068305082321167, "in-drivable-lane": 0, "agent_compute-ego": 0.16965231895446778, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.10635169982910156, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.0438078498840332, "sim_compute_performance-ego": 0.07239619255065918, "sim_compute_robot_state-ego": 0.07988656997680664}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.13199362875540047, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06887406940701642, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.16903969305980054, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.10892513432080232, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.04308419287959232, "sim_compute_performance-ego": 0.07771414141111736, "sim_compute_robot_state-ego": 0.0855656515193891}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.11999278165856186, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.06680511455146634, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.1653850759778704, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.10264807817887286, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.04141256760577766, "sim_compute_performance-ego": 0.0760656230303706, "sim_compute_robot_state-ego": 0.08294863116984465}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.1306660430771964, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.06594166159629822, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.15485321198190963, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.10419172474316188, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.04107913800648281, "sim_compute_performance-ego": 0.07486196075166975, "sim_compute_robot_state-ego": 0.08269126500402178}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.0918528125399635, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.047319650650024414, "in-drivable-lane": 0, "agent_compute-ego": 0.11115969930376324, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.06897233781360444, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.029284284228370303, "sim_compute_performance-ego": 0.05035451480320522, "sim_compute_robot_state-ego": 0.05485438165210542}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.099504208160659, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.05073627779039286, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.1257332098686089, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.08223420482570842, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.03356350074380131, "sim_compute_performance-ego": 0.05701646562349998, "sim_compute_robot_state-ego": 0.06307074579141908}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.10269927111538972, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.05053903406316584, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.1271657250144265, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.08007894862781871, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.03500947952270508, "sim_compute_performance-ego": 0.05786813389171253, "sim_compute_robot_state-ego": 0.05819113037802957}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.09454699305744914, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.04951558484659566, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.12717993847735518, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.07668042492556881, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.03228694742376154, "sim_compute_performance-ego": 0.05500716667670708, "sim_compute_robot_state-ego": 0.05967788262800737}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.09496601138796124, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.048916493143354146, "in-drivable-lane": 0, "agent_compute-ego": 0.11737771545137678, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.0713031462260655, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.031650934900556295, "sim_compute_performance-ego": 0.053821827684129984, "sim_compute_robot_state-ego": 0.05792453459330967}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.08673824983484604, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.04905211224275477, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.12687049660028196, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.07722775141398112, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.03055897881002987, "sim_compute_performance-ego": 0.05728602876850203, "sim_compute_robot_state-ego": 0.05586604511036592}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.09898602520978007, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.050037127953988535, "in-drivable-lane": 0, "agent_compute-ego": 0.123650003362585, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.0771725442674425, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.03268294864230686, "sim_compute_performance-ego": 0.05393622539661549, "sim_compute_robot_state-ego": 0.060504259886565034}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.08347569026199042, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.04957724786272236, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.11900805959514545, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.07214815008874033, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.03162240748311959, "sim_compute_performance-ego": 0.0565953628689635, "sim_compute_robot_state-ego": 0.05874191779716342}}
set_robot_commands_max0.11037328663994284
set_robot_commands_mean0.08927585401364478
set_robot_commands_median0.08223420482570842
set_robot_commands_min0.06897233781360444
sim_compute_performance-ego_max0.07771414141111736
sim_compute_performance-ego_mean0.06431732774165656
sim_compute_performance-ego_median0.05786813389171253
sim_compute_performance-ego_min0.05035451480320522
sim_compute_robot_state-ego_max0.08601093292236328
sim_compute_robot_state-ego_mean0.06968162847128426
sim_compute_robot_state-ego_median0.06307074579141908
sim_compute_robot_state-ego_min0.05485438165210542
sim_compute_sim_state_max0.04576858352212345
sim_compute_sim_state_mean0.03705276207927452
sim_compute_sim_state_median0.03500947952270508
sim_compute_sim_state_min0.029284284228370303
sim_physics_max0.15508344594170065
sim_physics_mean0.1119781794244092
sim_physics_median0.10269927111538972
sim_physics_min0.08347569026199042
sim_render-ego_max0.07098269462585449
sim_render-ego_mean0.0580103100600478
sim_render-ego_median0.05073627779039286
sim_render-ego_min0.047319650650024414
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.503333333333331
survival_time_min0.8500000000000002
No reset possible
236943729jiang pengLF sim test - whaido2-LF-sim-testingstep1-simulationerroryesip-172-31-25-98-20620:33:00
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
236773716jiang pengSecond test -RGB- TH-jpaido2-LF-sim-validationstep1-simulationfailedyesip-172-31-25-98-20620:03:07
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 58, in on_received_get_commands
               ||     action = (action + np.random.normal(0,0.2,size=env.action_space.shape[0])).clip(env.action_space.low, env.action_space.high)
               || NameError: name 'env' is not defined
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
235183667FANG MEIYI 🇸🇬testaido2-LFV-sim-testingstep1-simulationerroryesip-172-31-25-98-20620:17:05
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
234943662Hui-Kuo Yang 🇹🇼Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationerroryesip-172-31-25-98-20620:01:40
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
234843660FANG MEIYI 🇸🇬testaido2-LFVI-sim-validationstep1-simulationerroryesip-172-31-25-98-20620:17:43
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
234803657FANG MEIYI 🇸🇬testaido2-LFV-sim-testingstep1-simulationerroryesip-172-31-25-98-20620:29:48
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
234753656jiang pengRL-TH-xyzaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-25-98-20620:11:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6601686524415251
survival_time_median13.300000000000054
deviation-center-line_median0.3934561963593459
in-drivable-lane_median0.9999999999999964


other stats
agent_compute-ego_max0.10631141627406722
agent_compute-ego_mean0.10467877879828838
agent_compute-ego_median0.10415000836054485
agent_compute-ego_min0.10398321273999336
deviation-center-line_max0.7159369900356997
deviation-center-line_mean0.3888198686152492
deviation-center-line_min0.1368864080648932
deviation-heading_max2.585660156294618
deviation-heading_mean1.4996111984810372
deviation-heading_median1.6624986916468236
deviation-heading_min0.5509723559289654
driven_any_max2.5776326431550514
driven_any_mean1.9463457670700948
driven_any_median2.0581802629742074
driven_any_min1.0837226204642323
driven_lanedir_consec_max2.5263006027656463
driven_lanedir_consec_mean1.699653387168611
driven_lanedir_consec_min0.9934225797598628
driven_lanedir_max2.5263006027656463
driven_lanedir_mean1.699653387168611
driven_lanedir_median1.6601686524415251
driven_lanedir_min0.9934225797598628
in-drivable-lane_max1.40000000000002
in-drivable-lane_mean0.7700000000000065
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.0581802629742074, "sim_physics": 0.05886234656471168, "survival_time": 13.550000000000058, "driven_lanedir": 1.6601686524415251, "sim_render-ego": 0.039102821772388864, "in-drivable-lane": 1.40000000000002, "agent_compute-ego": 0.10631141627406722, "deviation-heading": 1.6624986916468236, "set_robot_commands": 0.05713763272190446, "deviation-center-line": 0.4058166881770972, "driven_lanedir_consec": 1.6601686524415251, "sim_compute_sim_state": 0.02479272047092114, "sim_compute_performance-ego": 0.04168398617818347, "sim_compute_robot_state-ego": 0.04350836602524198}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0837226204642323, "sim_physics": 0.06304141850147432, "survival_time": 5.14999999999999, "driven_lanedir": 0.9934225797598628, "sim_render-ego": 0.03816614104706107, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.1040204960165672, "deviation-heading": 0.7692391563639723, "set_robot_commands": 0.056564981497607185, "deviation-center-line": 0.29200306043920987, "driven_lanedir_consec": 0.9934225797598628, "sim_compute_sim_state": 0.025330707864853943, "sim_compute_performance-ego": 0.042102288273931705, "sim_compute_robot_state-ego": 0.04416420853253707}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.5776326431550514, "sim_physics": 0.05835317532221476, "survival_time": 14.950000000000076, "driven_lanedir": 2.5263006027656463, "sim_render-ego": 0.038137925465901695, "in-drivable-lane": 0, "agent_compute-ego": 0.10415000836054485, "deviation-heading": 2.585660156294618, "set_robot_commands": 0.05756393273671468, "deviation-center-line": 0.7159369900356997, "driven_lanedir_consec": 2.5263006027656463, "sim_compute_sim_state": 0.024626015027364095, "sim_compute_performance-ego": 0.04175795555114746, "sim_compute_robot_state-ego": 0.043017958799997966}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.42936047926378, "sim_physics": 0.06283736945991229, "survival_time": 13.300000000000054, "driven_lanedir": 2.0907493794664003, "sim_render-ego": 0.04017104062818943, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.10492876060026927, "deviation-heading": 1.929685632170806, "set_robot_commands": 0.05686915906748377, "deviation-center-line": 0.3934561963593459, "driven_lanedir_consec": 2.0907493794664003, "sim_compute_sim_state": 0.024763374400318117, "sim_compute_performance-ego": 0.04199275307189253, "sim_compute_robot_state-ego": 0.04431597361887308}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5828328294932026, "sim_physics": 0.06366385761489216, "survival_time": 5.849999999999987, "driven_lanedir": 1.2276257214096211, "sim_render-ego": 0.0381571900131356, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.10398321273999336, "deviation-heading": 0.5509723559289654, "set_robot_commands": 0.05645166095505413, "deviation-center-line": 0.1368864080648932, "driven_lanedir_consec": 1.2276257214096211, "sim_compute_sim_state": 0.025312050794943784, "sim_compute_performance-ego": 0.04227428354768672, "sim_compute_robot_state-ego": 0.04385749906556219}}
set_robot_commands_max0.05756393273671468
set_robot_commands_mean0.05691747339575283
set_robot_commands_median0.05686915906748377
set_robot_commands_min0.05645166095505413
sim_compute_performance-ego_max0.04227428354768672
sim_compute_performance-ego_mean0.041962253324568384
sim_compute_performance-ego_median0.04199275307189253
sim_compute_performance-ego_min0.04168398617818347
sim_compute_robot_state-ego_max0.04431597361887308
sim_compute_robot_state-ego_mean0.04377280120844246
sim_compute_robot_state-ego_median0.04385749906556219
sim_compute_robot_state-ego_min0.043017958799997966
sim_compute_sim_state_max0.025330707864853943
sim_compute_sim_state_mean0.024964973711680216
sim_compute_sim_state_median0.02479272047092114
sim_compute_sim_state_min0.024626015027364095
sim_physics_max0.06366385761489216
sim_physics_mean0.061351633492641035
sim_physics_median0.06283736945991229
sim_physics_min0.05835317532221476
sim_render-ego_max0.04017104062818943
sim_render-ego_mean0.03874702378533533
sim_render-ego_median0.03816614104706107
sim_render-ego_min0.038137925465901695
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.560000000000032
survival_time_min5.14999999999999
No reset possible
233633612Riza Velioglu 🇩🇪aido2-LFVI-sim-testingstep1-simulationerroryesip-172-31-25-98-20620:04:50
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
233353601Victor Adolfo Romero Cano 🇨🇴aido2-LFVI-sim-validationstep1-simulationsuccessyesip-172-31-25-98-20620:08:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.493517638549009
survival_time_median2.3999999999999995
deviation-center-line_median0.09791133281082
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.16230631176429458
agent_compute-ego_mean0.13997344048398536
agent_compute-ego_median0.12834014211382186
agent_compute-ego_min0.12199000517527264
deviation-center-line_max0.2348196785686717
deviation-center-line_mean0.13547481992266058
deviation-center-line_min0.06216029860587694
deviation-heading_max0.8115272458314897
deviation-heading_mean0.49959867397150787
deviation-heading_median0.46504862964833654
deviation-heading_min0.30044835691402494
driven_any_max2.1864003300000694
driven_any_mean1.1068208197848532
driven_any_median0.9410513078477724
driven_any_min0.34749292376309954
driven_lanedir_consec_max1.826231945363564
driven_lanedir_consec_mean0.804744013449103
driven_lanedir_consec_min0.3325249708009643
driven_lanedir_max1.826231945363564
driven_lanedir_mean0.804828147320482
driven_lanedir_median0.493517638549009
driven_lanedir_min0.3325249708009643
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.5599999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.2221743094770214, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06639673438253282, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.16230631176429458, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.10713294186169588, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.04207918915567519, "sim_compute_performance-ego": 0.07244503045383888, "sim_compute_robot_state-ego": 0.08068058762369276, "sim_compute_robot_state-npc0": 0.07643573797201808, "sim_compute_robot_state-npc1": 0.07431730741186987, "sim_compute_robot_state-npc2": 0.07223542430732824, "sim_compute_robot_state-npc3": 0.07062024104444287}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.2295380405017308, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06774954284940447, "in-drivable-lane": 0, "agent_compute-ego": 0.16084939241409302, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.09989900248391288, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.04506926877158029, "sim_compute_performance-ego": 0.07432244505201067, "sim_compute_robot_state-ego": 0.08132364920207433, "sim_compute_robot_state-npc0": 0.07591501304081508, "sim_compute_robot_state-npc1": 0.0757906266621181, "sim_compute_robot_state-npc2": 0.0760559013911656, "sim_compute_robot_state-npc3": 0.08192168814795357}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.15289264512293546, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.04986950263236333, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.12638135095244474, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.0748203564616083, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.031047839562869765, "sim_compute_performance-ego": 0.05506982386690899, "sim_compute_robot_state-ego": 0.06308819020836098, "sim_compute_robot_state-npc0": 0.055571627848356675, "sim_compute_robot_state-npc1": 0.05491085422849192, "sim_compute_robot_state-npc2": 0.0561131991229011, "sim_compute_robot_state-npc3": 0.05671353710507883}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.15402661760648093, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.05062606930732727, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.12199000517527264, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.07364976902802785, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.030529022216796875, "sim_compute_performance-ego": 0.05522028605143229, "sim_compute_robot_state-ego": 0.05788964529832205, "sim_compute_robot_state-npc0": 0.05672599375247955, "sim_compute_robot_state-npc1": 0.05404298007488251, "sim_compute_robot_state-npc2": 0.052592188119888306, "sim_compute_robot_state-npc3": 0.05435555676619211}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.15613865852355957, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.047493968691144674, "in-drivable-lane": 0, "agent_compute-ego": 0.12834014211382186, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.07736072086152576, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03051233291625977, "sim_compute_performance-ego": 0.05377528780982608, "sim_compute_robot_state-ego": 0.05518544287908645, "sim_compute_robot_state-npc0": 0.05469702538989839, "sim_compute_robot_state-npc1": 0.05548999423072452, "sim_compute_robot_state-npc2": 0.054498695191882905, "sim_compute_robot_state-npc3": 0.05519781793866839}}
set_robot_commands_max0.10713294186169588
set_robot_commands_mean0.08657255813935413
set_robot_commands_median0.07736072086152576
set_robot_commands_min0.07364976902802785
sim_compute_performance-ego_max0.07432244505201067
sim_compute_performance-ego_mean0.0621665746468034
sim_compute_performance-ego_median0.05522028605143229
sim_compute_performance-ego_min0.05377528780982608
sim_compute_robot_state-ego_max0.08132364920207433
sim_compute_robot_state-ego_mean0.06763350304230731
sim_compute_robot_state-ego_median0.06308819020836098
sim_compute_robot_state-ego_min0.05518544287908645
sim_compute_robot_state-npc0_max0.07643573797201808
sim_compute_robot_state-npc0_mean0.06386907960071356
sim_compute_robot_state-npc0_median0.05672599375247955
sim_compute_robot_state-npc0_min0.05469702538989839
sim_compute_robot_state-npc1_max0.0757906266621181
sim_compute_robot_state-npc1_mean0.06291035252161739
sim_compute_robot_state-npc1_median0.05548999423072452
sim_compute_robot_state-npc1_min0.05404298007488251
sim_compute_robot_state-npc2_max0.0760559013911656
sim_compute_robot_state-npc2_mean0.062299081626633224
sim_compute_robot_state-npc2_median0.0561131991229011
sim_compute_robot_state-npc2_min0.052592188119888306
sim_compute_robot_state-npc3_max0.08192168814795357
sim_compute_robot_state-npc3_mean0.06376176820046717
sim_compute_robot_state-npc3_median0.05671353710507883
sim_compute_robot_state-npc3_min0.05435555676619211
sim_compute_sim_state_max0.04506926877158029
sim_compute_sim_state_mean0.03584753052463638
sim_compute_sim_state_median0.031047839562869765
sim_compute_sim_state_min0.03051233291625977
sim_physics_max0.2295380405017308
sim_physics_mean0.18295405424634564
sim_physics_median0.15613865852355957
sim_physics_min0.15289264512293546
sim_render-ego_max0.06774954284940447
sim_render-ego_mean0.05642716357255452
sim_render-ego_median0.05062606930732727
sim_render-ego_min0.047493968691144674
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.789999999999997
survival_time_min1.0500000000000005
No reset possible
232882903Julian ZillyBaseline-IL-logs-tensorflowaido2-LFV-sim-testingstep1-simulationerroryesip-172-31-25-98-20620:10:26
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
231753576Bhairav Mehtachallenge-aido_LF-template-pytorchaido2-LFVI-sim-validationstep1-simulationerroryesip-172-31-25-98-20620:02:34
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible