Duckietown Challenges Home Challenges Submissions

Evaluator 1855

ID1855
evaluatorreg11
ownerI don't have one πŸ˜€
machinearchimede
processreg11
versiond-c:6.0.31;d-c-r:6.0.15
first heard
last heard
statusinactive
# evaluating
# success15 33299
# timeout
# failed1 33403
# error
# aborted
# host-error1 33301
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
334196836Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg110:24:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median14.950000000000076
deviation-center-line_median0.4054131312023622
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.03066341479619344
agent_compute-ego_mean0.029295109987258903
agent_compute-ego_median0.02926992495854696
agent_compute-ego_min0.027988205750783285
complete-iteration_max0.2889590350786845
complete-iteration_mean0.26927841210365294
complete-iteration_median0.2669871326287587
complete-iteration_min0.26002070665359495
deviation-center-line_max0.6863069918481528
deviation-center-line_mean0.41778364329376794
deviation-center-line_min0.13942680180416853
deviation-heading_max3.7258518640401217
deviation-heading_mean1.8869656519179927
deviation-heading_median1.6198720948235377
deviation-heading_min0.486072248607516
driven_any_max1.3686924727581474e-13
driven_any_mean8.215966626878722e-14
driven_any_median1.3278267374516872e-13
driven_any_min0.0
driven_lanedir_consec_max1.7821788787841797e-05
driven_lanedir_consec_mean3.564357757568359e-06
driven_lanedir_consec_min0.0
driven_lanedir_max1.7821788787841797e-05
driven_lanedir_mean3.564357757568359e-06
driven_lanedir_median0.0
driven_lanedir_min0.0
get_state_dump_max0.02031842311223348
get_state_dump_mean0.019769296169281005
get_state_dump_median0.019890418052673334
get_state_dump_min0.01900667985280355
get_ui_image_max0.04913410902023316
get_ui_image_mean0.04747024472554525
get_ui_image_median0.047556297779083254
get_ui_image_min0.04627162377039591
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.047389376958211264, "step_physics": 0.09513272921244303, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.01992188851038615, "sim_render-ego": 0.007987515131632487, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029562260309855145, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.26749191919962567, "set_robot_commands": 0.007780781586964925, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02865360498428345, "sim_compute_performance-ego": 0.006773245334625244, "sim_compute_robot_state-ego": 0.012135756015777589, "sim_compute_robot_state-parked0": 0.011914376417795818}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.04913410902023316, "step_physics": 0.09341837088267008, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.019407970905303953, "sim_render-ego": 0.008091718355814615, "in-drivable-lane": 0.0, "agent_compute-ego": 0.028650660514831543, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.2665919319788615, "set_robot_commands": 0.0077916105588277185, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02858151833216349, "sim_compute_performance-ego": 0.00699584166208903, "sim_compute_robot_state-ego": 0.012326023578643798, "sim_compute_robot_state-parked0": 0.011954334576924642}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.047460439999898275, "step_physics": 0.0900462261835734, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.02031842311223348, "sim_render-ego": 0.008255549271901448, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029746955235799153, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.26543305555979413, "set_robot_commands": 0.00816097656885783, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02913241465886434, "sim_compute_performance-ego": 0.007071582476298014, "sim_compute_robot_state-ego": 0.012446207205454508, "sim_compute_robot_state-parked0": 0.012544705867767332}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.04627162377039591, "step_physics": 0.08989106734593709, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.01978096882502238, "sim_render-ego": 0.008019891579945882, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02888092279434204, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.26002070665359495, "set_robot_commands": 0.007765849431355794, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02820852756500244, "sim_compute_performance-ego": 0.0069658176104227705, "sim_compute_robot_state-ego": 0.012332255840301514, "sim_compute_robot_state-parked0": 0.011664698918660482}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.04785438140233358, "step_physics": 0.09342195908228557, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.020087835788726808, "sim_render-ego": 0.008319434324900309, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030589393774668378, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.2692259709040324, "set_robot_commands": 0.008173136711120606, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.028324705759684245, "sim_compute_performance-ego": 0.007149686813354492, "sim_compute_robot_state-ego": 0.012774994373321531, "sim_compute_robot_state-parked0": 0.012283480962117514}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 0.0, "get_ui_image": 0.04786668539047241, "step_physics": 0.09246901194254556, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.02006126085917155, "sim_render-ego": 0.008320549329121907, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03066341479619344, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.267382333278656, "set_robot_commands": 0.007872163454691569, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.028367237250010172, "sim_compute_performance-ego": 0.007023292382558187, "sim_compute_robot_state-ego": 0.012287872632344564, "sim_compute_robot_state-parked0": 0.012199521859486898}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.04799158811569214, "step_physics": 0.11346425692240396, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.02008075475692749, "sim_render-ego": 0.008433462778727214, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02965231021245321, "deviation-heading": 0.486072248607516, "complete-iteration": 0.2889590350786845, "set_robot_commands": 0.008141674200693767, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.028600727717081702, "sim_compute_performance-ego": 0.0071368575096130375, "sim_compute_robot_state-ego": 0.012887685298919678, "sim_compute_robot_state-parked0": 0.012311546802520753}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.046648916403452555, "step_physics": 0.11233316977818808, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.01985894759496053, "sim_render-ego": 0.008223433494567872, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02897758960723877, "deviation-heading": 0.486072248607516, "complete-iteration": 0.28452215433120726, "set_robot_commands": 0.007957278887430827, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.028329707781473795, "sim_compute_performance-ego": 0.007067346572875976, "sim_compute_robot_state-ego": 0.012789274056752524, "sim_compute_robot_state-parked0": 0.0120974596341451}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 1.3278267374516872e-13, "get_ui_image": 0.04765215555826823, "step_physics": 0.09440084218978882, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.01916823148727417, "sim_render-ego": 0.007764232158660888, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02823938687642415, "deviation-heading": 2.800123339068113, "complete-iteration": 0.26309410572052, "set_robot_commands": 0.0074814804395039874, "deviation-center-line": 0.6489654322483692, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.028118353684743247, "sim_compute_performance-ego": 0.0066221300760904945, "sim_compute_robot_state-ego": 0.011821715831756592, "sim_compute_robot_state-parked0": 0.011587684949239094}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 1.3278267374516872e-13, "get_ui_image": 0.04643317063649496, "step_physics": 0.09409340937932333, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.01900667985280355, "sim_render-ego": 0.007684720357259115, "in-drivable-lane": 0.0, "agent_compute-ego": 0.027988205750783285, "deviation-heading": 2.800123339068113, "complete-iteration": 0.26006290833155316, "set_robot_commands": 0.007475183010101318, "deviation-center-line": 0.6489654322483692, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02739511807759603, "sim_compute_performance-ego": 0.006565994421641032, "sim_compute_robot_state-ego": 0.011737182935078938, "sim_compute_robot_state-parked0": 0.011452782154083251}}
set_robot_commands_max0.008173136711120606
set_robot_commands_mean0.007860013484954834
set_robot_commands_median0.007831887006759644
set_robot_commands_min0.007475183010101318
sim_compute_performance-ego_max0.007149686813354492
sim_compute_performance-ego_mean0.006937179485956828
sim_compute_performance-ego_median0.007009567022323609
sim_compute_performance-ego_min0.006565994421641032
sim_compute_robot_state-ego_max0.012887685298919678
sim_compute_robot_state-ego_mean0.012353896776835124
sim_compute_robot_state-ego_median0.012329139709472655
sim_compute_robot_state-ego_min0.011737182935078938
sim_compute_robot_state-parked0_max0.012544705867767332
sim_compute_robot_state-parked0_mean0.01200105921427409
sim_compute_robot_state-parked0_median0.012025897105534871
sim_compute_robot_state-parked0_min0.011452782154083251
sim_compute_sim_state_max0.02913241465886434
sim_compute_sim_state_mean0.028371191581090294
sim_compute_sim_state_median0.028348472515741983
sim_compute_sim_state_min0.02739511807759603
sim_render-ego_max0.008433462778727214
sim_render-ego_mean0.008110050678253173
sim_render-ego_median0.008157575925191243
sim_render-ego_min0.007684720357259115
simulation-passed1
step_physics_max0.11346425692240396
step_physics_mean0.09686710429191588
step_physics_median0.09375768423080444
step_physics_min0.08989106734593709
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
334036828Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simfailednoreg110:03:33
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 443, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 27 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 666, in scoring_context
    yield cie
  File "experiment_manager.py", line 607, in <module>
    wrap(cie)
  File "experiment_manager.py", line 595, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 43, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 213, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 447, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
334006826Liam PaullΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg110:24:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median14.950000000000076
deviation-center-line_median0.4054131312023622
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.031981493631998696
agent_compute-ego_mean0.031051165580749513
agent_compute-ego_median0.030882366100947065
agent_compute-ego_min0.030601255098978677
complete-iteration_max0.2900362467765808
complete-iteration_mean0.26909088937441505
complete-iteration_median0.26544980684916175
complete-iteration_min0.2564909116427104
deviation-center-line_max0.6863069918481528
deviation-center-line_mean0.41778364329376794
deviation-center-line_min0.13942680180416853
deviation-heading_max3.7258518640401217
deviation-heading_mean1.8869656519179927
deviation-heading_median1.6198720948235377
deviation-heading_min0.486072248607516
driven_any_max1.3686924727581474e-13
driven_any_mean8.215966626878722e-14
driven_any_median1.3278267374516872e-13
driven_any_min0.0
driven_lanedir_consec_max1.7821788787841797e-05
driven_lanedir_consec_mean3.564357757568359e-06
driven_lanedir_consec_min0.0
driven_lanedir_max1.7821788787841797e-05
driven_lanedir_mean3.564357757568359e-06
driven_lanedir_median0.0
driven_lanedir_min0.0
get_state_dump_max0.02112335999806722
get_state_dump_mean0.020983564535776773
get_state_dump_median0.021015549898147586
get_state_dump_min0.0207862917582194
get_ui_image_max0.04758824189503988
get_ui_image_mean0.046757077058156335
get_ui_image_median0.046680094798405965
get_ui_image_min0.04586564381917318
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.046773297786712645, "step_physics": 0.08825713872909546, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.0207862917582194, "sim_render-ego": 0.00835992415746053, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030801289081573487, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.26672244787216187, "set_robot_commands": 0.008851874669392903, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.0287914514541626, "sim_compute_performance-ego": 0.007395736376444499, "sim_compute_robot_state-ego": 0.01340128501256307, "sim_compute_robot_state-parked0": 0.01306246280670166}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.04586564381917318, "step_physics": 0.08726752519607545, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.02101372639338175, "sim_render-ego": 0.007690002123514811, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030838220914204916, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.2564909116427104, "set_robot_commands": 0.006704177856445313, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.028392602602640787, "sim_compute_performance-ego": 0.006363933881123861, "sim_compute_robot_state-ego": 0.010496389071146648, "sim_compute_robot_state-parked0": 0.011615797678629558}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.04608108202616374, "step_physics": 0.08679760058720906, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.0211225159962972, "sim_render-ego": 0.00843347708384196, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030601255098978677, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.2634980607032776, "set_robot_commands": 0.00846331516901652, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.028901593685150148, "sim_compute_performance-ego": 0.007219523588816325, "sim_compute_robot_state-ego": 0.012951016426086426, "sim_compute_robot_state-parked0": 0.012678517500559488}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.046517574787139894, "step_physics": 0.0872186303138733, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.02101737340291341, "sim_render-ego": 0.0083605162302653, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03070073207219442, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.2631355595588684, "set_robot_commands": 0.008261854648590089, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.028810800711313884, "sim_compute_performance-ego": 0.007096765041351319, "sim_compute_robot_state-ego": 0.012596660455067951, "sim_compute_robot_state-parked0": 0.01230748176574707}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.04719631671905518, "step_physics": 0.09000449975331624, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.020850485960642495, "sim_render-ego": 0.008509623209635416, "in-drivable-lane": 0.0, "agent_compute-ego": 0.031981493631998696, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.2684256895383199, "set_robot_commands": 0.008371609846750895, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.028527085781097413, "sim_compute_performance-ego": 0.007276434103647868, "sim_compute_robot_state-ego": 0.012874244054158528, "sim_compute_robot_state-parked0": 0.012588943640391032}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 0.0, "get_ui_image": 0.04655665397644043, "step_physics": 0.08869433959325154, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.02087478240331014, "sim_render-ego": 0.008153379758199056, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0317687201499939, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.2633958745002747, "set_robot_commands": 0.00766831636428833, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.028426002661387124, "sim_compute_performance-ego": 0.006836308638254802, "sim_compute_robot_state-ego": 0.011880493958791098, "sim_compute_robot_state-parked0": 0.012290918032328287}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.04702011585235596, "step_physics": 0.11103730916976928, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.02109004259109497, "sim_render-ego": 0.008571792443593343, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03115252494812012, "deviation-heading": 0.486072248607516, "complete-iteration": 0.2900362467765808, "set_robot_commands": 0.008621804714202881, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02869242032368978, "sim_compute_performance-ego": 0.007413028081258138, "sim_compute_robot_state-ego": 0.01317966143290202, "sim_compute_robot_state-parked0": 0.0130095903078715}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.046586891810099285, "step_physics": 0.11060444434483846, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.02104604403177897, "sim_render-ego": 0.008460350036621093, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03103382349014282, "deviation-heading": 0.486072248607516, "complete-iteration": 0.28830448945363363, "set_robot_commands": 0.008426148891448975, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.028742133776346844, "sim_compute_performance-ego": 0.0073399806022644044, "sim_compute_robot_state-ego": 0.01291638692220052, "sim_compute_robot_state-parked0": 0.01290276845296224}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 1.3278267374516872e-13, "get_ui_image": 0.04738495190938314, "step_physics": 0.08713784376780193, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.020911022822062173, "sim_render-ego": 0.008622542222340901, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03070708513259888, "deviation-heading": 2.800123339068113, "complete-iteration": 0.2657101742426554, "set_robot_commands": 0.008727293014526367, "deviation-center-line": 0.6489654322483692, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.028725117842356363, "sim_compute_performance-ego": 0.007410055001576742, "sim_compute_robot_state-ego": 0.013055202960968015, "sim_compute_robot_state-parked0": 0.012786216735839843}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 1.3278267374516872e-13, "get_ui_image": 0.04758824189503988, "step_physics": 0.08766705354054768, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.02112335999806722, "sim_render-ego": 0.008458078702290853, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03092651128768921, "deviation-heading": 2.800123339068113, "complete-iteration": 0.26518943945566814, "set_robot_commands": 0.008188184897104898, "deviation-center-line": 0.6489654322483692, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02880445639292399, "sim_compute_performance-ego": 0.007229883670806885, "sim_compute_robot_state-ego": 0.012552806536356608, "sim_compute_robot_state-parked0": 0.012397700945536296}}
set_robot_commands_max0.008851874669392903
set_robot_commands_mean0.008228458007176717
set_robot_commands_median0.008398879369099936
set_robot_commands_min0.006704177856445313
sim_compute_performance-ego_max0.007413028081258138
sim_compute_performance-ego_mean0.007158164898554484
sim_compute_performance-ego_median0.007253158887227377
sim_compute_performance-ego_min0.006363933881123861
sim_compute_robot_state-ego_max0.01340128501256307
sim_compute_robot_state-ego_mean0.012590414683024086
sim_compute_robot_state-ego_median0.012895315488179526
sim_compute_robot_state-ego_min0.010496389071146648
sim_compute_robot_state-parked0_max0.01306246280670166
sim_compute_robot_state-parked0_mean0.0125640397866567
sim_compute_robot_state-parked0_median0.01263373057047526
sim_compute_robot_state-parked0_min0.011615797678629558
sim_compute_sim_state_max0.028901593685150148
sim_compute_sim_state_mean0.028681366523106894
sim_compute_sim_state_median0.028733625809351605
sim_compute_sim_state_min0.028392602602640787
sim_render-ego_max0.008622542222340901
sim_render-ego_mean0.008361968596776327
sim_render-ego_median0.008445777893066407
sim_render-ego_min0.007690002123514811
simulation-passed1
step_physics_max0.11103730916976928
step_physics_mean0.09246863849957784
step_physics_median0.08796209613482157
step_physics_min0.08679760058720906
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
333996825Liam PaullΒ πŸ‡¨πŸ‡¦baseline-duckietownaido5-LF-sim-validationLFv-simsuccessnoreg110:14:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.918854824166718
survival_time_median7.374999999999982
deviation-center-line_median0.45021947571887655
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.03209887298883176
agent_compute-ego_mean0.03132159102808915
agent_compute-ego_median0.03132099819434647
agent_compute-ego_min0.03032332619810416
complete-iteration_max0.2860118675898839
complete-iteration_mean0.2723699623355871
complete-iteration_median0.2706759610371283
complete-iteration_min0.26016528826010854
deviation-center-line_max0.7074449963052348
deviation-center-line_mean0.41226867828617897
deviation-center-line_min0.1680619666897364
deviation-heading_max3.073141855961695
deviation-heading_mean1.3546023217741434
deviation-heading_median1.155610626130846
deviation-heading_min1.0445212786668394
driven_any_max1.939933114020438
driven_any_mean0.9694442555405032
driven_any_median0.934233391321263
driven_any_min0.6321706294806734
driven_lanedir_consec_max1.858724208600455
driven_lanedir_consec_mean0.941733232372471
driven_lanedir_consec_min0.6173395398355699
driven_lanedir_max1.858724208600455
driven_lanedir_mean0.941733232372471
driven_lanedir_median0.918854824166718
driven_lanedir_min0.6173395398355699
get_state_dump_max0.021009617646535236
get_state_dump_mean0.020883825396850575
get_state_dump_median0.02090341065513733
get_state_dump_min0.02069558752210517
get_ui_image_max0.04901217377704123
get_ui_image_mean0.047168574412454214
get_ui_image_median0.04719271271170436
get_ui_image_min0.04611180016868993
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.1171198667141111, "get_ui_image": 0.047128518873995, "step_physics": 0.09223827584223314, "survival_time": 8.79999999999999, "driven_lanedir": 1.1040128929312938, "get_state_dump": 0.020837474953044544, "sim_render-ego": 0.00809007612141696, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03147802298719233, "deviation-heading": 1.1532157692219407, "complete-iteration": 0.26727447184649383, "set_robot_commands": 0.0069296956062316895, "deviation-center-line": 0.4693553729395965, "driven_lanedir_consec": 1.1040128929312938, "sim_compute_sim_state": 0.03036310456015847, "sim_compute_performance-ego": 0.00676901638507843, "sim_compute_robot_state-ego": 0.011388893831859936, "sim_compute_robot_state-parked0": 0.01178416203368794}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.939933114020438, "get_ui_image": 0.04734260479609172, "step_physics": 0.09330808003743488, "survival_time": 14.950000000000076, "driven_lanedir": 1.858724208600455, "get_state_dump": 0.021009617646535236, "sim_render-ego": 0.008180980682373046, "in-drivable-lane": 0.0, "agent_compute-ego": 0.031164345741271977, "deviation-heading": 3.073141855961695, "complete-iteration": 0.2758994992574056, "set_robot_commands": 0.007256149450937907, "deviation-center-line": 0.7074449963052348, "driven_lanedir_consec": 1.858724208600455, "sim_compute_sim_state": 0.036617857615152995, "sim_compute_performance-ego": 0.006828603744506836, "sim_compute_robot_state-ego": 0.011592354774475098, "sim_compute_robot_state-parked0": 0.012337425549825032}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 0.964106702411376, "get_ui_image": 0.04611180016868993, "step_physics": 0.08955374830647518, "survival_time": 7.599999999999981, "driven_lanedir": 0.94637633742675, "get_state_dump": 0.02069558752210517, "sim_render-ego": 0.00770035699794167, "in-drivable-lane": 0.0, "agent_compute-ego": 0.031610807305888125, "deviation-heading": 1.4281581710581648, "complete-iteration": 0.26016528826010854, "set_robot_commands": 0.006710011708109002, "deviation-center-line": 0.4882693118708183, "driven_lanedir_consec": 0.94637633742675, "sim_compute_sim_state": 0.029087752103805545, "sim_compute_performance-ego": 0.006228296380293996, "sim_compute_robot_state-ego": 0.01071911893392864, "sim_compute_robot_state-parked0": 0.011483187738217803}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 0.6321706294806734, "get_ui_image": 0.04621332065731872, "step_physics": 0.08948243365568273, "survival_time": 5.09999999999999, "driven_lanedir": 0.6173395398355699, "get_state_dump": 0.020824684816248277, "sim_render-ego": 0.007651618882721546, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03209887298883176, "deviation-heading": 1.055648684833447, "complete-iteration": 0.26026376088460285, "set_robot_commands": 0.006714881635179706, "deviation-center-line": 0.32321429738548035, "driven_lanedir_consec": 0.6173395398355699, "sim_compute_sim_state": 0.02843142958248363, "sim_compute_performance-ego": 0.006357071446437461, "sim_compute_robot_state-ego": 0.010565640879612342, "sim_compute_robot_state-parked0": 0.011659874635584214}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 0.6852824399258209, "get_ui_image": 0.046677227453752, "step_physics": 0.09050204970619896, "survival_time": 5.4999999999999885, "driven_lanedir": 0.6417304463466084, "get_state_dump": 0.020929356054826216, "sim_render-ego": 0.0079035607251254, "in-drivable-lane": 0.0, "agent_compute-ego": 0.032067454944957385, "deviation-heading": 1.078772032850268, "complete-iteration": 0.2684989170594649, "set_robot_commands": 0.006807505000721324, "deviation-center-line": 0.18083019657370916, "driven_lanedir_consec": 0.6417304463466084, "sim_compute_sim_state": 0.03435329090465199, "sim_compute_performance-ego": 0.006541757150129839, "sim_compute_robot_state-ego": 0.010819985649802468, "sim_compute_robot_state-parked0": 0.011634163423018025}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 0.7184752924337886, "get_ui_image": 0.04901217377704123, "step_physics": 0.09225457232931386, "survival_time": 5.749999999999988, "driven_lanedir": 0.6671928615434884, "get_state_dump": 0.02088331346926482, "sim_render-ego": 0.008510732650756836, "in-drivable-lane": 0.0, "agent_compute-ego": 0.031438317506209665, "deviation-heading": 1.307288746887583, "complete-iteration": 0.2783210401949675, "set_robot_commands": 0.007797983418340268, "deviation-center-line": 0.1680619666897364, "driven_lanedir_consec": 0.6671928615434884, "sim_compute_sim_state": 0.03618259844572648, "sim_compute_performance-ego": 0.006995325503141984, "sim_compute_robot_state-ego": 0.01236260870228643, "sim_compute_robot_state-parked0": 0.012615977162900178}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 1.0504117351297313, "get_ui_image": 0.04675996086814187, "step_physics": 0.11497510707739628, "survival_time": 8.249999999999982, "driven_lanedir": 1.0390638295654435, "get_state_dump": 0.020966016885006065, "sim_render-ego": 0.007811741395430131, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03120367888248328, "deviation-heading": 1.0445212786668394, "complete-iteration": 0.2859128561886874, "set_robot_commands": 0.006707518028490471, "deviation-center-line": 0.4718733203402027, "driven_lanedir_consec": 1.0390638295654435, "sim_compute_sim_state": 0.028510151487408264, "sim_compute_performance-ego": 0.006388804406830759, "sim_compute_robot_state-ego": 0.010590368328672469, "sim_compute_robot_state-parked0": 0.011735341043183295}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 0.90436008023115, "get_ui_image": 0.04725690654941373, "step_physics": 0.11436061092189977, "survival_time": 7.149999999999983, "driven_lanedir": 0.8913333109066859, "get_state_dump": 0.02099252580762743, "sim_render-ego": 0.007722436131297292, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03118297770306781, "deviation-heading": 1.052857748053875, "complete-iteration": 0.2860118675898839, "set_robot_commands": 0.006552952986497145, "deviation-center-line": 0.4310835784981567, "driven_lanedir_consec": 0.8913333109066859, "sim_compute_sim_state": 0.029058361386919355, "sim_compute_performance-ego": 0.006388440832391485, "sim_compute_robot_state-ego": 0.010772818451994782, "sim_compute_robot_state-parked0": 0.01145886207793976}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 0.9707465070111624, "get_ui_image": 0.04786011907789442, "step_physics": 0.0929626405628678, "survival_time": 7.649999999999981, "driven_lanedir": 0.9570790815035246, "get_state_dump": 0.02077616897283816, "sim_render-ego": 0.008305340810538896, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03032332619810416, "deviation-heading": 1.1944134471678691, "complete-iteration": 0.2709641721513536, "set_robot_commands": 0.008246033799414541, "deviation-center-line": 0.5150303165639445, "driven_lanedir_consec": 0.9570790815035246, "sim_compute_sim_state": 0.029690712885139813, "sim_compute_performance-ego": 0.007291013119267482, "sim_compute_robot_state-ego": 0.012670587090884936, "sim_compute_robot_state-parked0": 0.01258065186294855}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 0.7118361880467778, "get_ui_image": 0.04732311190220348, "step_physics": 0.0906828579149748, "survival_time": 5.699999999999988, "driven_lanedir": 0.6944798150648896, "get_state_dump": 0.020923507841009843, "sim_render-ego": 0.00861526372139914, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03064810602288497, "deviation-heading": 1.158005483039751, "complete-iteration": 0.270387749922903, "set_robot_commands": 0.008498948917054293, "deviation-center-line": 0.36752342569490953, "driven_lanedir_consec": 0.6944798150648896, "sim_compute_sim_state": 0.029845819138644033, "sim_compute_performance-ego": 0.007270484639887224, "sim_compute_robot_state-ego": 0.01333251961490564, "sim_compute_robot_state-parked0": 0.012987391990527772}}
set_robot_commands_max0.008498948917054293
set_robot_commands_mean0.007222168055097636
set_robot_commands_median0.006868600303476507
set_robot_commands_min0.006552952986497145
sim_compute_performance-ego_max0.007291013119267482
sim_compute_performance-ego_mean0.006705881360796549
sim_compute_performance-ego_median0.006655386767604134
sim_compute_performance-ego_min0.006228296380293996
sim_compute_robot_state-ego_max0.01333251961490564
sim_compute_robot_state-ego_mean0.011481489625842277
sim_compute_robot_state-ego_median0.011104439740831204
sim_compute_robot_state-ego_min0.010565640879612342
sim_compute_robot_state-parked0_max0.012987391990527772
sim_compute_robot_state-parked0_mean0.012027703751783258
sim_compute_robot_state-parked0_median0.011759751538435618
sim_compute_robot_state-parked0_min0.01145886207793976
sim_compute_sim_state_max0.036617857615152995
sim_compute_sim_state_mean0.031214107811009056
sim_compute_sim_state_median0.029768266011891923
sim_compute_sim_state_min0.02843142958248363
sim_render-ego_max0.00861526372139914
sim_render-ego_mean0.008049210811900093
sim_render-ego_median0.00799681842327118
sim_render-ego_min0.007651618882721546
simulation-passed1
step_physics_max0.11497510707739628
step_physics_mean0.09603203763544774
step_physics_median0.09224642408577348
step_physics_min0.08948243365568273
survival_time_max14.950000000000076
survival_time_mean7.644999999999994
survival_time_min5.09999999999999
No reset possible
333746811BalΓ‘zs PeiszΒ πŸ‡­πŸ‡ΊPredictorLastaido2-PREDstep1-simulationsuccessyesreg110:00:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.1183401140490946
error_L20.021109845646173145


No reset possible
333706809Anthony CourchesneΒ πŸ‡¨πŸ‡¦baseline-duckietownaido5-LF-sim-validationLFv-simsuccessnoreg110:08:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3779614325037599
survival_time_median3.324999999999996
deviation-center-line_median0.2512291229945154
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.031330430984497074
agent_compute-ego_mean0.03060754459613439
agent_compute-ego_median0.030646962229027803
agent_compute-ego_min0.02980945359415083
complete-iteration_max0.2829676564917507
complete-iteration_mean0.26868376618067624
complete-iteration_median0.26929080290580865
complete-iteration_min0.26038923263549807
deviation-center-line_max0.4359954898526317
deviation-center-line_mean0.29610686139604797
deviation-center-line_min0.1976220429196164
deviation-heading_max2.286581164642681
deviation-heading_mean1.07288114246569
deviation-heading_median0.8187349528959728
deviation-heading_min0.6619984625395918
driven_any_max0.7848624465560211
driven_any_mean0.4529593274252224
driven_any_median0.39333939708839494
driven_any_min0.28695965996455974
driven_lanedir_consec_max0.6802395853288715
driven_lanedir_consec_mean0.4200814296448714
driven_lanedir_consec_min0.27347748091279467
driven_lanedir_max0.6802395853288715
driven_lanedir_mean0.4200814296448714
driven_lanedir_median0.3779614325037599
driven_lanedir_min0.27347748091279467
get_state_dump_max0.026102622350056965
get_state_dump_mean0.02138108562580563
get_state_dump_median0.020905589623884724
get_state_dump_min0.020566999435424806
get_ui_image_max0.04854790273919163
get_ui_image_mean0.04736803585443701
get_ui_image_median0.04717474863617818
get_ui_image_min0.046461690555919304
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 0.3934999890991786, "get_ui_image": 0.04721106344194555, "step_physics": 0.0904476856117818, "survival_time": 3.349999999999996, "driven_lanedir": 0.3781075339199065, "get_state_dump": 0.02095695040119228, "sim_render-ego": 0.008769554878348735, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02980945359415083, "deviation-heading": 0.8218240116725859, "complete-iteration": 0.2691870411830162, "set_robot_commands": 0.008561902971410039, "deviation-center-line": 0.25178734328466934, "driven_lanedir_consec": 0.3781075339199065, "sim_compute_sim_state": 0.029905379708133527, "sim_compute_performance-ego": 0.00737885930644932, "sim_compute_robot_state-ego": 0.013349525964082176, "sim_compute_robot_state-parked0": 0.012552222209190255}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 0.3931788050776113, "get_ui_image": 0.046461690555919304, "step_physics": 0.09001072970303622, "survival_time": 3.2999999999999963, "driven_lanedir": 0.37781533108761334, "get_state_dump": 0.020869525996121498, "sim_render-ego": 0.007741801666490959, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030977534525322193, "deviation-heading": 0.8156458941193596, "complete-iteration": 0.26153638146140357, "set_robot_commands": 0.006512967022982511, "deviation-center-line": 0.25067090270436143, "driven_lanedir_consec": 0.37781533108761334, "sim_compute_sim_state": 0.03027286674037124, "sim_compute_performance-ego": 0.00648815342874238, "sim_compute_robot_state-ego": 0.010555393768079352, "sim_compute_robot_state-parked0": 0.011402404669559362}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 0.2935983318061053, "get_ui_image": 0.0477441759670482, "step_physics": 0.09040442167543898, "survival_time": 2.549999999999999, "driven_lanedir": 0.2735872872679206, "get_state_dump": 0.020955754261390836, "sim_render-ego": 0.008762457791496725, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030837708828496, "deviation-heading": 0.8879414083911582, "complete-iteration": 0.2695289032132018, "set_robot_commands": 0.00802920846378102, "deviation-center-line": 0.1976220429196164, "driven_lanedir_consec": 0.2735872872679206, "sim_compute_sim_state": 0.02996083334380505, "sim_compute_performance-ego": 0.007620465521718941, "sim_compute_robot_state-ego": 0.012901516521678253, "sim_compute_robot_state-parked0": 0.012056542377845914}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 0.2935983318061053, "get_ui_image": 0.047138433830410824, "step_physics": 0.0891591006634282, "survival_time": 2.549999999999999, "driven_lanedir": 0.2735872872679206, "get_state_dump": 0.026102622350056965, "sim_render-ego": 0.00794823964436849, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03034759970272289, "deviation-heading": 0.8879414083911582, "complete-iteration": 0.26411015847150016, "set_robot_commands": 0.006735525879205442, "deviation-center-line": 0.1976220429196164, "driven_lanedir_consec": 0.2735872872679206, "sim_compute_sim_state": 0.02895833464229808, "sim_compute_performance-ego": 0.0062968871172736675, "sim_compute_robot_state-ego": 0.010779109655642044, "sim_compute_robot_state-parked0": 0.010388668845681584}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 0.7848624465560211, "get_ui_image": 0.046906356811523435, "step_physics": 0.0908873691558838, "survival_time": 6.249999999999986, "driven_lanedir": 0.6802395853288715, "get_state_dump": 0.020716510772705077, "sim_render-ego": 0.007872194290161132, "in-drivable-lane": 0.0, "agent_compute-ego": 0.031330430984497074, "deviation-heading": 2.286581164642681, "complete-iteration": 0.2705787029266357, "set_robot_commands": 0.006782644271850586, "deviation-center-line": 0.4359954898526317, "driven_lanedir_consec": 0.6802395853288715, "sim_compute_sim_state": 0.03820986747741699, "sim_compute_performance-ego": 0.006379276275634766, "sim_compute_robot_state-ego": 0.010531194686889648, "sim_compute_robot_state-parked0": 0.010708515167236327}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 0.7848624465560211, "get_ui_image": 0.04667713928222656, "step_physics": 0.09046159934997558, "survival_time": 6.249999999999986, "driven_lanedir": 0.6802395853288715, "get_state_dump": 0.020566999435424806, "sim_render-ego": 0.007539718627929687, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03102448272705078, "deviation-heading": 2.286581164642681, "complete-iteration": 0.2635435562133789, "set_robot_commands": 0.006612800598144532, "deviation-center-line": 0.4359954898526317, "driven_lanedir_consec": 0.6802395853288715, "sim_compute_sim_state": 0.033160055160522464, "sim_compute_performance-ego": 0.006190668106079102, "sim_compute_robot_state-ego": 0.010292879104614258, "sim_compute_robot_state-parked0": 0.010764907836914065}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 0.5060368017110307, "get_ui_image": 0.04854790273919163, "step_physics": 0.10488827544522572, "survival_time": 4.149999999999993, "driven_lanedir": 0.4951413622110103, "get_state_dump": 0.02062904116619064, "sim_render-ego": 0.007925082402056959, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03004211402801146, "deviation-heading": 0.6619984625395918, "complete-iteration": 0.2756014645817768, "set_robot_commands": 0.006665120641869235, "deviation-center-line": 0.35292507358531194, "driven_lanedir_consec": 0.4951413622110103, "sim_compute_sim_state": 0.028793085052306395, "sim_compute_performance-ego": 0.006299507187073489, "sim_compute_robot_state-ego": 0.010501536978296486, "sim_compute_robot_state-parked0": 0.0110515887478748}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 0.5060368017110307, "get_ui_image": 0.04761477263577013, "step_physics": 0.10599866832595274, "survival_time": 4.149999999999993, "driven_lanedir": 0.4951413622110103, "get_state_dump": 0.02084024268460561, "sim_render-ego": 0.008268370685807193, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030671866543321723, "deviation-heading": 0.6619984625395918, "complete-iteration": 0.2829676564917507, "set_robot_commands": 0.0075007404189511954, "deviation-center-line": 0.35292507358531194, "driven_lanedir_consec": 0.4951413622110103, "sim_compute_sim_state": 0.030643598142876684, "sim_compute_performance-ego": 0.007031702133546393, "sim_compute_robot_state-ego": 0.012177395533366376, "sim_compute_robot_state-parked0": 0.01195335675434894}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 0.28695965996455974, "get_ui_image": 0.04683526039123535, "step_physics": 0.0899575424194336, "survival_time": 2.499999999999999, "driven_lanedir": 0.27347748091279467, "get_state_dump": 0.02094165325164795, "sim_render-ego": 0.008035883903503419, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03041219711303711, "deviation-heading": 0.7091497238590456, "complete-iteration": 0.26038923263549807, "set_robot_commands": 0.006916484832763672, "deviation-center-line": 0.2427625776281645, "driven_lanedir_consec": 0.27347748091279467, "sim_compute_sim_state": 0.02910860538482666, "sim_compute_performance-ego": 0.00647885799407959, "sim_compute_robot_state-ego": 0.0105924654006958, "sim_compute_robot_state-parked0": 0.010856904983520509}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 0.28695965996455974, "get_ui_image": 0.04854356288909912, "step_physics": 0.09072585582733154, "survival_time": 2.499999999999999, "driven_lanedir": 0.27347748091279467, "get_state_dump": 0.021231555938720705, "sim_render-ego": 0.008299589157104492, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030622057914733887, "deviation-heading": 0.7091497238590456, "complete-iteration": 0.26939456462860106, "set_robot_commands": 0.007830801010131836, "deviation-center-line": 0.2427625776281645, "driven_lanedir_consec": 0.27347748091279467, "sim_compute_sim_state": 0.02960423469543457, "sim_compute_performance-ego": 0.0074244880676269534, "sim_compute_robot_state-ego": 0.012328047752380372, "sim_compute_robot_state-parked0": 0.012519335746765135}}
set_robot_commands_max0.008561902971410039
set_robot_commands_mean0.007214819611109008
set_robot_commands_median0.0068495645523071295
set_robot_commands_min0.006512967022982511
sim_compute_performance-ego_max0.007620465521718941
sim_compute_performance-ego_mean0.00675888651382246
sim_compute_performance-ego_median0.0064835057114109845
sim_compute_performance-ego_min0.006190668106079102
sim_compute_robot_state-ego_max0.013349525964082176
sim_compute_robot_state-ego_mean0.011400906536572476
sim_compute_robot_state-ego_median0.01068578752816892
sim_compute_robot_state-ego_min0.010292879104614258
sim_compute_robot_state-parked0_max0.012552222209190255
sim_compute_robot_state-parked0_mean0.011425444733893689
sim_compute_robot_state-parked0_median0.01122699670871708
sim_compute_robot_state-parked0_min0.010388668845681584
sim_compute_sim_state_max0.03820986747741699
sim_compute_sim_state_mean0.030861686034799163
sim_compute_sim_state_median0.02993310652596929
sim_compute_sim_state_min0.028793085052306395
sim_render-ego_max0.008769554878348735
sim_render-ego_mean0.008116289304726779
sim_render-ego_median0.007992061773935955
sim_render-ego_min0.007539718627929687
simulation-passed1
step_physics_max0.10599866832595274
step_physics_mean0.0932941248177488
step_physics_median0.09045464248087869
step_physics_min0.0891591006634282
survival_time_max6.249999999999986
survival_time_mean3.7549999999999946
survival_time_min2.499999999999999
No reset possible
333696808Chuqiao LiPredictorLastaido2-PREDstep1-simulationsuccessyesreg110:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.1302632664695353
error_L20.024318906629421575


No reset possible
333646806Anthony CourchesneΒ πŸ‡¨πŸ‡¦baseline-duckietownaido5-LF-sim-validationLFv-simsuccessnoreg110:08:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3779614325037599
survival_time_median3.374999999999996
deviation-center-line_median0.25192747035025365
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.03345690290611911
agent_compute-ego_mean0.02992110858278178
agent_compute-ego_median0.02986056120255414
agent_compute-ego_min0.028105125427246094
complete-iteration_max0.2891052573560232
complete-iteration_mean0.26628532386287107
complete-iteration_median0.2622529589611551
complete-iteration_min0.2560278901866838
deviation-center-line_max0.4359954898526317
deviation-center-line_mean0.29624653086719566
deviation-center-line_min0.1976220429196164
deviation-heading_max2.286581164642681
deviation-heading_mean1.0739646689505218
deviation-heading_median0.8241525853201317
deviation-heading_min0.6619984625395918
driven_any_max0.7848624465560211
driven_any_mean0.4529593274252225
driven_any_median0.3933393970883956
driven_any_min0.28695965996455974
driven_lanedir_consec_max0.6802395853288715
driven_lanedir_consec_mean0.4200814296448714
driven_lanedir_consec_min0.27347748091279467
driven_lanedir_max0.6802395853288715
driven_lanedir_mean0.4200814296448714
driven_lanedir_median0.3779614325037599
driven_lanedir_min0.27347748091279467
get_state_dump_max0.025113372241749483
get_state_dump_mean0.0207501464189614
get_state_dump_median0.020411749345710477
get_state_dump_min0.019263052940368657
get_ui_image_max0.047773715972900394
get_ui_image_mean0.04650411737269232
get_ui_image_median0.046429932324782666
get_ui_image_min0.04472944315742044
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 0.39349998909917994, "get_ui_image": 0.04645169299581776, "step_physics": 0.09020845786384914, "survival_time": 3.4499999999999957, "driven_lanedir": 0.3781075339199065, "get_state_dump": 0.0207980335622594, "sim_render-ego": 0.008185144783794016, "in-drivable-lane": 0.0, "agent_compute-ego": 0.030075885247493137, "deviation-heading": 0.8326592765209038, "complete-iteration": 0.262945382491402, "set_robot_commands": 0.0074606805607892466, "deviation-center-line": 0.2531840379961459, "driven_lanedir_consec": 0.3781075339199065, "sim_compute_sim_state": 0.02898312651592752, "sim_compute_performance-ego": 0.00677937010060186, "sim_compute_robot_state-ego": 0.0119780699412028, "sim_compute_robot_state-parked0": 0.011769764665244282}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 0.3931788050776113, "get_ui_image": 0.04544994325348825, "step_physics": 0.08643111676880808, "survival_time": 3.2999999999999963, "driven_lanedir": 0.37781533108761334, "get_state_dump": 0.020967140342250015, "sim_render-ego": 0.007722211606574781, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03092465256199692, "deviation-heading": 0.8156458941193596, "complete-iteration": 0.2566028725017201, "set_robot_commands": 0.006559292475382487, "deviation-center-line": 0.25067090270436143, "driven_lanedir_consec": 0.37781533108761334, "sim_compute_sim_state": 0.030310692209185974, "sim_compute_performance-ego": 0.006328875368291681, "sim_compute_robot_state-ego": 0.010640007076841412, "sim_compute_robot_state-parked0": 0.011014371207266144}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 0.2935983318061053, "get_ui_image": 0.04625653753093645, "step_physics": 0.08652296720766554, "survival_time": 2.549999999999999, "driven_lanedir": 0.2735872872679206, "get_state_dump": 0.021162968055874695, "sim_render-ego": 0.007445433560539694, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029850833556231332, "deviation-heading": 0.8879414083911582, "complete-iteration": 0.2560278901866838, "set_robot_commands": 0.006435651405184877, "deviation-center-line": 0.1976220429196164, "driven_lanedir_consec": 0.2735872872679206, "sim_compute_sim_state": 0.028975201588050992, "sim_compute_performance-ego": 0.006547254674574908, "sim_compute_robot_state-ego": 0.011583856507843616, "sim_compute_robot_state-parked0": 0.010988104577158013}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 0.2935983318061053, "get_ui_image": 0.04472944315742044, "step_physics": 0.08836710219289742, "survival_time": 2.549999999999999, "driven_lanedir": 0.2735872872679206, "get_state_dump": 0.025113372241749483, "sim_render-ego": 0.007392930049522251, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029703855514526367, "deviation-heading": 0.8879414083911582, "complete-iteration": 0.2581964614344578, "set_robot_commands": 0.006450821371639476, "deviation-center-line": 0.1976220429196164, "driven_lanedir_consec": 0.2735872872679206, "sim_compute_sim_state": 0.0284273250430238, "sim_compute_performance-ego": 0.006281020594578164, "sim_compute_robot_state-ego": 0.010997243956023571, "sim_compute_robot_state-parked0": 0.010477173562143362}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 0.7848624465560211, "get_ui_image": 0.04628181457519531, "step_physics": 0.08958022689819337, "survival_time": 6.249999999999986, "driven_lanedir": 0.6802395853288715, "get_state_dump": 0.02049355506896973, "sim_render-ego": 0.007789995193481445, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029870288848876953, "deviation-heading": 2.286581164642681, "complete-iteration": 0.26336906623840334, "set_robot_commands": 0.007063980102539062, "deviation-center-line": 0.4359954898526317, "driven_lanedir_consec": 0.6802395853288715, "sim_compute_sim_state": 0.032975179672241214, "sim_compute_performance-ego": 0.006475408554077148, "sim_compute_robot_state-ego": 0.011416994094848632, "sim_compute_robot_state-parked0": 0.011175765991210935}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 0.7848624465560211, "get_ui_image": 0.047773715972900394, "step_physics": 0.0945434684753418, "survival_time": 6.249999999999986, "driven_lanedir": 0.6802395853288715, "get_state_dump": 0.019574033737182615, "sim_render-ego": 0.008183090209960938, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029886989593505855, "deviation-heading": 2.286581164642681, "complete-iteration": 0.27253829193115237, "set_robot_commands": 0.0076598281860351565, "deviation-center-line": 0.4359954898526317, "driven_lanedir_consec": 0.6802395853288715, "sim_compute_sim_state": 0.03370745086669922, "sim_compute_performance-ego": 0.006934175491333008, "sim_compute_robot_state-ego": 0.012190330505371091, "sim_compute_robot_state-parked0": 0.011835933685302736}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 0.5060368017110307, "get_ui_image": 0.04765275013015931, "step_physics": 0.1091054721050952, "survival_time": 4.149999999999993, "driven_lanedir": 0.4951413622110103, "get_state_dump": 0.02032994362245123, "sim_render-ego": 0.008557428796607328, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03345690290611911, "deviation-heading": 0.6619984625395918, "complete-iteration": 0.2891052573560232, "set_robot_commands": 0.007749138108219008, "deviation-center-line": 0.35292507358531194, "driven_lanedir_consec": 0.4951413622110103, "sim_compute_sim_state": 0.02951017058039286, "sim_compute_performance-ego": 0.007474184036254883, "sim_compute_robot_state-ego": 0.012642779982233622, "sim_compute_robot_state-parked0": 0.012376891561301355}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 0.5060368017110307, "get_ui_image": 0.04751201710069036, "step_physics": 0.10841547437461026, "survival_time": 4.149999999999993, "driven_lanedir": 0.4951413622110103, "get_state_dump": 0.019988907388893955, "sim_render-ego": 0.008247958608420498, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02846086743366287, "deviation-heading": 0.6619984625395918, "complete-iteration": 0.2826932568147958, "set_robot_commands": 0.007775367024433182, "deviation-center-line": 0.35292507358531194, "driven_lanedir_consec": 0.4951413622110103, "sim_compute_sim_state": 0.02989333508962608, "sim_compute_performance-ego": 0.007347351097198854, "sim_compute_robot_state-ego": 0.01260153069553605, "sim_compute_robot_state-parked0": 0.012199108859142624}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 0.28695965996455974, "get_ui_image": 0.04652508735656738, "step_physics": 0.09478129863739014, "survival_time": 2.499999999999999, "driven_lanedir": 0.27347748091279467, "get_state_dump": 0.019263052940368657, "sim_render-ego": 0.007348394393920899, "in-drivable-lane": 0.0, "agent_compute-ego": 0.028105125427246094, "deviation-heading": 0.7091497238590456, "complete-iteration": 0.2598142242431641, "set_robot_commands": 0.006636891365051269, "deviation-center-line": 0.2427625776281645, "driven_lanedir_consec": 0.27347748091279467, "sim_compute_sim_state": 0.029008464813232424, "sim_compute_performance-ego": 0.006144213676452637, "sim_compute_robot_state-ego": 0.010645980834960938, "sim_compute_robot_state-parked0": 0.01111125946044922}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 0.28695965996455974, "get_ui_image": 0.04640817165374756, "step_physics": 0.0978849458694458, "survival_time": 2.499999999999999, "driven_lanedir": 0.27347748091279467, "get_state_dump": 0.019810457229614255, "sim_render-ego": 0.0072185564041137695, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02887568473815918, "deviation-heading": 0.7091497238590456, "complete-iteration": 0.2615605354309082, "set_robot_commands": 0.0062245607376098635, "deviation-center-line": 0.2427625776281645, "driven_lanedir_consec": 0.27347748091279467, "sim_compute_sim_state": 0.02772186279296875, "sim_compute_performance-ego": 0.006205410957336426, "sim_compute_robot_state-ego": 0.010642509460449218, "sim_compute_robot_state-parked0": 0.010322089195251466}}
set_robot_commands_max0.007775367024433182
set_robot_commands_mean0.007001621133688363
set_robot_commands_median0.0068504357337951655
set_robot_commands_min0.0062245607376098635
sim_compute_performance-ego_max0.007474184036254883
sim_compute_performance-ego_mean0.006651726455069958
sim_compute_performance-ego_median0.006511331614326028
sim_compute_performance-ego_min0.006144213676452637
sim_compute_robot_state-ego_max0.012642779982233622
sim_compute_robot_state-ego_mean0.011533930305531096
sim_compute_robot_state-ego_median0.011500425301346123
sim_compute_robot_state-ego_min0.010640007076841412
sim_compute_robot_state-parked0_max0.012376891561301355
sim_compute_robot_state-parked0_mean0.011327046276447017
sim_compute_robot_state-parked0_median0.011143512725830078
sim_compute_robot_state-parked0_min0.010322089195251466
sim_compute_sim_state_max0.03370745086669922
sim_compute_sim_state_mean0.02995128091713488
sim_compute_sim_state_median0.02925931769681264
sim_compute_sim_state_min0.02772186279296875
sim_render-ego_max0.008557428796607328
sim_render-ego_mean0.007809114360693563
sim_render-ego_median0.007756103400028113
sim_render-ego_min0.0072185564041137695
simulation-passed1
step_physics_max0.1091054721050952
step_physics_mean0.09458405303932968
step_physics_median0.09237596316959548
step_physics_min0.08643111676880808
survival_time_max6.249999999999986
survival_time_mean3.764999999999995
survival_time_min2.499999999999999
No reset possible
333366789Jonas WΓΌstΒ πŸ‡¨πŸ‡­PredictorLastaido2-PREDstep1-simulationsuccessyesreg110:00:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.09857967470268772
error_L20.015359464341711385


No reset possible
333256784Shao (Mike) ZhangΒ πŸ‡¨πŸ‡¦PredictorLastaido2-PREDstep1-simulationsuccessyesreg110:00:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.10912961088276588
error_L20.018220665805309916


No reset possible
333236782Jiaxu XingPredictorLastaido2-PREDstep1-simulationsuccessyesreg110:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.12436396129671232
error_L20.02286293208554883


No reset possible
333196780Yash VyasΒ πŸ‡¨πŸ‡­PredictorLastaido2-PREDstep1-simulationsuccessyesreg110:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.10355914136069372
error_L20.01765909549731069


No reset possible
333186779Charalampos RouliosΒ πŸ‡¬πŸ‡·PredictorLastaido2-PREDstep1-simulationsuccessyesreg110:00:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.13138607716395684
error_L20.02758708837397745


No reset possible
333156777Frederic LetschPredictorLastaido2-PREDstep1-simulationsuccessyesreg110:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11122288318633594
error_L20.018488925326191532


No reset possible
333106775Szymon KulpinskiPredictorLastaido2-PREDstep1-simulationsuccessyesreg110:00:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11653824458456336
error_L20.020127025248315788


No reset possible
333016771Jonathan PeelPredictorLastaido2-PREDstep1-simulationhost-erroryesreg110:00:11
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job33301-896806', 'up', '-d', '--renew-anon-volumes']:

   >  Command '['docker-compose', '-p', 'job33301-896806', 'up', '-d', '--renew-anon-volumes']' returned non-zero exit status 1.

stdout | 

stderr | Creating network "job33301-896806_evaluation" with the default driver
stderr | could not find an available, non-overlapping IPv4 address pool among the defaults to assign to the network
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
332996771Jonathan PeelPredictorLastaido2-PREDstep1-simulationsuccessyesreg110:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.09969787101455764
error_L20.015061737451790472


No reset possible