Duckietown Challenges Home Challenges Submissions

Evaluator 2259

ID2259
evaluatorreg01-bf67cb02b1e0-1
ownerI don't have one 😀
machinearchimede
processreg01-bf67cb02b1e0-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success5 40848
# timeout
# failed2 40859
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
4090410819Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-bf67cb02b1e0-10:11:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8433869073547329
survival_time_median14.950000000000076
deviation-center-line_median0.5485631345322248
in-drivable-lane_median0.8000000000000114


other stats
agent_compute-ego_max0.04234313567479451
agent_compute-ego_mean0.029432655771573384
agent_compute-ego_median0.025726498762766517
agent_compute-ego_min0.023934489885965984
complete-iteration_max0.3019335087140401
complete-iteration_mean0.28417829652627313
complete-iteration_median0.28082181731859845
complete-iteration_min0.2731360427538554
deviation-center-line_max0.7782398702387204
deviation-center-line_mean0.5824186044298097
deviation-center-line_min0.454308278416069
deviation-heading_max3.1706440697876888
deviation-heading_mean2.2254652662368546
deviation-heading_median2.055795016535715
deviation-heading_min1.6196269620882988
driven_any_max2.025937904052177
driven_any_mean1.9936643505801637
driven_any_median2.0147465550817323
driven_any_min1.919226388105014
driven_lanedir_consec_max1.9467137294764456
driven_lanedir_consec_mean1.7555067426592963
driven_lanedir_consec_min1.388539426451274
driven_lanedir_max1.9467137294764456
driven_lanedir_mean1.7555067426592963
driven_lanedir_median1.8433869073547329
driven_lanedir_min1.388539426451274
get_duckie_state_max4.750887552897135e-06
get_duckie_state_mean4.674394925435383e-06
get_duckie_state_median4.671414693196615e-06
get_duckie_state_min4.6038627624511716e-06
get_robot_state_max0.024355645179748538
get_robot_state_mean0.023361147046089173
get_robot_state_median0.023653462330500287
get_robot_state_min0.021782018343607584
get_state_dump_max0.020425841013590493
get_state_dump_mean0.019522063930829368
get_state_dump_median0.019434754451115928
get_state_dump_min0.01879290580749512
get_ui_image_max0.04842523415883382
get_ui_image_mean0.04754406293233236
get_ui_image_median0.04771086732546488
get_ui_image_min0.04632928291956584
in-drivable-lane_max4.150000000000059
in-drivable-lane_mean1.500000000000021
in-drivable-lane_min0.25000000000000355
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.919226388105014, "get_ui_image": 0.04632928291956584, "step_physics": 0.10243843237559, "survival_time": 14.950000000000076, "driven_lanedir": 1.388539426451274, "get_state_dump": 0.020425841013590493, "sim_render-ego": 0.009686996936798095, "get_robot_state": 0.02383310397466024, "get_duckie_state": 4.750887552897135e-06, "in-drivable-lane": 4.150000000000059, "agent_compute-ego": 0.02595918734868367, "deviation-heading": 1.6196269620882988, "complete-iteration": 0.27554043849309284, "set_robot_commands": 0.007778467337290446, "deviation-center-line": 0.454308278416069, "driven_lanedir_consec": 1.388539426451274, "sim_compute_sim_state": 0.032329376538594565, "sim_compute_performance-ego": 0.006527018547058105}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.025937904052177, "get_ui_image": 0.04727964957555135, "step_physics": 0.10686488389968872, "survival_time": 14.950000000000076, "driven_lanedir": 1.9228636135188584, "get_state_dump": 0.01879290580749512, "sim_render-ego": 0.009195849895477295, "get_robot_state": 0.02347382068634033, "get_duckie_state": 4.6038627624511716e-06, "in-drivable-lane": 0.350000000000005, "agent_compute-ego": 0.023934489885965984, "deviation-heading": 2.29645159211508, "complete-iteration": 0.2731360427538554, "set_robot_commands": 0.007354937394460043, "deviation-center-line": 0.5453762336078396, "driven_lanedir_consec": 1.9228636135188584, "sim_compute_sim_state": 0.029892133076985676, "sim_compute_performance-ego": 0.006130544344584147}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.003764316353171, "get_ui_image": 0.04842523415883382, "step_physics": 0.1145953877766927, "survival_time": 14.950000000000076, "driven_lanedir": 1.7639102011906074, "get_state_dump": 0.01952938477198283, "sim_render-ego": 0.009434011777242023, "get_robot_state": 0.024355645179748538, "get_duckie_state": 4.69525655110677e-06, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.025493810176849364, "deviation-heading": 3.1706440697876888, "complete-iteration": 0.286103196144104, "set_robot_commands": 0.00754624605178833, "deviation-center-line": 0.7782398702387204, "driven_lanedir_consec": 1.7639102011906074, "sim_compute_sim_state": 0.030187331835428873, "sim_compute_performance-ego": 0.006308404604593912}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.025728793810293, "get_ui_image": 0.04814208507537842, "step_physics": 0.1146848193804423, "survival_time": 14.950000000000076, "driven_lanedir": 1.9467137294764456, "get_state_dump": 0.019340124130249024, "sim_render-ego": 0.008817973136901856, "get_robot_state": 0.021782018343607584, "get_duckie_state": 4.647572835286458e-06, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.04234313567479451, "deviation-heading": 1.81513844095635, "complete-iteration": 0.3019335087140401, "set_robot_commands": 0.006695950826009114, "deviation-center-line": 0.5517500354566099, "driven_lanedir_consec": 1.9467137294764456, "sim_compute_sim_state": 0.034068586826324465, "sim_compute_performance-ego": 0.005837030410766601}}
set_robot_commands_max0.007778467337290446
set_robot_commands_mean0.007343900402386984
set_robot_commands_median0.007450591723124187
set_robot_commands_min0.006695950826009114
sim_compute_performance-ego_max0.006527018547058105
sim_compute_performance-ego_mean0.006200749476750691
sim_compute_performance-ego_median0.0062194744745890295
sim_compute_performance-ego_min0.005837030410766601
sim_compute_sim_state_max0.034068586826324465
sim_compute_sim_state_mean0.031619357069333394
sim_compute_sim_state_median0.03125835418701172
sim_compute_sim_state_min0.029892133076985676
sim_render-ego_max0.009686996936798095
sim_render-ego_mean0.009283707936604818
sim_render-ego_median0.00931493083635966
sim_render-ego_min0.008817973136901856
simulation-passed1
step_physics_max0.1146848193804423
step_physics_mean0.10964588085810342
step_physics_median0.11073013583819072
step_physics_min0.10243843237559
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4089810823Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednoreg01-bf67cb02b1e0-10:04:02
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 55 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4088410834Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-bf67cb02b1e0-10:10:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.865488335209736
survival_time_median14.950000000000076
deviation-center-line_median0.3625189429657093
in-drivable-lane_median2.600000000000037


other stats
agent_compute-ego_max0.027283074061075847
agent_compute-ego_mean0.026217822732415588
agent_compute-ego_median0.026184439066820924
agent_compute-ego_min0.02521933873494466
complete-iteration_max0.29088989973068236
complete-iteration_mean0.2852483833173536
complete-iteration_median0.285998903977796
complete-iteration_min0.27810582558314006
deviation-center-line_max0.6195413535161155
deviation-center-line_mean0.3930421395310253
deviation-center-line_min0.22758931867656687
deviation-heading_max2.4518203561647307
deviation-heading_mean1.5872760793037308
deviation-heading_median1.3547575442650217
deviation-heading_min1.1877688725201492
driven_any_max2.3514017826950613
driven_any_mean2.040699034840369
driven_any_median2.1342673352170074
driven_any_min1.5428596862323996
driven_lanedir_consec_max2.0195219595703646
driven_lanedir_consec_mean1.767368821373191
driven_lanedir_consec_min1.318976655502928
driven_lanedir_max2.0195219595703646
driven_lanedir_mean1.767368821373191
driven_lanedir_median1.865488335209736
driven_lanedir_min1.318976655502928
get_duckie_state_max4.95505782793153e-06
get_duckie_state_mean4.7830553174768605e-06
get_duckie_state_median4.801750183105469e-06
get_duckie_state_min4.573663075764974e-06
get_robot_state_max0.02514975388844808
get_robot_state_mean0.024730448962757424
get_robot_state_median0.02480612484913952
get_robot_state_min0.024159792264302572
get_state_dump_max0.02359407027562459
get_state_dump_mean0.02085256738482781
get_state_dump_median0.020094995558636745
get_state_dump_min0.01962620814641317
get_ui_image_max0.04874526779606657
get_ui_image_mean0.048066571058717165
get_ui_image_median0.048119342327117925
get_ui_image_min0.04728233178456624
in-drivable-lane_max2.8500000000000405
in-drivable-lane_mean2.537500000000036
in-drivable-lane_min2.10000000000003
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.5428596862323996, "get_ui_image": 0.04874526779606657, "step_physics": 0.10784068085112662, "survival_time": 10.600000000000016, "driven_lanedir": 1.318976655502928, "get_state_dump": 0.019999634544804412, "sim_render-ego": 0.00977421706577517, "get_robot_state": 0.024864048328039783, "get_duckie_state": 4.95505782793153e-06, "in-drivable-lane": 2.10000000000003, "agent_compute-ego": 0.025840514111069017, "deviation-heading": 1.2963528895537066, "complete-iteration": 0.2819355703749747, "set_robot_commands": 0.007592820896292632, "deviation-center-line": 0.22758931867656687, "driven_lanedir_consec": 1.318976655502928, "sim_compute_sim_state": 0.03071794869764796, "sim_compute_performance-ego": 0.0063340045371145575}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.3514017826950613, "get_ui_image": 0.04728233178456624, "step_physics": 0.1000055972735087, "survival_time": 14.950000000000076, "driven_lanedir": 1.9988194144854663, "get_state_dump": 0.02359407027562459, "sim_render-ego": 0.009870768388112386, "get_robot_state": 0.02514975388844808, "get_duckie_state": 4.759629567464193e-06, "in-drivable-lane": 2.8500000000000405, "agent_compute-ego": 0.026528364022572835, "deviation-heading": 1.413162198976337, "complete-iteration": 0.27810582558314006, "set_robot_commands": 0.007971840699513753, "deviation-center-line": 0.32177955551953186, "driven_lanedir_consec": 1.9988194144854663, "sim_compute_sim_state": 0.03087672551472982, "sim_compute_performance-ego": 0.006592961152394613}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9940083609473829, "get_ui_image": 0.048212358951568605, "step_physics": 0.11578624804814656, "survival_time": 14.950000000000076, "driven_lanedir": 1.7321572559340053, "get_state_dump": 0.020190356572469075, "sim_render-ego": 0.00982584317525228, "get_robot_state": 0.024748201370239257, "get_duckie_state": 4.843870798746745e-06, "in-drivable-lane": 2.3500000000000334, "agent_compute-ego": 0.027283074061075847, "deviation-heading": 2.4518203561647307, "complete-iteration": 0.29088989973068236, "set_robot_commands": 0.007658416430155436, "deviation-center-line": 0.6195413535161155, "driven_lanedir_consec": 1.7321572559340053, "sim_compute_sim_state": 0.03048506736755371, "sim_compute_performance-ego": 0.006471755504608154}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.2745263094866326, "get_ui_image": 0.04802632570266724, "step_physics": 0.11563584407170614, "survival_time": 14.950000000000076, "driven_lanedir": 2.0195219595703646, "get_state_dump": 0.01962620814641317, "sim_render-ego": 0.009360027313232424, "get_robot_state": 0.024159792264302572, "get_duckie_state": 4.573663075764974e-06, "in-drivable-lane": 2.8500000000000405, "agent_compute-ego": 0.02521933873494466, "deviation-heading": 1.1877688725201492, "complete-iteration": 0.2900622375806173, "set_robot_commands": 0.007423273722330729, "deviation-center-line": 0.4032583304118867, "driven_lanedir_consec": 2.0195219595703646, "sim_compute_sim_state": 0.034273683230082196, "sim_compute_performance-ego": 0.006121078332265218}}
set_robot_commands_max0.007971840699513753
set_robot_commands_mean0.007661587937073137
set_robot_commands_median0.007625618663224034
set_robot_commands_min0.007423273722330729
sim_compute_performance-ego_max0.006592961152394613
sim_compute_performance-ego_mean0.006379949881595635
sim_compute_performance-ego_median0.006402880020861356
sim_compute_performance-ego_min0.006121078332265218
sim_compute_sim_state_max0.034273683230082196
sim_compute_sim_state_mean0.03158835620250342
sim_compute_sim_state_median0.03079733710618889
sim_compute_sim_state_min0.03048506736755371
sim_render-ego_max0.009870768388112386
sim_render-ego_mean0.009707713985593064
sim_render-ego_median0.009800030120513724
sim_render-ego_min0.009360027313232424
simulation-passed1
step_physics_max0.11578624804814656
step_physics_mean0.109817092561122
step_physics_median0.11173826246141638
step_physics_min0.1000055972735087
survival_time_max14.950000000000076
survival_time_mean13.86250000000006
survival_time_min10.600000000000016
No reset possible
4087110838Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg01-bf67cb02b1e0-10:10:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6792557792246905
survival_time_median13.600000000000058
deviation-center-line_median0.30429399190687534
in-drivable-lane_median4.17500000000005


other stats
agent_compute-ego_max0.026489051977793377
agent_compute-ego_mean0.025696594846292577
agent_compute-ego_median0.02570535831232719
agent_compute-ego_min0.024886610782722557
complete-iteration_max0.30093189774835866
complete-iteration_mean0.28694701860986715
complete-iteration_median0.28390384611782726
complete-iteration_min0.27904848445545544
deviation-center-line_max0.3518733779268675
deviation-center-line_mean0.29861434742769777
deviation-center-line_min0.233996027970173
deviation-heading_max3.341659577198141
deviation-heading_mean1.5538162779403524
deviation-heading_median1.0331046895825078
deviation-heading_min0.8073961553982528
driven_any_max2.544262919367098
driven_any_mean2.2557441382375725
driven_any_median2.278459373565714
driven_any_min1.9217948864517644
driven_lanedir_consec_max1.9742205876648569
driven_lanedir_consec_mean1.5000279198744355
driven_lanedir_consec_min0.667379533383505
driven_lanedir_max1.9742205876648569
driven_lanedir_mean1.5042106465464338
driven_lanedir_median1.6792557792246905
driven_lanedir_min0.6841104400714972
get_duckie_state_max3.842620162276535e-06
get_duckie_state_mean3.675230713760883e-06
get_duckie_state_median3.623925338286167e-06
get_duckie_state_min3.6104520161946617e-06
get_robot_state_max0.026660367015569186
get_robot_state_mean0.02490517541691264
get_robot_state_median0.0244825250452215
get_robot_state_min0.02399528456163836
get_state_dump_max0.021298943339167417
get_state_dump_mean0.020340016123424978
get_state_dump_median0.02022603260097007
get_state_dump_min0.019609055952592328
get_ui_image_max0.04916465838750204
get_ui_image_mean0.0484070170401131
get_ui_image_median0.04841286671971421
get_ui_image_min0.047637676333521936
in-drivable-lane_max9.40000000000006
in-drivable-lane_mean5.412500000000053
in-drivable-lane_min3.900000000000055
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.9217948864517644, "get_ui_image": 0.047637676333521936, "step_physics": 0.10642976481635293, "survival_time": 11.100000000000025, "driven_lanedir": 1.3857456670566863, "get_state_dump": 0.021298943339167417, "sim_render-ego": 0.00948505466048782, "get_robot_state": 0.02399528456163836, "get_duckie_state": 3.842620162276535e-06, "in-drivable-lane": 4.150000000000039, "agent_compute-ego": 0.025492910866264824, "deviation-heading": 0.9179176833140584, "complete-iteration": 0.27937732730899845, "set_robot_commands": 0.007374136297552435, "deviation-center-line": 0.233996027970173, "driven_lanedir_consec": 1.3857456670566863, "sim_compute_sim_state": 0.031328012277414136, "sim_compute_performance-ego": 0.006120604437750739}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.544262919367098, "get_ui_image": 0.04772266041148793, "step_physics": 0.10577679720791903, "survival_time": 13.75000000000006, "driven_lanedir": 1.9727658913926944, "get_state_dump": 0.019609055952592328, "sim_render-ego": 0.00989784760908647, "get_robot_state": 0.02441595684398304, "get_duckie_state": 3.6352330988103695e-06, "in-drivable-lane": 3.900000000000055, "agent_compute-ego": 0.02591780575838956, "deviation-heading": 1.1482916958509573, "complete-iteration": 0.27904848445545544, "set_robot_commands": 0.00791689699346369, "deviation-center-line": 0.32907635976052135, "driven_lanedir_consec": 1.9727658913926944, "sim_compute_sim_state": 0.03085434913635254, "sim_compute_performance-ego": 0.006717640269886364}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.1262924266493037, "get_ui_image": 0.04916465838750204, "step_physics": 0.11331023931503297, "survival_time": 14.950000000000076, "driven_lanedir": 0.6841104400714972, "get_state_dump": 0.01993311882019043, "sim_render-ego": 0.009801452954610188, "get_robot_state": 0.02454909324645996, "get_duckie_state": 3.6104520161946617e-06, "in-drivable-lane": 9.40000000000006, "agent_compute-ego": 0.026489051977793377, "deviation-heading": 3.341659577198141, "complete-iteration": 0.2884303649266561, "set_robot_commands": 0.007870192527770997, "deviation-center-line": 0.3518733779268675, "driven_lanedir_consec": 0.667379533383505, "sim_compute_sim_state": 0.03068579117457072, "sim_compute_performance-ego": 0.006405328909556071}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.430626320482124, "get_ui_image": 0.04910307302794049, "step_physics": 0.12124569265372692, "survival_time": 13.450000000000056, "driven_lanedir": 1.9742205876648569, "get_state_dump": 0.02051894638174972, "sim_render-ego": 0.009269941251960383, "get_robot_state": 0.026660367015569186, "get_duckie_state": 3.6126175777619655e-06, "in-drivable-lane": 4.20000000000006, "agent_compute-ego": 0.024886610782722557, "deviation-heading": 0.8073961553982528, "complete-iteration": 0.30093189774835866, "set_robot_commands": 0.007035134893367725, "deviation-center-line": 0.27951162405322927, "driven_lanedir_consec": 1.9742205876648569, "sim_compute_sim_state": 0.035972643962136876, "sim_compute_performance-ego": 0.006028599012296882}}
set_robot_commands_max0.00791689699346369
set_robot_commands_mean0.007549090178038712
set_robot_commands_median0.007622164412661716
set_robot_commands_min0.007035134893367725
sim_compute_performance-ego_max0.006717640269886364
sim_compute_performance-ego_mean0.006318043157372514
sim_compute_performance-ego_median0.006262966673653406
sim_compute_performance-ego_min0.006028599012296882
sim_compute_sim_state_max0.035972643962136876
sim_compute_sim_state_mean0.03221019913761857
sim_compute_sim_state_median0.03109118070688334
sim_compute_sim_state_min0.03068579117457072
sim_render-ego_max0.00989784760908647
sim_render-ego_mean0.009613574119036216
sim_render-ego_median0.009643253807549004
sim_render-ego_min0.009269941251960383
simulation-passed1
step_physics_max0.12124569265372692
step_physics_mean0.11169062349825797
step_physics_median0.10987000206569296
step_physics_min0.10577679720791903
survival_time_max14.950000000000076
survival_time_mean13.312500000000052
survival_time_min11.100000000000025
No reset possible
4086311277Jacopo Tanitemplate-randomaido5-LF-sim-validationLFv-simsuccessnoreg01-bf67cb02b1e0-10:04:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.644037326580434
survival_time_median4.7749999999999915
deviation-center-line_median0.10361109150784235
in-drivable-lane_median2.5499999999999914


other stats
agent_compute-ego_max0.025358516158479633
agent_compute-ego_mean0.024636212714318484
agent_compute-ego_median0.024528718356985856
agent_compute-ego_min0.02412889798482259
complete-iteration_max0.30495126861514465
complete-iteration_mean0.28489586763457964
complete-iteration_median0.28086713391583595
complete-iteration_min0.2728979340915022
deviation-center-line_max0.1558386830383756
deviation-center-line_mean0.10879855071843546
deviation-center-line_min0.07213333681968147
deviation-heading_max0.976837469261332
deviation-heading_mean0.4922932418762878
deviation-heading_median0.3609623398756611
deviation-heading_min0.27041081849249704
driven_any_max2.8894611145876907
driven_any_mean1.8510551780477624
driven_any_median1.9986666350865232
driven_any_min0.5174263274303109
driven_lanedir_consec_max0.8904446665936316
driven_lanedir_consec_mean0.6302364342579729
driven_lanedir_consec_min0.3424264172773923
driven_lanedir_max0.8904446665936316
driven_lanedir_mean0.6302364342579729
driven_lanedir_median0.644037326580434
driven_lanedir_min0.3424264172773923
get_duckie_state_max3.988459958868512e-06
get_duckie_state_mean3.8021515791391023e-06
get_duckie_state_median3.793676818799823e-06
get_duckie_state_min3.632792720088253e-06
get_robot_state_max0.026547988255818684
get_robot_state_mean0.023755586442254378
get_robot_state_median0.023577274441045556
get_robot_state_min0.021319808631107724
get_state_dump_max0.021275886983582463
get_state_dump_mean0.019804589860150296
get_state_dump_median0.019451592525759877
get_state_dump_min0.019039287405498956
get_ui_image_max0.05062697692350908
get_ui_image_mean0.04928710285218278
get_ui_image_median0.04949394474221114
get_ui_image_min0.04753354500079977
in-drivable-lane_max4.699999999999983
in-drivable-lane_mean2.5374999999999917
in-drivable-lane_min0.3500000000000003
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.16193217979593, "get_ui_image": 0.04930550365124719, "step_physics": 0.1098276114059707, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6085881804686812, "get_state_dump": 0.019039287405498956, "sim_render-ego": 0.009538593938795187, "get_robot_state": 0.023935980715994107, "get_duckie_state": 3.988459958868512e-06, "in-drivable-lane": 1.1999999999999966, "agent_compute-ego": 0.02455101578922595, "deviation-heading": 0.27041081849249704, "complete-iteration": 0.2800320972830562, "set_robot_commands": 0.00763476905176195, "deviation-center-line": 0.1246386243322534, "driven_lanedir_consec": 0.6085881804686812, "sim_compute_sim_state": 0.029491574077282923, "sim_compute_performance-ego": 0.006501654447135278}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.5174263274303109, "get_ui_image": 0.04753354500079977, "step_physics": 0.10829164241922312, "survival_time": 1.4500000000000006, "driven_lanedir": 0.3424264172773923, "get_state_dump": 0.0197630421868686, "sim_render-ego": 0.00885516199572333, "get_robot_state": 0.021319808631107724, "get_duckie_state": 3.691377310917295e-06, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.024506420924745757, "deviation-heading": 0.3106738984320317, "complete-iteration": 0.2728979340915022, "set_robot_commands": 0.006593728887623754, "deviation-center-line": 0.07213333681968147, "driven_lanedir_consec": 0.3424264172773923, "sim_compute_sim_state": 0.029355361543852702, "sim_compute_performance-ego": 0.00646263155443915}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.835401090377117, "get_ui_image": 0.049682385833175094, "step_physics": 0.11206681463453504, "survival_time": 6.749999999999984, "driven_lanedir": 0.6794864726921869, "get_state_dump": 0.01914014286465115, "sim_render-ego": 0.009541605137012623, "get_robot_state": 0.02321856816609701, "get_duckie_state": 3.632792720088253e-06, "in-drivable-lane": 4.699999999999983, "agent_compute-ego": 0.02412889798482259, "deviation-heading": 0.41125078131929055, "complete-iteration": 0.2817021705486156, "set_robot_commands": 0.007278405295477973, "deviation-center-line": 0.08258355868343131, "driven_lanedir_consec": 0.6794864726921869, "sim_compute_sim_state": 0.03010997419004087, "sim_compute_performance-ego": 0.00631588653281883}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8894611145876907, "get_ui_image": 0.05062697692350908, "step_physics": 0.11829139788945515, "survival_time": 6.5999999999999845, "driven_lanedir": 0.8904446665936316, "get_state_dump": 0.021275886983582463, "sim_render-ego": 0.010724401835239294, "get_robot_state": 0.026547988255818684, "get_duckie_state": 3.895976326682351e-06, "in-drivable-lane": 3.899999999999986, "agent_compute-ego": 0.025358516158479633, "deviation-heading": 0.976837469261332, "complete-iteration": 0.30495126861514465, "set_robot_commands": 0.008331632975376013, "deviation-center-line": 0.1558386830383756, "driven_lanedir_consec": 0.8904446665936316, "sim_compute_sim_state": 0.036139636328726105, "sim_compute_performance-ego": 0.007416381980433609}}
set_robot_commands_max0.008331632975376013
set_robot_commands_mean0.007459634052559923
set_robot_commands_median0.007456587173619961
set_robot_commands_min0.006593728887623754
sim_compute_performance-ego_max0.007416381980433609
sim_compute_performance-ego_mean0.0066741386287067165
sim_compute_performance-ego_median0.006482143000787214
sim_compute_performance-ego_min0.00631588653281883
sim_compute_sim_state_max0.036139636328726105
sim_compute_sim_state_mean0.031274136534975655
sim_compute_sim_state_median0.029800774133661896
sim_compute_sim_state_min0.029355361543852702
sim_render-ego_max0.010724401835239294
sim_render-ego_mean0.00966494072669261
sim_render-ego_median0.009540099537903904
sim_render-ego_min0.00885516199572333
simulation-passed1
step_physics_max0.11829139788945515
step_physics_mean0.112119366587296
step_physics_median0.11094721302025289
step_physics_min0.10829164241922312
survival_time_max6.749999999999984
survival_time_mean4.437499999999992
survival_time_min1.4500000000000006
No reset possible
4085911276Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simfailednoreg01-bf67cb02b1e0-10:03:32
The container "solut [...]
The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4084811275Vincenzo Polizzi 🇮🇹template-randomaido5-LF-sim-validationLFv-simsuccessnoreg01-bf67cb02b1e0-10:04:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.644037326580434
survival_time_median4.7749999999999915
deviation-center-line_median0.10361109150784235
in-drivable-lane_median2.5499999999999914


other stats
agent_compute-ego_max0.03556448322231487
agent_compute-ego_mean0.02768359776329473
agent_compute-ego_median0.025610366330445195
agent_compute-ego_min0.023949175169973663
complete-iteration_max0.2973667563814105
complete-iteration_mean0.2863256441403867
complete-iteration_median0.28754473025167565
complete-iteration_min0.27284635967678494
deviation-center-line_max0.1558386830383756
deviation-center-line_mean0.10879855071843546
deviation-center-line_min0.07213333681968147
deviation-heading_max0.976837469261332
deviation-heading_mean0.4922932418762878
deviation-heading_median0.3609623398756611
deviation-heading_min0.27041081849249704
driven_any_max2.8894611145876907
driven_any_mean1.8510551780477624
driven_any_median1.9986666350865232
driven_any_min0.5174263274303109
driven_lanedir_consec_max0.8904446665936316
driven_lanedir_consec_mean0.6302364342579729
driven_lanedir_consec_min0.3424264172773923
driven_lanedir_max0.8904446665936316
driven_lanedir_mean0.6302364342579729
driven_lanedir_median0.644037326580434
driven_lanedir_min0.3424264172773923
get_duckie_state_max4.563508210358796e-06
get_duckie_state_mean3.906083447802386e-06
get_duckie_state_median3.730533138344261e-06
get_duckie_state_min3.5997593041622276e-06
get_robot_state_max0.025068324187706256
get_robot_state_mean0.02366354862681188
get_robot_state_median0.02403756998203419
get_robot_state_min0.02151073035547289
get_state_dump_max0.02163205712528552
get_state_dump_mean0.021156057138097747
get_state_dump_median0.021139081088726797
get_state_dump_min0.02071400924965187
get_ui_image_max0.05399126117512331
get_ui_image_mean0.04940758479576643
get_ui_image_median0.0482367855752648
get_ui_image_min0.04716550685741283
in-drivable-lane_max4.699999999999983
in-drivable-lane_mean2.5374999999999917
in-drivable-lane_min0.3500000000000003
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.16193217979593, "get_ui_image": 0.05399126117512331, "step_physics": 0.09932289689274156, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6085881804686812, "get_state_dump": 0.02163205712528552, "sim_render-ego": 0.012874510328648454, "get_robot_state": 0.02151073035547289, "get_duckie_state": 3.8025742870266153e-06, "in-drivable-lane": 1.1999999999999966, "agent_compute-ego": 0.03556448322231487, "deviation-heading": 0.27041081849249704, "complete-iteration": 0.291514772479817, "set_robot_commands": 0.007137589535470736, "deviation-center-line": 0.1246386243322534, "driven_lanedir_consec": 0.6085881804686812, "sim_compute_sim_state": 0.032633813761048396, "sim_compute_performance-ego": 0.006585650524850619}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.5174263274303109, "get_ui_image": 0.04785189135321256, "step_physics": 0.10543477124181289, "survival_time": 1.4500000000000006, "driven_lanedir": 0.3424264172773923, "get_state_dump": 0.02111670888703445, "sim_render-ego": 0.010035958783379916, "get_robot_state": 0.025068324187706256, "get_duckie_state": 3.6584919896619074e-06, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.02593060197501347, "deviation-heading": 0.3106738984320317, "complete-iteration": 0.2835746880235343, "set_robot_commands": 0.007550173792345771, "deviation-center-line": 0.07213333681968147, "driven_lanedir_consec": 0.3424264172773923, "sim_compute_sim_state": 0.03356700930102118, "sim_compute_performance-ego": 0.006772970331126246}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.835401090377117, "get_ui_image": 0.04716550685741283, "step_physics": 0.1028879236291956, "survival_time": 6.749999999999984, "driven_lanedir": 0.6794864726921869, "get_state_dump": 0.02071400924965187, "sim_render-ego": 0.00932642972027814, "get_robot_state": 0.023010949735288267, "get_duckie_state": 4.563508210358796e-06, "in-drivable-lane": 4.699999999999983, "agent_compute-ego": 0.025290130685876915, "deviation-heading": 0.41125078131929055, "complete-iteration": 0.27284635967678494, "set_robot_commands": 0.007355857778478552, "deviation-center-line": 0.08258355868343131, "driven_lanedir_consec": 0.6794864726921869, "sim_compute_sim_state": 0.030460308216236257, "sim_compute_performance-ego": 0.006397671169704861}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8894611145876907, "get_ui_image": 0.04862167979731704, "step_physics": 0.11898300683859622, "survival_time": 6.5999999999999845, "driven_lanedir": 0.8904446665936316, "get_state_dump": 0.021161453290419144, "sim_render-ego": 0.009659637104381214, "get_robot_state": 0.02506419022878011, "get_duckie_state": 3.5997593041622276e-06, "in-drivable-lane": 3.899999999999986, "agent_compute-ego": 0.023949175169973663, "deviation-heading": 0.976837469261332, "complete-iteration": 0.2973667563814105, "set_robot_commands": 0.007938796823674982, "deviation-center-line": 0.1558386830383756, "driven_lanedir_consec": 0.8904446665936316, "sim_compute_sim_state": 0.035374753402941155, "sim_compute_performance-ego": 0.00638259540904652}}
set_robot_commands_max0.007938796823674982
set_robot_commands_mean0.007495604482492511
set_robot_commands_median0.007453015785412161
set_robot_commands_min0.007137589535470736
sim_compute_performance-ego_max0.006772970331126246
sim_compute_performance-ego_mean0.0065347218586820615
sim_compute_performance-ego_median0.00649166084727774
sim_compute_performance-ego_min0.00638259540904652
sim_compute_sim_state_max0.035374753402941155
sim_compute_sim_state_mean0.03300897117031175
sim_compute_sim_state_median0.03310041153103479
sim_compute_sim_state_min0.030460308216236257
sim_render-ego_max0.012874510328648454
sim_render-ego_mean0.010474133984171932
sim_render-ego_median0.009847797943880566
sim_render-ego_min0.00932642972027814
simulation-passed1
step_physics_max0.11898300683859622
step_physics_mean0.10665714965058656
step_physics_median0.10416134743550425
step_physics_min0.09932289689274156
survival_time_max6.749999999999984
survival_time_mean4.437499999999992
survival_time_min1.4500000000000006
No reset possible