Duckietown Challenges Home Challenges Submissions

Evaluator 2265

ID2265
evaluatorreg02-2604b9bb4859-1
ownerI don't have one 😀
machinearchimede
processreg02-2604b9bb4859-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success5 40841
# timeout
# failed1 40883
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
4090710818Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg02-2604b9bb4859-10:11:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9525783651613065
survival_time_median14.950000000000076
deviation-center-line_median0.5026453642178077
in-drivable-lane_median9.375000000000057


other stats
agent_compute-ego_max0.027380786736806235
agent_compute-ego_mean0.026263659545895067
agent_compute-ego_median0.026150013902021665
agent_compute-ego_min0.025373823642730713
complete-iteration_max0.29173978726069133
complete-iteration_mean0.28555745395179066
complete-iteration_median0.2840385479163225
complete-iteration_min0.2824129327138265
deviation-center-line_max0.6568315269936894
deviation-center-line_mean0.43808936633920725
deviation-center-line_min0.0902352099275243
deviation-heading_max2.187282514315135
deviation-heading_mean1.553009538680307
deviation-heading_median1.6825435981252617
deviation-heading_min0.6596684441555696
driven_any_max3.0631105789493343
driven_any_mean3.018651151260443
driven_any_median3.0580613112768944
driven_any_min2.8953714035386495
driven_lanedir_consec_max1.097260994447712
driven_lanedir_consec_mean0.8121615978711858
driven_lanedir_consec_min0.24622866671441823
driven_lanedir_max1.097260994447712
driven_lanedir_mean0.8121615978711858
driven_lanedir_median0.9525783651613065
driven_lanedir_min0.24622866671441823
get_duckie_state_max4.185835520426433e-06
get_duckie_state_mean3.7879306379841695e-06
get_duckie_state_median3.699858983357748e-06
get_duckie_state_min3.5661690647947493e-06
get_robot_state_max0.024281725883483887
get_robot_state_mean0.024057918011229508
get_robot_state_median0.024046918948491414
get_robot_state_min0.023856108264451312
get_state_dump_max0.020552684466044108
get_state_dump_mean0.019876888805761217
get_state_dump_median0.019691896466680917
get_state_dump_min0.019571077823638917
get_ui_image_max0.04964108770390702
get_ui_image_mean0.0490311137470115
get_ui_image_median0.04899611393610637
get_ui_image_min0.048491139411926266
in-drivable-lane_max13.250000000000076
in-drivable-lane_mean10.13750000000006
in-drivable-lane_min8.550000000000054
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.053081760832301, "get_ui_image": 0.04927989800771077, "step_physics": 0.10668439706166584, "survival_time": 14.950000000000076, "driven_lanedir": 1.097260994447712, "get_state_dump": 0.01978756586710612, "sim_render-ego": 0.009723137219746908, "get_robot_state": 0.024281725883483887, "get_duckie_state": 4.185835520426433e-06, "in-drivable-lane": 9.100000000000062, "agent_compute-ego": 0.026823743979136148, "deviation-heading": 1.397960641669258, "complete-iteration": 0.2824129327138265, "set_robot_commands": 0.007569904327392578, "deviation-center-line": 0.6568315269936894, "driven_lanedir_consec": 1.097260994447712, "sim_compute_sim_state": 0.03146490176518758, "sim_compute_performance-ego": 0.006565295855204265}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.8953714035386495, "get_ui_image": 0.04964108770390702, "step_physics": 0.11200505094898884, "survival_time": 14.150000000000066, "driven_lanedir": 0.9673552720772104, "get_state_dump": 0.01959622706625571, "sim_render-ego": 0.009255357007677056, "get_robot_state": 0.023856108264451312, "get_duckie_state": 3.5661690647947493e-06, "in-drivable-lane": 8.550000000000054, "agent_compute-ego": 0.025476283824907176, "deviation-heading": 2.187282514315135, "complete-iteration": 0.2839208575946282, "set_robot_commands": 0.0071889756003875194, "deviation-center-line": 0.48982968675905414, "driven_lanedir_consec": 0.9673552720772104, "sim_compute_sim_state": 0.0304868667791252, "sim_compute_performance-ego": 0.006190311782351653}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.0631105789493343, "get_ui_image": 0.048712329864501955, "step_physics": 0.11005751927693684, "survival_time": 14.950000000000076, "driven_lanedir": 0.24622866671441823, "get_state_dump": 0.019571077823638917, "sim_render-ego": 0.009498177369435628, "get_robot_state": 0.02402005116144816, "get_duckie_state": 3.7693977355957032e-06, "in-drivable-lane": 13.250000000000076, "agent_compute-ego": 0.027380786736806235, "deviation-heading": 0.6596684441555696, "complete-iteration": 0.2841562382380168, "set_robot_commands": 0.007371547222137451, "deviation-center-line": 0.0902352099275243, "driven_lanedir_consec": 0.24622866671441823, "sim_compute_sim_state": 0.030964653491973877, "sim_compute_performance-ego": 0.006353898048400879}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.0630408617214875, "get_ui_image": 0.048491139411926266, "step_physics": 0.1151468594868978, "survival_time": 14.950000000000076, "driven_lanedir": 0.9378014582454022, "get_state_dump": 0.020552684466044108, "sim_render-ego": 0.009230737686157226, "get_robot_state": 0.024073786735534668, "get_duckie_state": 3.630320231119792e-06, "in-drivable-lane": 9.650000000000052, "agent_compute-ego": 0.025373823642730713, "deviation-heading": 1.9671265545812653, "complete-iteration": 0.29173978726069133, "set_robot_commands": 0.007351448535919189, "deviation-center-line": 0.5154610416765611, "driven_lanedir_consec": 0.9378014582454022, "sim_compute_sim_state": 0.03500971555709839, "sim_compute_performance-ego": 0.006289611657460531}}
set_robot_commands_max0.007569904327392578
set_robot_commands_mean0.007370468921459185
set_robot_commands_median0.00736149787902832
set_robot_commands_min0.0071889756003875194
sim_compute_performance-ego_max0.006565295855204265
sim_compute_performance-ego_mean0.006349779335854332
sim_compute_performance-ego_median0.006321754852930705
sim_compute_performance-ego_min0.006190311782351653
sim_compute_sim_state_max0.03500971555709839
sim_compute_sim_state_mean0.031981534398346265
sim_compute_sim_state_median0.031214777628580728
sim_compute_sim_state_min0.0304868667791252
sim_render-ego_max0.009723137219746908
sim_render-ego_mean0.009426852320754206
sim_render-ego_median0.009376767188556342
sim_render-ego_min0.009230737686157226
simulation-passed1
step_physics_max0.1151468594868978
step_physics_mean0.11097345669362234
step_physics_median0.11103128511296284
step_physics_min0.10668439706166584
survival_time_max14.950000000000076
survival_time_mean14.750000000000076
survival_time_min14.150000000000066
No reset possible
4089210827Daniil Lisussim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg02-2604b9bb4859-10:11:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8724774206853052
survival_time_median14.950000000000076
deviation-center-line_median0.33545282964972034
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.02621766964594523
agent_compute-ego_mean0.02567162871360779
agent_compute-ego_median0.02568915843963623
agent_compute-ego_min0.02509052832921346
complete-iteration_max0.2871403439839681
complete-iteration_mean0.2802893618742625
complete-iteration_median0.2788109302520752
complete-iteration_min0.2763952430089315
deviation-center-line_max0.5214510029833583
deviation-center-line_mean0.33313323594018146
deviation-center-line_min0.1401762814779268
deviation-heading_max3.873375191927797
deviation-heading_mean1.790805460996214
deviation-heading_median1.2628398469900248
deviation-heading_min0.7641669580770103
driven_any_max2.012657917083782
driven_any_mean1.7308589518020518
driven_any_median1.883318152219332
driven_any_min1.1441415856857613
driven_lanedir_consec_max2.009204302920517
driven_lanedir_consec_mean1.6059609833344504
driven_lanedir_consec_min0.6696847890466744
driven_lanedir_max2.009204302920517
driven_lanedir_mean1.6059609833344504
driven_lanedir_median1.8724774206853052
driven_lanedir_min0.6696847890466744
get_duckie_state_max3.631909688313802e-06
get_duckie_state_mean3.517866134643555e-06
get_duckie_state_median3.4940242767333987e-06
get_duckie_state_min3.45150629679362e-06
get_robot_state_max0.0241627836227417
get_robot_state_mean0.02378840883572896
get_robot_state_median0.023862621386845907
get_robot_state_min0.02326560894648234
get_state_dump_max0.020614293416341144
get_state_dump_mean0.019911786715189617
get_state_dump_median0.019940882921218872
get_state_dump_min0.019151087601979574
get_ui_image_max0.04857234875361125
get_ui_image_mean0.04787679811318715
get_ui_image_median0.04782324194908143
get_ui_image_min0.047288359800974525
in-drivable-lane_max4.600000000000065
in-drivable-lane_mean1.1500000000000163
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.8011995750891785, "get_ui_image": 0.04857234875361125, "step_physics": 0.10919989903767904, "survival_time": 14.950000000000076, "driven_lanedir": 1.7831754839110403, "get_state_dump": 0.019151087601979574, "sim_render-ego": 0.009490173657735189, "get_robot_state": 0.023687243461608887, "get_duckie_state": 3.631909688313802e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02579444885253906, "deviation-heading": 1.7095740319251462, "complete-iteration": 0.28078060229619345, "set_robot_commands": 0.007444713115692139, "deviation-center-line": 0.5147972571669645, "driven_lanedir_consec": 1.7831754839110403, "sim_compute_sim_state": 0.03106516202290853, "sim_compute_performance-ego": 0.0061644371350606285}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.012657917083782, "get_ui_image": 0.04810601313908895, "step_physics": 0.10740338643391928, "survival_time": 14.950000000000076, "driven_lanedir": 2.009204302920517, "get_state_dump": 0.0200835649172465, "sim_render-ego": 0.009135198593139647, "get_robot_state": 0.02326560894648234, "get_duckie_state": 3.4626324971516927e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02509052832921346, "deviation-heading": 0.8161056620549035, "complete-iteration": 0.27684125820795696, "set_robot_commands": 0.007467544078826905, "deviation-center-line": 0.1561084021324763, "driven_lanedir_consec": 2.009204302920517, "sim_compute_sim_state": 0.029915424187978108, "sim_compute_performance-ego": 0.0061636543273925785}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.1441415856857613, "get_ui_image": 0.047288359800974525, "step_physics": 0.10444473584493, "survival_time": 14.950000000000076, "driven_lanedir": 0.6696847890466744, "get_state_dump": 0.020614293416341144, "sim_render-ego": 0.009875465234120686, "get_robot_state": 0.0241627836227417, "get_duckie_state": 3.5254160563151043e-06, "in-drivable-lane": 4.600000000000065, "agent_compute-ego": 0.02621766964594523, "deviation-heading": 3.873375191927797, "complete-iteration": 0.2763952430089315, "set_robot_commands": 0.007752821445465088, "deviation-center-line": 0.5214510029833583, "driven_lanedir_consec": 0.6696847890466744, "sim_compute_sim_state": 0.029351131916046144, "sim_compute_performance-ego": 0.006468915939331054}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9654367293494857, "get_ui_image": 0.047540470759073895, "step_physics": 0.11171908934911091, "survival_time": 14.950000000000076, "driven_lanedir": 1.9617793574595697, "get_state_dump": 0.019798200925191245, "sim_render-ego": 0.009578760464986165, "get_robot_state": 0.024037999312082926, "get_duckie_state": 3.45150629679362e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0255838680267334, "deviation-heading": 0.7641669580770103, "complete-iteration": 0.2871403439839681, "set_robot_commands": 0.008160091241200765, "deviation-center-line": 0.1401762814779268, "driven_lanedir_consec": 1.9617793574595697, "sim_compute_sim_state": 0.0340734068552653, "sim_compute_performance-ego": 0.0064318466186523435}}
set_robot_commands_max0.008160091241200765
set_robot_commands_mean0.007706292470296224
set_robot_commands_median0.007610182762145996
set_robot_commands_min0.007444713115692139
sim_compute_performance-ego_max0.006468915939331054
sim_compute_performance-ego_mean0.0063072135051091514
sim_compute_performance-ego_median0.006298141876856486
sim_compute_performance-ego_min0.0061636543273925785
sim_compute_sim_state_max0.0340734068552653
sim_compute_sim_state_mean0.03110128124554952
sim_compute_sim_state_median0.03049029310544332
sim_compute_sim_state_min0.029351131916046144
sim_render-ego_max0.009875465234120686
sim_render-ego_mean0.009519899487495424
sim_render-ego_median0.009534467061360677
sim_render-ego_min0.009135198593139647
simulation-passed1
step_physics_max0.11171908934911091
step_physics_mean0.1081917776664098
step_physics_median0.10830164273579916
step_physics_min0.10444473584493
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4088310833Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednoreg02-2604b9bb4859-10:03:46
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 56 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4086910840Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg02-2604b9bb4859-10:10:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7661944950750957
survival_time_median14.000000000000064
deviation-center-line_median0.34422870105673475
in-drivable-lane_median9.350000000000044


other stats
agent_compute-ego_max0.027734317779541016
agent_compute-ego_mean0.026301742823500385
agent_compute-ego_median0.026188835053515613
agent_compute-ego_min0.02509498340742929
complete-iteration_max0.30426282031195506
complete-iteration_mean0.2912435105915862
complete-iteration_median0.2872560828734575
complete-iteration_min0.2861990563074748
deviation-center-line_max0.3985311085835008
deviation-center-line_mean0.30339399949188767
deviation-center-line_min0.12658748727058042
deviation-heading_max2.1110873941940267
deviation-heading_mean1.6253103661490311
deviation-heading_median1.869584297140099
deviation-heading_min0.6509854761219004
driven_any_max3.0631166735872335
driven_any_mean2.8247880444337943
driven_any_median2.8639829212098453
driven_any_min2.5080696617282534
driven_lanedir_consec_max0.9059184082022842
driven_lanedir_consec_mean0.6949703362408273
driven_lanedir_consec_min0.3415739466108333
driven_lanedir_max0.9059184082022842
driven_lanedir_mean0.6949703362408273
driven_lanedir_median0.7661944950750957
driven_lanedir_min0.3415739466108333
get_duckie_state_max4.046359042889676e-06
get_duckie_state_mean3.8899548232543896e-06
get_duckie_state_median3.903025672549293e-06
get_duckie_state_min3.707408905029297e-06
get_robot_state_max0.02455411979130336
get_robot_state_mean0.024158840294412412
get_robot_state_median0.02412792697126566
get_robot_state_min0.02382538744381496
get_state_dump_max0.022768478734152657
get_state_dump_mean0.020480210751565132
get_state_dump_median0.0199272726830982
get_state_dump_min0.019297818905911465
get_ui_image_max0.04990995441164289
get_ui_image_mean0.04964556201737994
get_ui_image_median0.04975105635067712
get_ui_image_min0.049170180956522626
in-drivable-lane_max12.850000000000076
in-drivable-lane_mean9.70000000000005
in-drivable-lane_min7.25000000000004
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.5080696617282534, "get_ui_image": 0.0498593114165642, "step_physics": 0.11246143951107132, "survival_time": 12.35000000000004, "driven_lanedir": 0.8832146459930077, "get_state_dump": 0.019297818905911465, "sim_render-ego": 0.009617014935142117, "get_robot_state": 0.023982549003261303, "get_duckie_state": 4.046359042889676e-06, "in-drivable-lane": 7.25000000000004, "agent_compute-ego": 0.02580957663686652, "deviation-heading": 1.8349290417128248, "complete-iteration": 0.28765972423167363, "set_robot_commands": 0.007327101008612134, "deviation-center-line": 0.3985311085835008, "driven_lanedir_consec": 0.8832146459930077, "sim_compute_sim_state": 0.032695193039743525, "sim_compute_performance-ego": 0.006393901732286461}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.8639813714638427, "get_ui_image": 0.04990995441164289, "step_physics": 0.10987504635538374, "survival_time": 14.000000000000064, "driven_lanedir": 0.9059184082022842, "get_state_dump": 0.02021069186074393, "sim_render-ego": 0.009808118854250227, "get_robot_state": 0.02455411979130336, "get_duckie_state": 3.841945103236607e-06, "in-drivable-lane": 8.750000000000044, "agent_compute-ego": 0.026568093470164707, "deviation-heading": 2.1110873941940267, "complete-iteration": 0.28685244151524136, "set_robot_commands": 0.007615331241062709, "deviation-center-line": 0.3648355722272073, "driven_lanedir_consec": 0.9059184082022842, "sim_compute_sim_state": 0.03124795130320958, "sim_compute_performance-ego": 0.006839218309947423}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.0631166735872335, "get_ui_image": 0.049170180956522626, "step_physics": 0.1100918173789978, "survival_time": 14.950000000000076, "driven_lanedir": 0.3415739466108333, "get_state_dump": 0.01964385350545247, "sim_render-ego": 0.009854551951090494, "get_robot_state": 0.02427330493927002, "get_duckie_state": 3.964106241861979e-06, "in-drivable-lane": 12.850000000000076, "agent_compute-ego": 0.027734317779541016, "deviation-heading": 0.6509854761219004, "complete-iteration": 0.2861990563074748, "set_robot_commands": 0.007851118246714275, "deviation-center-line": 0.12658748727058042, "driven_lanedir_consec": 0.3415739466108333, "sim_compute_sim_state": 0.030807369550069172, "sim_compute_performance-ego": 0.006551632086435954}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8639844709558475, "get_ui_image": 0.04964280128479004, "step_physics": 0.12449797902788434, "survival_time": 14.000000000000064, "driven_lanedir": 0.6491743441571838, "get_state_dump": 0.022768478734152657, "sim_render-ego": 0.009091033254350936, "get_robot_state": 0.02382538744381496, "get_duckie_state": 3.707408905029297e-06, "in-drivable-lane": 9.950000000000042, "agent_compute-ego": 0.02509498340742929, "deviation-heading": 1.904239552567374, "complete-iteration": 0.30426282031195506, "set_robot_commands": 0.007227375677653722, "deviation-center-line": 0.32362182988626226, "driven_lanedir_consec": 0.6491743441571838, "sim_compute_sim_state": 0.03591059020587376, "sim_compute_performance-ego": 0.005985928433282035}}
set_robot_commands_max0.007851118246714275
set_robot_commands_mean0.007505231543510711
set_robot_commands_median0.007471216124837422
set_robot_commands_min0.007227375677653722
sim_compute_performance-ego_max0.006839218309947423
sim_compute_performance-ego_mean0.006442670140487968
sim_compute_performance-ego_median0.0064727669093612075
sim_compute_performance-ego_min0.005985928433282035
sim_compute_sim_state_max0.03591059020587376
sim_compute_sim_state_mean0.03266527602472401
sim_compute_sim_state_median0.03197157217147655
sim_compute_sim_state_min0.030807369550069172
sim_render-ego_max0.009854551951090494
sim_render-ego_mean0.009592679748708442
sim_render-ego_median0.00971256689469617
sim_render-ego_min0.009091033254350936
simulation-passed1
step_physics_max0.12449797902788434
step_physics_mean0.1142315705683343
step_physics_median0.11127662844503455
step_physics_min0.10987504635538374
survival_time_max14.950000000000076
survival_time_mean13.82500000000006
survival_time_min12.35000000000004
No reset possible
4085510845Daniil Lisussim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg02-2604b9bb4859-10:09:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.733953061069872
survival_time_median14.075000000000063
deviation-center-line_median0.2136431938238394
in-drivable-lane_median7.775000000000079


other stats
agent_compute-ego_max0.031001547972361248
agent_compute-ego_mean0.027516193814349894
agent_compute-ego_median0.026627182761828107
agent_compute-ego_min0.025808861761382133
complete-iteration_max0.2939345180988312
complete-iteration_mean0.28627622121211255
complete-iteration_median0.2849782471584551
complete-iteration_min0.28121387243270873
deviation-center-line_max0.2999240306914739
deviation-center-line_mean0.2037347973736406
deviation-center-line_min0.08772877115540961
deviation-heading_max0.8643821319018155
deviation-heading_mean0.7107480215756272
deviation-heading_median0.7172560273288147
deviation-heading_min0.5440978997430643
driven_any_max2.8308871532919055
driven_any_mean2.732013752787295
driven_any_median2.718439617089528
driven_any_min2.660288623678218
driven_lanedir_consec_max1.9817237810736228
driven_lanedir_consec_mean1.5284347228478463
driven_lanedir_consec_min0.6641089881780182
driven_lanedir_max1.9817237810736228
driven_lanedir_mean1.5284347228478463
driven_lanedir_median1.733953061069872
driven_lanedir_min0.6641089881780182
get_duckie_state_max4.511890989361388e-06
get_duckie_state_mean4.110092466527765e-06
get_duckie_state_median4.22815481821696e-06
get_duckie_state_min3.472169240315755e-06
get_robot_state_max0.02488506038983663
get_robot_state_mean0.0241186719139417
get_robot_state_median0.02435136040051778
get_robot_state_min0.02288690646489461
get_state_dump_max0.025090978542963664
get_state_dump_mean0.02106049208930044
get_state_dump_median0.020059503696181556
get_state_dump_min0.019031982421875
get_ui_image_max0.04863913138707479
get_ui_image_mean0.047656287514802186
get_ui_image_median0.04754006338841987
get_ui_image_min0.04690589189529419
in-drivable-lane_max8.300000000000093
in-drivable-lane_mean6.925000000000059
in-drivable-lane_min3.8499999999999863
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.715187293233737, "get_ui_image": 0.04789263551885432, "step_physics": 0.10860840027982538, "survival_time": 13.200000000000053, "driven_lanedir": 1.4979960585881391, "get_state_dump": 0.019810225927468506, "sim_render-ego": 0.009736823313163988, "get_robot_state": 0.024464507897694904, "get_duckie_state": 4.511890989361388e-06, "in-drivable-lane": 7.700000000000064, "agent_compute-ego": 0.025808861761382133, "deviation-heading": 0.5760503028724892, "complete-iteration": 0.28162198716943915, "set_robot_commands": 0.007392869754271073, "deviation-center-line": 0.15392562928201486, "driven_lanedir_consec": 1.4979960585881391, "sim_compute_sim_state": 0.03135209372549346, "sim_compute_performance-ego": 0.006329034314011083}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.7216919409453184, "get_ui_image": 0.04690589189529419, "step_physics": 0.1036742107073466, "survival_time": 14.950000000000076, "driven_lanedir": 1.969910063551605, "get_state_dump": 0.020308781464894617, "sim_render-ego": 0.00959525187810262, "get_robot_state": 0.024238212903340654, "get_duckie_state": 3.964106241861979e-06, "in-drivable-lane": 7.850000000000095, "agent_compute-ego": 0.031001547972361248, "deviation-heading": 0.8584617517851402, "complete-iteration": 0.28121387243270873, "set_robot_commands": 0.007655280431111654, "deviation-center-line": 0.2999240306914739, "driven_lanedir_consec": 1.969910063551605, "sim_compute_sim_state": 0.030857568581899007, "sim_compute_performance-ego": 0.006759703159332275}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8308871532919055, "get_ui_image": 0.04718749125798543, "step_physics": 0.10727670391400657, "survival_time": 5.999999999999987, "driven_lanedir": 0.6641089881780182, "get_state_dump": 0.025090978542963664, "sim_render-ego": 0.009779576460520427, "get_robot_state": 0.02488506038983663, "get_duckie_state": 4.49220339457194e-06, "in-drivable-lane": 3.8499999999999863, "agent_compute-ego": 0.0273806631565094, "deviation-heading": 0.5440978997430643, "complete-iteration": 0.2939345180988312, "set_robot_commands": 0.008198519547780355, "deviation-center-line": 0.08772877115540961, "driven_lanedir_consec": 0.6641089881780182, "sim_compute_sim_state": 0.032210598389307656, "sim_compute_performance-ego": 0.011699171861012776}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.660288623678218, "get_ui_image": 0.04863913138707479, "step_physics": 0.11449771563212076, "survival_time": 14.950000000000076, "driven_lanedir": 1.9817237810736228, "get_state_dump": 0.019031982421875, "sim_render-ego": 0.009236001173655192, "get_robot_state": 0.02288690646489461, "get_duckie_state": 3.472169240315755e-06, "in-drivable-lane": 8.300000000000093, "agent_compute-ego": 0.02587370236714681, "deviation-heading": 0.8643821319018155, "complete-iteration": 0.2883345071474711, "set_robot_commands": 0.007056273619333903, "deviation-center-line": 0.2733607583656639, "driven_lanedir_consec": 1.9817237810736228, "sim_compute_sim_state": 0.03487813870112101, "sim_compute_performance-ego": 0.006026208400726318}}
set_robot_commands_max0.008198519547780355
set_robot_commands_mean0.007575735838124246
set_robot_commands_median0.007524075092691363
set_robot_commands_min0.007056273619333903
sim_compute_performance-ego_max0.011699171861012776
sim_compute_performance-ego_mean0.007703529433770613
sim_compute_performance-ego_median0.006544368736671679
sim_compute_performance-ego_min0.006026208400726318
sim_compute_sim_state_max0.03487813870112101
sim_compute_sim_state_mean0.03232459984945528
sim_compute_sim_state_median0.03178134605740056
sim_compute_sim_state_min0.030857568581899007
sim_render-ego_max0.009779576460520427
sim_render-ego_mean0.009586913206360556
sim_render-ego_median0.009666037595633304
sim_render-ego_min0.009236001173655192
simulation-passed1
step_physics_max0.11449771563212076
step_physics_mean0.10851425763332484
step_physics_median0.10794255209691596
step_physics_min0.1036742107073466
survival_time_max14.950000000000076
survival_time_mean12.275000000000048
survival_time_min5.999999999999987
No reset possible
4084110854Dishank Bansal 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg02-2604b9bb4859-10:11:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.1749782887017877
survival_time_median14.950000000000076
deviation-center-line_median0.5467312740502002
in-drivable-lane_median1.8750000000000264


other stats
agent_compute-ego_max0.05781049966812134
agent_compute-ego_mean0.03379891812801361
agent_compute-ego_median0.02605143944422404
agent_compute-ego_min0.025282293955485025
complete-iteration_max0.3332600951194763
complete-iteration_mean0.29689807017644243
complete-iteration_median0.2865643505255381
complete-iteration_min0.28120348453521726
deviation-center-line_max0.5588575695184083
deviation-center-line_mean0.545224880643238
deviation-center-line_min0.5285794049541431
deviation-heading_max3.2986341397251966
deviation-heading_mean2.3385176135073342
deviation-heading_median2.1109301097394626
deviation-heading_min1.833576094825216
driven_any_max2.552597583541419
driven_any_mean2.5504834008604504
driven_any_median2.5525598454876786
driven_any_min2.544216328925026
driven_lanedir_consec_max2.448759654346965
driven_lanedir_consec_mean2.01774317876381
driven_lanedir_consec_min1.2722564833046983
driven_lanedir_max2.448759654346965
driven_lanedir_mean2.01774317876381
driven_lanedir_median2.1749782887017877
driven_lanedir_min1.2722564833046983
get_duckie_state_max3.6104520161946617e-06
get_duckie_state_mean3.3781925837198895e-06
get_duckie_state_median3.368854522705078e-06
get_duckie_state_min3.1646092732747396e-06
get_robot_state_max0.024446487426757812
get_robot_state_mean0.023291955987612405
get_robot_state_median0.02313473065694173
get_robot_state_min0.02245187520980835
get_state_dump_max0.020345040957132975
get_state_dump_mean0.019177523652712504
get_state_dump_median0.01889646530151367
get_state_dump_min0.0185721230506897
get_ui_image_max0.05278237660725912
get_ui_image_mean0.049881435235341394
get_ui_image_median0.04926106929779053
get_ui_image_min0.04822122573852539
in-drivable-lane_max7.000000000000098
in-drivable-lane_mean2.6875000000000377
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.544216328925026, "get_ui_image": 0.04912227312723796, "step_physics": 0.11015153090159098, "survival_time": 14.950000000000076, "driven_lanedir": 2.448759654346965, "get_state_dump": 0.019200225671132404, "sim_render-ego": 0.00939779043197632, "get_robot_state": 0.023422062397003177, "get_duckie_state": 3.6104520161946617e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.025282293955485025, "deviation-heading": 3.2986341397251966, "complete-iteration": 0.28120348453521726, "set_robot_commands": 0.007201700210571289, "deviation-center-line": 0.5588575695184083, "driven_lanedir_consec": 2.448759654346965, "sim_compute_sim_state": 0.03101707379023234, "sim_compute_performance-ego": 0.006206909020741781}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.552597583541419, "get_ui_image": 0.0493998654683431, "step_physics": 0.11392552455266317, "survival_time": 14.950000000000076, "driven_lanedir": 2.107924860176899, "get_state_dump": 0.0185721230506897, "sim_render-ego": 0.009067575136820476, "get_robot_state": 0.02245187520980835, "get_duckie_state": 3.3855438232421873e-06, "in-drivable-lane": 2.3000000000000327, "agent_compute-ego": 0.025636165142059325, "deviation-heading": 1.92014967766772, "complete-iteration": 0.2824948517481486, "set_robot_commands": 0.007043680349985758, "deviation-center-line": 0.5441717655061173, "driven_lanedir_consec": 2.107924860176899, "sim_compute_sim_state": 0.030124355951944987, "sim_compute_performance-ego": 0.006078532536824544}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.5525419863644077, "get_ui_image": 0.04822122573852539, "step_physics": 0.121710311571757, "survival_time": 14.950000000000076, "driven_lanedir": 1.2722564833046983, "get_state_dump": 0.018592704931894934, "sim_render-ego": 0.009299294153849284, "get_robot_state": 0.02284739891688029, "get_duckie_state": 3.1646092732747396e-06, "in-drivable-lane": 7.000000000000098, "agent_compute-ego": 0.026466713746388752, "deviation-heading": 1.833576094825216, "complete-iteration": 0.2906338493029276, "set_robot_commands": 0.007174294789632161, "deviation-center-line": 0.5285794049541431, "driven_lanedir_consec": 1.2722564833046983, "sim_compute_sim_state": 0.030077872276306154, "sim_compute_performance-ego": 0.0060456260045369465}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.552577704610949, "get_ui_image": 0.05278237660725912, "step_physics": 0.11388709863026936, "survival_time": 14.950000000000076, "driven_lanedir": 2.242031717226676, "get_state_dump": 0.020345040957132975, "sim_render-ego": 0.0110693359375, "get_robot_state": 0.024446487426757812, "get_duckie_state": 3.352165222167969e-06, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.05781049966812134, "deviation-heading": 2.301710541811205, "complete-iteration": 0.3332600951194763, "set_robot_commands": 0.008950979709625244, "deviation-center-line": 0.549290782594283, "driven_lanedir_consec": 2.242031717226676, "sim_compute_sim_state": 0.036058788299560544, "sim_compute_performance-ego": 0.007701196670532227}}
set_robot_commands_max0.008950979709625244
set_robot_commands_mean0.007592663764953614
set_robot_commands_median0.0071879975001017254
set_robot_commands_min0.007043680349985758
sim_compute_performance-ego_max0.007701196670532227
sim_compute_performance-ego_mean0.006508066058158874
sim_compute_performance-ego_median0.006142720778783162
sim_compute_performance-ego_min0.0060456260045369465
sim_compute_sim_state_max0.036058788299560544
sim_compute_sim_state_mean0.031819522579511005
sim_compute_sim_state_median0.030570714871088665
sim_compute_sim_state_min0.030077872276306154
sim_render-ego_max0.0110693359375
sim_render-ego_mean0.009708498915036518
sim_render-ego_median0.0093485422929128
sim_render-ego_min0.009067575136820476
simulation-passed1
step_physics_max0.121710311571757
step_physics_mean0.11491861641407013
step_physics_median0.11390631159146627
step_physics_min0.11015153090159098
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible