Duckietown Challenges Home Challenges Submissions

Evaluator 2267

ID2267
evaluatormont03-614c9626f856-1
ownerI don't have one 😀
machineaido-ms-7b09
processmont03-614c9626f856-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success5 40843
# timeout
# failed3 40852
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
4090210821Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnomont03-614c9626f856-10:09:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8624028250066864
survival_time_median14.950000000000076
deviation-center-line_median0.605484139935862
in-drivable-lane_median0.6750000000000096


other stats
agent_compute-ego_max0.01775276740392049
agent_compute-ego_mean0.017640490134557086
agent_compute-ego_median0.017628781398137408
agent_compute-ego_min0.01755163033803304
complete-iteration_max0.21164194345474244
complete-iteration_mean0.20599645197391508
complete-iteration_median0.2052887201309204
complete-iteration_min0.20176642417907711
deviation-center-line_max0.9937529147370228
deviation-center-line_mean0.6835006023131335
deviation-center-line_min0.5292812146437869
deviation-heading_max3.652081547540867
deviation-heading_mean2.591004326424897
deviation-heading_median2.544119062952782
deviation-heading_min1.6236976322531589
driven_any_max2.0339646538026717
driven_any_mean2.0238003333351395
driven_any_median2.0246475520846214
driven_any_min2.0119415753686445
driven_lanedir_consec_max1.9439257780335215
driven_lanedir_consec_mean1.8600804035604523
driven_lanedir_consec_min1.771590186194914
driven_lanedir_max1.9439257780335215
driven_lanedir_mean1.8600804035604523
driven_lanedir_median1.8624028250066864
driven_lanedir_min1.771590186194914
get_duckie_state_max2.741018931070963e-06
get_duckie_state_mean2.610484759012858e-06
get_duckie_state_median2.613464991251627e-06
get_duckie_state_min2.4739901224772136e-06
get_robot_state_max0.01617465098698934
get_robot_state_mean0.01590767502784729
get_robot_state_median0.015878691673278808
get_robot_state_min0.015698665777842204
get_state_dump_max0.013766826788584392
get_state_dump_mean0.013556135296821594
get_state_dump_median0.013507930835088094
get_state_dump_min0.013441852728525798
get_ui_image_max0.03695603052775065
get_ui_image_mean0.03644620597362518
get_ui_image_median0.036701500415802
get_ui_image_min0.03542579253514608
in-drivable-lane_max1.40000000000002
in-drivable-lane_mean0.7375000000000105
in-drivable-lane_min0.20000000000000284
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.0339646538026717, "get_ui_image": 0.03542579253514608, "step_physics": 0.07961811463038126, "survival_time": 14.950000000000076, "driven_lanedir": 1.7843670369410591, "get_state_dump": 0.013554845650990804, "sim_render-ego": 0.006233961582183838, "get_robot_state": 0.016013236045837403, "get_duckie_state": 2.6154518127441408e-06, "in-drivable-lane": 1.40000000000002, "agent_compute-ego": 0.01755163033803304, "deviation-heading": 2.652058512418452, "complete-iteration": 0.20176642417907711, "set_robot_commands": 0.004922943909962972, "deviation-center-line": 0.6624737188589264, "driven_lanedir_consec": 1.7843670369410591, "sim_compute_sim_state": 0.024179970423380538, "sim_compute_performance-ego": 0.004122294584910075}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.025059227392998, "get_ui_image": 0.03668891509373983, "step_physics": 0.08009611924489339, "survival_time": 14.950000000000076, "driven_lanedir": 1.9439257780335215, "get_state_dump": 0.013441852728525798, "sim_render-ego": 0.0062000409762064616, "get_robot_state": 0.015698665777842204, "get_duckie_state": 2.6114781697591145e-06, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.017605907917022705, "deviation-heading": 2.4361796134871123, "complete-iteration": 0.2022429609298706, "set_robot_commands": 0.005004283587137858, "deviation-center-line": 0.5292812146437869, "driven_lanedir_consec": 1.9439257780335215, "sim_compute_sim_state": 0.023236531416575112, "sim_compute_performance-ego": 0.004116068681081136}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.0119415753686445, "get_ui_image": 0.03695603052775065, "step_physics": 0.08440409898757935, "survival_time": 14.950000000000076, "driven_lanedir": 1.771590186194914, "get_state_dump": 0.013766826788584392, "sim_render-ego": 0.00621977965037028, "get_robot_state": 0.01617465098698934, "get_duckie_state": 2.741018931070963e-06, "in-drivable-lane": 1.050000000000015, "agent_compute-ego": 0.01775276740392049, "deviation-heading": 3.652081547540867, "complete-iteration": 0.20833447933197025, "set_robot_commands": 0.005006892681121826, "deviation-center-line": 0.9937529147370228, "driven_lanedir_consec": 1.771590186194914, "sim_compute_sim_state": 0.02370668093363444, "sim_compute_performance-ego": 0.004195714791615804}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.0242358767762454, "get_ui_image": 0.03671408573786417, "step_physics": 0.08600595076878866, "survival_time": 14.950000000000076, "driven_lanedir": 1.940438613072314, "get_state_dump": 0.013461016019185383, "sim_render-ego": 0.006034439404805502, "get_robot_state": 0.015744147300720216, "get_duckie_state": 2.4739901224772136e-06, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.017651654879252115, "deviation-heading": 1.6236976322531589, "complete-iteration": 0.21164194345474244, "set_robot_commands": 0.004823118845621745, "deviation-center-line": 0.5484945610127977, "driven_lanedir_consec": 1.940438613072314, "sim_compute_sim_state": 0.027058377265930175, "sim_compute_performance-ego": 0.004005066553751628}}
set_robot_commands_max0.005006892681121826
set_robot_commands_mean0.0049393097559611
set_robot_commands_median0.004963613748550415
set_robot_commands_min0.004823118845621745
sim_compute_performance-ego_max0.004195714791615804
sim_compute_performance-ego_mean0.00410978615283966
sim_compute_performance-ego_median0.004119181632995605
sim_compute_performance-ego_min0.004005066553751628
sim_compute_sim_state_max0.027058377265930175
sim_compute_sim_state_mean0.024545390009880062
sim_compute_sim_state_median0.023943325678507488
sim_compute_sim_state_min0.023236531416575112
sim_render-ego_max0.006233961582183838
sim_render-ego_mean0.00617205540339152
sim_render-ego_median0.006209910313288371
sim_render-ego_min0.006034439404805502
simulation-passed1
step_physics_max0.08600595076878866
step_physics_mean0.08253107090791066
step_physics_median0.08225010911623637
step_physics_min0.07961811463038126
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4089010828Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnomont03-614c9626f856-10:09:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9177284020439895
survival_time_median14.950000000000076
deviation-center-line_median0.4533831824961141
in-drivable-lane_median1.7500000000000249


other stats
agent_compute-ego_max0.017800849278767905
agent_compute-ego_mean0.017579148411750796
agent_compute-ego_median0.01752663771311442
agent_compute-ego_min0.01746246894200643
complete-iteration_max0.21041025002797445
complete-iteration_mean0.20271463652451832
complete-iteration_median0.20106282949447632
complete-iteration_min0.19832263708114625
deviation-center-line_max0.8480992294948413
deviation-center-line_mean0.5318979889097568
deviation-center-line_min0.3727263611519578
deviation-heading_max3.712614644448901
deviation-heading_mean2.1692036823728578
deviation-heading_median1.7582302303576305
deviation-heading_min1.44773962432727
driven_any_max2.237363580054238
driven_any_mean2.22744850267102
driven_any_median2.226234053062771
driven_any_min2.219962324504302
driven_lanedir_consec_max1.9411048500846464
driven_lanedir_consec_mean1.877443685974469
driven_lanedir_consec_min1.7332130897252496
driven_lanedir_max1.9411048500846464
driven_lanedir_mean1.877443685974469
driven_lanedir_median1.9177284020439895
driven_lanedir_min1.7332130897252496
get_duckie_state_max3.92913818359375e-06
get_duckie_state_mean3.662904103597005e-06
get_duckie_state_median3.62396240234375e-06
get_duckie_state_min3.474553426106771e-06
get_robot_state_max0.016058192253112794
get_robot_state_mean0.01580504834651947
get_robot_state_median0.01575806736946106
get_robot_state_min0.01564586639404297
get_state_dump_max0.013746159076690674
get_state_dump_mean0.013680358330408732
get_state_dump_median0.01368850350379944
get_state_dump_min0.013598267237345378
get_ui_image_max0.03611721118291219
get_ui_image_mean0.03533872107664744
get_ui_image_median0.035251169999440515
get_ui_image_min0.03473533312479655
in-drivable-lane_max2.450000000000035
in-drivable-lane_mean1.8750000000000264
in-drivable-lane_min1.550000000000022
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.237363580054238, "get_ui_image": 0.03473533312479655, "step_physics": 0.07752596696217855, "survival_time": 14.950000000000076, "driven_lanedir": 1.907251887497744, "get_state_dump": 0.013598267237345378, "sim_render-ego": 0.006024142901102702, "get_robot_state": 0.01564586639404297, "get_duckie_state": 3.6764144897460937e-06, "in-drivable-lane": 1.8500000000000263, "agent_compute-ego": 0.017800849278767905, "deviation-heading": 1.9288345388432009, "complete-iteration": 0.19832263708114625, "set_robot_commands": 0.005000380674997965, "deviation-center-line": 0.5150051200185191, "driven_lanedir_consec": 1.907251887497744, "sim_compute_sim_state": 0.023691120147705077, "sim_compute_performance-ego": 0.004146718184153239}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.2230821709408253, "get_ui_image": 0.03563751935958862, "step_physics": 0.07861899773279826, "survival_time": 14.950000000000076, "driven_lanedir": 1.9411048500846464, "get_state_dump": 0.013659199078877768, "sim_render-ego": 0.006172642707824707, "get_robot_state": 0.01570748249689738, "get_duckie_state": 3.92913818359375e-06, "in-drivable-lane": 1.550000000000022, "agent_compute-ego": 0.01746246894200643, "deviation-heading": 1.5876259218720603, "complete-iteration": 0.2002548352877299, "set_robot_commands": 0.004962979157765706, "deviation-center-line": 0.3727263611519578, "driven_lanedir_consec": 1.9411048500846464, "sim_compute_sim_state": 0.023561083475748697, "sim_compute_performance-ego": 0.0043096280097961424}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.2293859351847165, "get_ui_image": 0.0348648206392924, "step_physics": 0.08162663221359252, "survival_time": 14.950000000000076, "driven_lanedir": 1.7332130897252496, "get_state_dump": 0.01371780792872111, "sim_render-ego": 0.0060245728492736815, "get_robot_state": 0.01580865224202474, "get_duckie_state": 3.474553426106771e-06, "in-drivable-lane": 2.450000000000035, "agent_compute-ego": 0.017559399604797365, "deviation-heading": 3.712614644448901, "complete-iteration": 0.20187082370122275, "set_robot_commands": 0.004765086174011231, "deviation-center-line": 0.8480992294948413, "driven_lanedir_consec": 1.7332130897252496, "sim_compute_sim_state": 0.023346560001373293, "sim_compute_performance-ego": 0.004001493453979492}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.219962324504302, "get_ui_image": 0.03611721118291219, "step_physics": 0.08413740555445354, "survival_time": 14.950000000000076, "driven_lanedir": 1.9282049165902355, "get_state_dump": 0.013746159076690674, "sim_render-ego": 0.0061676756540934245, "get_robot_state": 0.016058192253112794, "get_duckie_state": 3.5715103149414064e-06, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.017493875821431477, "deviation-heading": 1.44773962432727, "complete-iteration": 0.21041025002797445, "set_robot_commands": 0.004953391551971435, "deviation-center-line": 0.3917612449737091, "driven_lanedir_consec": 1.9282049165902355, "sim_compute_sim_state": 0.027510730425516765, "sim_compute_performance-ego": 0.004067627588907877}}
set_robot_commands_max0.005000380674997965
set_robot_commands_mean0.0049204593896865845
set_robot_commands_median0.004958185354868571
set_robot_commands_min0.004765086174011231
sim_compute_performance-ego_max0.0043096280097961424
sim_compute_performance-ego_mean0.0041313668092091875
sim_compute_performance-ego_median0.004107172886530558
sim_compute_performance-ego_min0.004001493453979492
sim_compute_sim_state_max0.027510730425516765
sim_compute_sim_state_mean0.02452737351258596
sim_compute_sim_state_median0.023626101811726887
sim_compute_sim_state_min0.023346560001373293
sim_render-ego_max0.006172642707824707
sim_render-ego_mean0.006097258528073628
sim_render-ego_median0.006096124251683553
sim_render-ego_min0.006024142901102702
simulation-passed1
step_physics_max0.08413740555445354
step_physics_mean0.08047725061575571
step_physics_median0.0801228149731954
step_physics_min0.07752596696217855
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4088711280Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simfailednomont03-614c9626f856-10:00:52
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego" aborted:

error in ego |Exception while handling a message on topic "get_commands".
             |
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
             ||     handle_message_node(parsed, receiver0, context0)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
             ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             ||     f(**kwargs)
             ||   File "solution.py", line 71, in on_received_get_commands
             ||     velocity, omega = self.compute_action(self.current_image)
             ||   File "solution.py", line 67, in compute_action
             ||     action = self.model.predict(observation)
             ||   File "/workspace/model.py", line 95, in predict
             ||     omega = output[:, 1].unsqueeze(1) * self.max_steering * self.gain
             ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 778, in __getattr__
             ||     raise ModuleAttributeError("'{}' object has no attribute '{}'".format(
             || torch.nn.modules.module.ModuleAttributeError: 'Squeezenet' object has no attribute 'gain'
             ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4088110833Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednomont03-614c9626f856-10:03:15
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 49 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4087210838Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnomont03-614c9626f856-10:08:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.684325676269043
survival_time_median14.350000000000067
deviation-center-line_median0.26944206043914665
in-drivable-lane_median4.925000000000061


other stats
agent_compute-ego_max0.017610554852761515
agent_compute-ego_mean0.01739144602680536
agent_compute-ego_median0.01742176622389662
agent_compute-ego_min0.01711169680666669
complete-iteration_max0.21074456930160523
complete-iteration_mean0.20644446285916673
complete-iteration_median0.20845718869166965
complete-iteration_min0.1981189047517223
deviation-center-line_max0.34211219068078935
deviation-center-line_mean0.2798032239170659
deviation-center-line_min0.2382165841091809
deviation-heading_max2.1885130149525365
deviation-heading_mean1.2916796010219498
deviation-heading_median1.038658577063204
deviation-heading_min0.900888235008855
driven_any_max2.5826986757763355
driven_any_mean2.2710309973412666
driven_any_median2.291518903496521
driven_any_min1.918387506595689
driven_lanedir_consec_max1.975974911883445
driven_lanedir_consec_mean1.5048244222486835
driven_lanedir_consec_min0.674671424573204
driven_lanedir_max1.975974911883445
driven_lanedir_mean1.5048244222486835
driven_lanedir_median1.684325676269043
driven_lanedir_min0.674671424573204
get_duckie_state_max2.7822068900116217e-06
get_duckie_state_mean2.626686136369571e-06
get_duckie_state_median2.6001964175404177e-06
get_duckie_state_min2.5241448203858257e-06
get_robot_state_max0.016223799098621716
get_robot_state_mean0.01590776646463044
get_robot_state_median0.015872353644840517
get_robot_state_min0.01566255947021901
get_state_dump_max0.01379681121774094
get_state_dump_mean0.013687848380448816
get_state_dump_median0.01373060150927072
get_state_dump_min0.013493379285512875
get_ui_image_max0.03718625612495359
get_ui_image_mean0.035899528238140216
get_ui_image_median0.035950488112485454
get_ui_image_min0.03451088060263637
in-drivable-lane_max10.25000000000007
in-drivable-lane_mean6.200000000000065
in-drivable-lane_min4.700000000000067
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.0299932390431255, "get_ui_image": 0.03718625612495359, "step_physics": 0.08439845585626018, "survival_time": 12.100000000000035, "driven_lanedir": 1.3948408198325426, "get_state_dump": 0.013493379285512875, "sim_render-ego": 0.006271164279338742, "get_robot_state": 0.016223799098621716, "get_duckie_state": 2.7822068900116217e-06, "in-drivable-lane": 5.050000000000054, "agent_compute-ego": 0.017610554852761515, "deviation-heading": 0.9192440323866504, "complete-iteration": 0.20933287596899616, "set_robot_commands": 0.0050996591236965715, "deviation-center-line": 0.2382165841091809, "driven_lanedir_consec": 1.3948408198325426, "sim_compute_sim_state": 0.024727790808874713, "sim_compute_performance-ego": 0.0041731379248879175}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.5826986757763355, "get_ui_image": 0.03534162573440083, "step_physics": 0.07699302032132198, "survival_time": 14.650000000000071, "driven_lanedir": 1.9738105327055435, "get_state_dump": 0.01379681121774094, "sim_render-ego": 0.006030329258368691, "get_robot_state": 0.01566255947021901, "get_duckie_state": 2.5241448203858257e-06, "in-drivable-lane": 4.800000000000068, "agent_compute-ego": 0.017284572327910024, "deviation-heading": 1.1580731217397575, "complete-iteration": 0.1981189047517223, "set_robot_commands": 0.004872156898316263, "deviation-center-line": 0.34211219068078935, "driven_lanedir_consec": 1.9738105327055435, "sim_compute_sim_state": 0.02390306313290124, "sim_compute_performance-ego": 0.004090160233168879}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.918387506595689, "get_ui_image": 0.03655935049057007, "step_physics": 0.08695015033086141, "survival_time": 14.950000000000076, "driven_lanedir": 0.674671424573204, "get_state_dump": 0.013669791221618653, "sim_render-ego": 0.006376746495564778, "get_robot_state": 0.016063831647237143, "get_duckie_state": 2.5701522827148436e-06, "in-drivable-lane": 10.25000000000007, "agent_compute-ego": 0.01755896011988322, "deviation-heading": 2.1885130149525365, "complete-iteration": 0.21074456930160523, "set_robot_commands": 0.004831507205963135, "deviation-center-line": 0.2645651437754216, "driven_lanedir_consec": 0.674671424573204, "sim_compute_sim_state": 0.024275641441345214, "sim_compute_performance-ego": 0.004308375517527262}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.5530445679499167, "get_ui_image": 0.03451088060263637, "step_physics": 0.08305007707181775, "survival_time": 14.050000000000065, "driven_lanedir": 1.975974911883445, "get_state_dump": 0.013791411796922786, "sim_render-ego": 0.0063099920537548135, "get_robot_state": 0.01568087564244389, "get_duckie_state": 2.630240552365992e-06, "in-drivable-lane": 4.700000000000067, "agent_compute-ego": 0.01711169680666669, "deviation-heading": 0.900888235008855, "complete-iteration": 0.20758150141434312, "set_robot_commands": 0.0047180907157816495, "deviation-center-line": 0.2743189771028717, "driven_lanedir_consec": 1.975974911883445, "sim_compute_sim_state": 0.0281349246612223, "sim_compute_performance-ego": 0.004124541299623102}}
set_robot_commands_max0.0050996591236965715
set_robot_commands_mean0.004880353485939405
set_robot_commands_median0.004851832052139699
set_robot_commands_min0.0047180907157816495
sim_compute_performance-ego_max0.004308375517527262
sim_compute_performance-ego_mean0.00417405374380179
sim_compute_performance-ego_median0.00414883961225551
sim_compute_performance-ego_min0.004090160233168879
sim_compute_sim_state_max0.0281349246612223
sim_compute_sim_state_mean0.025260355011085867
sim_compute_sim_state_median0.024501716125109964
sim_compute_sim_state_min0.02390306313290124
sim_render-ego_max0.006376746495564778
sim_render-ego_mean0.006247058021756757
sim_render-ego_median0.006290578166546778
sim_render-ego_min0.006030329258368691
simulation-passed1
step_physics_max0.08695015033086141
step_physics_mean0.08284792589506532
step_physics_median0.08372426646403897
step_physics_min0.07699302032132198
survival_time_max14.950000000000076
survival_time_mean13.937500000000064
survival_time_min12.100000000000035
No reset possible
4085710844Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnomont03-614c9626f856-10:09:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median14.950000000000076
deviation-center-line_median0.3071094952840746
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.017701412836710614
agent_compute-ego_mean0.017443599303563435
agent_compute-ego_median0.01745948592821757
agent_compute-ego_min0.01715401252110799
complete-iteration_max0.2172866940498352
complete-iteration_mean0.20587921023368833
complete-iteration_median0.20343449274698897
complete-iteration_min0.19936116139094032
deviation-center-line_max0.6863069918481528
deviation-center-line_mean0.35998819605511767
deviation-center-line_min0.13942680180416853
deviation-heading_max3.7258518640401217
deviation-heading_mean1.6586762301304627
deviation-heading_median1.2113904039371066
deviation-heading_min0.486072248607516
driven_any_max1.3686924727581474e-13
driven_any_mean6.950391439969185e-14
driven_any_median7.057320516147632e-14
driven_any_min0.0
driven_lanedir_consec_max1.7821788787841797e-05
driven_lanedir_consec_mean4.455447196960449e-06
driven_lanedir_consec_min0.0
driven_lanedir_max1.7821788787841797e-05
driven_lanedir_mean4.455447196960449e-06
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max3.912448883056641e-06
get_duckie_state_mean3.730058670043945e-06
get_duckie_state_median3.7058194478352864e-06
get_duckie_state_min3.596146901448568e-06
get_robot_state_max0.016259903907775878
get_robot_state_mean0.01591344197591146
get_robot_state_median0.015866316954294843
get_robot_state_min0.015661230087280275
get_state_dump_max0.0137912384668986
get_state_dump_mean0.013766258557637532
get_state_dump_median0.01376414179801941
get_state_dump_min0.013745512167612712
get_ui_image_max0.03680865923563639
get_ui_image_mean0.03632714152336121
get_ui_image_median0.036456501881281536
get_ui_image_min0.03558690309524536
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.03558690309524536, "step_physics": 0.07938035885492961, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.0137912384668986, "sim_render-ego": 0.006122161547342936, "get_robot_state": 0.015709520975748698, "get_duckie_state": 3.7105878194173175e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017288615703582765, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.19936116139094032, "set_robot_commands": 0.004781045913696289, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.022453145980834963, "sim_compute_performance-ego": 0.004096213976542155}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.036798958778381345, "step_physics": 0.08173449118932088, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.013770694732666016, "sim_render-ego": 0.006375827789306641, "get_robot_state": 0.016259903907775878, "get_duckie_state": 3.912448883056641e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01715401252110799, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.20342684427897137, "set_robot_commands": 0.005000425974527995, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.021984803676605224, "sim_compute_performance-ego": 0.004189184506734212}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.03611404498418172, "step_physics": 0.08153393745422363, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.013745512167612712, "sim_render-ego": 0.00620341698328654, "get_robot_state": 0.016023112932840984, "get_duckie_state": 3.596146901448568e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017701412836710614, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.2034421412150065, "set_robot_commands": 0.004904472827911377, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.022840709686279295, "sim_compute_performance-ego": 0.004215435187021891}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.03680865923563639, "step_physics": 0.09278730392456054, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.013757588863372803, "sim_render-ego": 0.0060276047388712565, "get_robot_state": 0.015661230087280275, "get_duckie_state": 3.7010510762532552e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017630356152852376, "deviation-heading": 0.486072248607516, "complete-iteration": 0.2172866940498352, "set_robot_commands": 0.005084096590677897, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.025363468329111735, "sim_compute_performance-ego": 0.004010082880655925}}
set_robot_commands_max0.005084096590677897
set_robot_commands_mean0.004942510326703389
set_robot_commands_median0.004952449401219685
set_robot_commands_min0.004781045913696289
sim_compute_performance-ego_max0.004215435187021891
sim_compute_performance-ego_mean0.0041277291377385455
sim_compute_performance-ego_median0.004142699241638183
sim_compute_performance-ego_min0.004010082880655925
sim_compute_sim_state_max0.025363468329111735
sim_compute_sim_state_mean0.023160531918207806
sim_compute_sim_state_median0.02264692783355713
sim_compute_sim_state_min0.021984803676605224
sim_render-ego_max0.006375827789306641
sim_render-ego_mean0.006182252764701843
sim_render-ego_median0.006162789265314737
sim_render-ego_min0.0060276047388712565
simulation-passed1
step_physics_max0.09278730392456054
step_physics_mean0.08385902285575866
step_physics_median0.08163421432177226
step_physics_min0.07938035885492961
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4085211276Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simfailednomont03-614c9626f856-10:02:54
The container "solut [...]
The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4084310855Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnomont03-614c9626f856-10:09:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.3710776892778953
survival_time_median14.950000000000076
deviation-center-line_median0.35191194169889883
in-drivable-lane_median2.0250000000000212


other stats
agent_compute-ego_max0.017787461280822755
agent_compute-ego_mean0.017235362848570183
agent_compute-ego_median0.017230305514594382
agent_compute-ego_min0.016693379084269207
complete-iteration_max0.20545109192530311
complete-iteration_mean0.20539933203726776
complete-iteration_median0.2054189932346344
complete-iteration_min0.2053082497544991
deviation-center-line_max0.8442265988793946
deviation-center-line_mean0.4137793012565107
deviation-center-line_min0.1070667227488505
deviation-heading_max2.0682631795772193
deviation-heading_mean1.442870716659737
deviation-heading_median1.5151730792515492
deviation-heading_min0.6728735285586298
driven_any_max3.050933988723292
driven_any_mean2.8212825232628576
driven_any_median2.821559532549486
driven_any_min2.5910770392291664
driven_lanedir_consec_max2.8642527610040607
driven_lanedir_consec_mean2.0589211395695024
driven_lanedir_consec_min0.6292764187181592
driven_lanedir_max2.8642527610040607
driven_lanedir_mean2.0589211395695024
driven_lanedir_median2.3710776892778953
driven_lanedir_min0.6292764187181592
get_duckie_state_max2.7132034301757814e-06
get_duckie_state_mean2.642638923585877e-06
get_duckie_state_median2.6976415353227956e-06
get_duckie_state_min2.4620691935221353e-06
get_robot_state_max0.016287930011749267
get_robot_state_mean0.015898122390111288
get_robot_state_median0.016018593311309816
get_robot_state_min0.015267372926076252
get_state_dump_max0.013767975171407064
get_state_dump_mean0.013693512022033215
get_state_dump_median0.013698911666870116
get_state_dump_min0.013608249582985574
get_ui_image_max0.03654402540635693
get_ui_image_mean0.03586552989113238
get_ui_image_median0.03608569979667664
get_ui_image_min0.03474669456481934
in-drivable-lane_max11.400000000000082
in-drivable-lane_mean3.962500000000032
in-drivable-lane_min0.4000000000000057
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.050933988723292, "get_ui_image": 0.035756200949350996, "step_physics": 0.08156968196233114, "survival_time": 14.950000000000076, "driven_lanedir": 2.7505999544081665, "get_state_dump": 0.013767975171407064, "sim_render-ego": 0.006367456118265787, "get_robot_state": 0.016287930011749267, "get_duckie_state": 2.6941299438476564e-06, "in-drivable-lane": 1.1500000000000012, "agent_compute-ego": 0.01717902421951294, "deviation-heading": 1.8862735966346769, "complete-iteration": 0.20540921052296957, "set_robot_commands": 0.004892373085021972, "deviation-center-line": 0.4216242208512287, "driven_lanedir_consec": 2.7505999544081665, "sim_compute_sim_state": 0.02516882340113322, "sim_compute_performance-ego": 0.004265208244323731}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.628896201176934, "get_ui_image": 0.03654402540635693, "step_physics": 0.08209536241930585, "survival_time": 12.900000000000048, "driven_lanedir": 1.991555424147624, "get_state_dump": 0.013608249582985574, "sim_render-ego": 0.006314799767131953, "get_robot_state": 0.01588781674702962, "get_duckie_state": 2.7011531267979348e-06, "in-drivable-lane": 2.900000000000041, "agent_compute-ego": 0.017281586809675824, "deviation-heading": 1.1440725618684215, "complete-iteration": 0.2053082497544991, "set_robot_commands": 0.005000667978626813, "deviation-center-line": 0.28219966254656903, "driven_lanedir_consec": 1.991555424147624, "sim_compute_sim_state": 0.02418082074601521, "sim_compute_performance-ego": 0.004240096077438473}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.5910770392291664, "get_ui_image": 0.03641519864400228, "step_physics": 0.08128202199935913, "survival_time": 14.950000000000076, "driven_lanedir": 0.6292764187181592, "get_state_dump": 0.013741713364919026, "sim_render-ego": 0.006483097076416016, "get_robot_state": 0.016149369875590007, "get_duckie_state": 2.7132034301757814e-06, "in-drivable-lane": 11.400000000000082, "agent_compute-ego": 0.017787461280822755, "deviation-heading": 0.6728735285586298, "complete-iteration": 0.20545109192530311, "set_robot_commands": 0.004901901880900065, "deviation-center-line": 0.1070667227488505, "driven_lanedir_consec": 0.6292764187181592, "sim_compute_sim_state": 0.02412085215250651, "sim_compute_performance-ego": 0.004410957495371501}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.0142228639220376, "get_ui_image": 0.03474669456481934, "step_physics": 0.08375778754552206, "survival_time": 14.950000000000076, "driven_lanedir": 2.8642527610040607, "get_state_dump": 0.013656109968821209, "sim_render-ego": 0.005857268174489339, "get_robot_state": 0.015267372926076252, "get_duckie_state": 2.4620691935221353e-06, "in-drivable-lane": 0.4000000000000057, "agent_compute-ego": 0.016693379084269207, "deviation-heading": 2.0682631795772193, "complete-iteration": 0.20542877594629924, "set_robot_commands": 0.004909889698028564, "deviation-center-line": 0.8442265988793946, "driven_lanedir_consec": 2.8642527610040607, "sim_compute_sim_state": 0.02644078811009725, "sim_compute_performance-ego": 0.00395117998123169}}
set_robot_commands_max0.005000667978626813
set_robot_commands_mean0.004926208160644353
set_robot_commands_median0.004905895789464315
set_robot_commands_min0.004892373085021972
sim_compute_performance-ego_max0.004410957495371501
sim_compute_performance-ego_mean0.004216860449591349
sim_compute_performance-ego_median0.004252652160881102
sim_compute_performance-ego_min0.00395117998123169
sim_compute_sim_state_max0.02644078811009725
sim_compute_sim_state_mean0.02497782110243805
sim_compute_sim_state_median0.024674822073574215
sim_compute_sim_state_min0.02412085215250651
sim_render-ego_max0.006483097076416016
sim_render-ego_mean0.006255655284075774
sim_render-ego_median0.006341127942698871
sim_render-ego_min0.005857268174489339
simulation-passed1
step_physics_max0.08375778754552206
step_physics_mean0.08217621348162954
step_physics_median0.08183252219081849
step_physics_min0.08128202199935913
survival_time_max14.950000000000076
survival_time_mean14.437500000000073
survival_time_min12.900000000000048
No reset possible