Evaluator 2104

ID	2104
evaluator	`reg05-1d8e1780ead1-1`
owner	I don't have one 😀
machine	archimede
process	reg05-1d8e1780ead1-1
version	d-c:6.1.15;d-c-r:6.0.48
first heard	2020-11-01 20:42:08+00:00
last heard	2020-11-01 23:08:02+00:00
status	inactive
# evaluating
# success	2 `36057`
# timeout	1 `36067`
# failed
# error	1 `36055`
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job ID

submission

user

user label

challenge

step

status

up to date

evaluator

date started

date completed

duration

message

36067

9840

Bea Baselines 🐤

baseline-duckietown

aido5-LFVI_multi-sim-validation

LFVIv-sim

timeout

reg05-1d8e1780ead1-1

2020-11-01 22:58:35+00:00

2020-11-02 00:04:11+00:00

1:05:36

I can see how the jo [...]

I can see how the job 36067 is timeout because passed 3936 seconds and the timeout is 3600.0.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

36061

9817

Bea Baselines 🐤

template-pytorch

aido5-LF-sim-validation

LFv-sim

success

reg05-1d8e1780ead1-1

2020-11-01 21:36:43+00:00

2020-11-01 21:58:21+00:00

0:21:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.35045974509560107
survival_time_median	11.12500000000003
deviation-center-line_median	0.34732096788027733
in-drivable-lane_median	5.450000000000017

other stats

agent_compute-ego_max	2.570876448949178
agent_compute-ego_mean	2.068443199140296
agent_compute-ego_median	2.068443199140296
agent_compute-ego_min	1.566009949331414
complete-iteration_max	2.8992831675211588
complete-iteration_mean	2.383539301118894
complete-iteration_median	2.383539301118894
complete-iteration_min	1.8677954347166297
deviation-center-line_max	0.3493481720794152
deviation-center-line_mean	0.34732096788027733
deviation-center-line_min	0.3452937636811395
deviation-heading_max	5.870692597227869
deviation-heading_mean	4.219883364824657
deviation-heading_median	4.219883364824657
deviation-heading_min	2.569074132421445
driven_any_max	1.667722741869857
driven_any_mean	1.191010804267892
driven_any_median	1.191010804267892
driven_any_min	0.714298866665927
driven_lanedir_consec_max	0.4636742092568338
driven_lanedir_consec_mean	0.35045974509560107
driven_lanedir_consec_min	0.23724528093436836
driven_lanedir_max	0.4636742092568338
driven_lanedir_mean	0.35045974509560107
driven_lanedir_median	0.35045974509560107
driven_lanedir_min	0.23724528093436836
get_state_dump_max	0.015577982549798
get_state_dump_mean	0.015370619835918895
get_state_dump_median	0.015370619835918895
get_state_dump_min	0.015163257122039794
get_ui_image_max	0.07531970977783203
get_ui_image_mean	0.07390144096661921
get_ui_image_median	0.07390144096661921
get_ui_image_min	0.07248317215540638
in-drivable-lane_max	7.400000000000041
in-drivable-lane_mean	5.450000000000017
in-drivable-lane_min	3.499999999999992
per-episodes	details {"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.667722741869857, "get_ui_image": 0.07531970977783203, "step_physics": 0.17931713183720907, "survival_time": 14.950000000000076, "driven_lanedir": 0.4636742092568338, "get_state_dump": 0.015163257122039794, "sim_render-ego": 0.008177818457285563, "in-drivable-lane": 7.400000000000041, "agent_compute-ego": 2.570876448949178, "deviation-heading": 5.870692597227869, "complete-iteration": 2.8992831675211588, "set_robot_commands": 0.006171542803446452, "deviation-center-line": 0.3452937636811395, "driven_lanedir_consec": 0.4636742092568338, "sim_compute_sim_state": 0.018830490907033284, "sim_compute_performance-ego": 0.0061474760373433435, "sim_compute_robot_state-ego": 0.009709336757659911, "sim_compute_robot_state-parked0": 0.00940829912821452}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 0.714298866665927, "get_ui_image": 0.07248317215540638, "step_physics": 0.1544885325105223, "survival_time": 7.299999999999982, "driven_lanedir": 0.23724528093436836, "get_state_dump": 0.015577982549798, "sim_render-ego": 0.008426091442369435, "in-drivable-lane": 3.499999999999992, "agent_compute-ego": 1.566009949331414, "deviation-heading": 2.569074132421445, "complete-iteration": 1.8677954347166297, "set_robot_commands": 0.006479196352501438, "deviation-center-line": 0.3493481720794152, "driven_lanedir_consec": 0.23724528093436836, "sim_compute_sim_state": 0.01891904171199015, "sim_compute_performance-ego": 0.006057170972432175, "sim_compute_robot_state-ego": 0.010100763138026408, "sim_compute_robot_state-parked0": 0.009088578289502288}}
set_robot_commands_max	0.006479196352501438
set_robot_commands_mean	0.006325369577973946
set_robot_commands_median	0.006325369577973946
set_robot_commands_min	0.006171542803446452
sim_compute_performance-ego_max	0.0061474760373433435
sim_compute_performance-ego_mean	0.00610232350488776
sim_compute_performance-ego_median	0.00610232350488776
sim_compute_performance-ego_min	0.006057170972432175
sim_compute_robot_state-ego_max	0.010100763138026408
sim_compute_robot_state-ego_mean	0.00990504994784316
sim_compute_robot_state-ego_median	0.00990504994784316
sim_compute_robot_state-ego_min	0.009709336757659911
sim_compute_robot_state-parked0_max	0.00940829912821452
sim_compute_robot_state-parked0_mean	0.009248438708858404
sim_compute_robot_state-parked0_median	0.009248438708858404
sim_compute_robot_state-parked0_min	0.009088578289502288
sim_compute_sim_state_max	0.01891904171199015
sim_compute_sim_state_mean	0.018874766309511716
sim_compute_sim_state_median	0.018874766309511716
sim_compute_sim_state_min	0.018830490907033284
sim_render-ego_max	0.008426091442369435
sim_render-ego_mean	0.008301954949827498
sim_render-ego_median	0.008301954949827498
sim_render-ego_min	0.008177818457285563
simulation-passed	1
step_physics_max	0.17931713183720907
step_physics_mean	0.1669028321738657
step_physics_median	0.1669028321738657
step_physics_min	0.1544885325105223
survival_time_max	14.950000000000076
survival_time_mean	11.12500000000003
survival_time_min	7.299999999999982

No reset possible

36057

9800

Bea Baselines 🐤

straight

aido5-LFVI_multi-sim-validation

LFVIv-sim

success

reg05-1d8e1780ead1-1

2020-11-01 20:46:48+00:00

2020-11-01 20:54:04+00:00

0:07:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4448271993029011
survival_time_median	3.049999999999997
deviation-center-line_median	0.16204229780465118
in-drivable-lane_median	0.0

other stats

agent_compute-ego0_max	0.047864710698362255
agent_compute-ego0_mean	0.04541067021792052
agent_compute-ego0_median	0.04541067021792052
agent_compute-ego0_min	0.04295662973747879
agent_compute-ego1_max	0.045797148688894805
agent_compute-ego1_mean	0.04396546277843538
agent_compute-ego1_median	0.04396546277843538
agent_compute-ego1_min	0.04213377686797595
agent_compute-ego2_max	0.0460925962104172
agent_compute-ego2_mean	0.04405393170528724
agent_compute-ego2_median	0.04405393170528724
agent_compute-ego2_min	0.04201526720015729
complete-iteration_max	1.6197361008065645
complete-iteration_mean	1.4833895573850535
complete-iteration_median	1.4833895573850535
complete-iteration_min	1.347043013963543
deviation-center-line_max	0.25746356861009595
deviation-center-line_mean	0.18326009620399683
deviation-center-line_min	0.13466842791086536
deviation-heading_max	0.7352695890794486
deviation-heading_mean	0.3775885919320583
deviation-heading_median	0.35956679565697475
deviation-heading_min	0.030836127410108667
driven_any_max	0.4484649879563624
driven_any_mean	0.44802759571271383
driven_any_median	0.4480275957127146
driven_any_min	0.44759020346906503
driven_lanedir_consec_max	0.44840955910620695
driven_lanedir_consec_mean	0.4312421305378989
driven_lanedir_consec_min	0.392074025770182
driven_lanedir_max	0.44840955910620695
driven_lanedir_mean	0.4312421305378989
driven_lanedir_median	0.4448271993029011
driven_lanedir_min	0.392074025770182
get_state_dump_max	0.04584924901118044
get_state_dump_mean	0.04398891964896781
get_state_dump_median	0.04398891964896781
get_state_dump_min	0.04212859028675517
get_ui_image_max	0.1522679328918457
get_ui_image_mean	0.1431624635321195
get_ui_image_median	0.1431624635321195
get_ui_image_min	0.1340569941723933
in-drivable-lane_max	0.2499999999999991
in-drivable-lane_mean	0.06666666666666643
in-drivable-lane_min	0.0
per-episodes	details {"udem1-0-0-ego0": {"driven_any": 0.4484649879563562, "get_ui_image": 0.1340569941723933, "step_physics": 0.8208649705667965, "survival_time": 3.049999999999997, "driven_lanedir": 0.445595259456681, "get_state_dump": 0.04584924901118044, "sim_render-ego0": 0.00868793393744797, "sim_render-ego1": 0.008883999996497983, "sim_render-ego2": 0.008675508811825612, "in-drivable-lane": 0.0, "deviation-heading": 0.3432464204151321, "agent_compute-ego0": 0.047864710698362255, "agent_compute-ego1": 0.045797148688894805, "agent_compute-ego2": 0.0460925962104172, "complete-iteration": 1.347043013963543, "set_robot_commands": 0.006458157398661629, "deviation-center-line": 0.1591290213325826, "driven_lanedir_consec": 0.445595259456681, "sim_compute_sim_state": 0.052483007556102315, "sim_compute_performance-ego0": 0.006364013327926886, "sim_compute_performance-ego1": 0.006189897412159404, "sim_compute_performance-ego2": 0.006204030552848441, "sim_compute_robot_state-ego0": 0.011554190369903064, "sim_compute_robot_state-ego1": 0.009084928231161148, "sim_compute_robot_state-ego2": 0.009697605351932714, "sim_compute_robot_state-parked0": 0.009908992736065974, "sim_compute_robot_state-parked1": 0.009955718869068583, "sim_compute_robot_state-parked2": 0.009964196408381228, "sim_compute_robot_state-parked3": 0.010380440070980886, "sim_compute_robot_state-parked4": 0.009446527137130989, "sim_compute_robot_state-parked5": 0.009297183302582288}, "udem1-0-0-ego1": {"driven_any": 0.4484649879563624, "get_ui_image": 0.1340569941723933, "step_physics": 0.8208649705667965, "survival_time": 3.049999999999997, "driven_lanedir": 0.44840955910620695, "get_state_dump": 0.04584924901118044, "sim_render-ego0": 0.00868793393744797, "sim_render-ego1": 0.008883999996497983, "sim_render-ego2": 0.008675508811825612, "in-drivable-lane": 0.0, "deviation-heading": 0.04625276718878463, "agent_compute-ego0": 0.047864710698362255, "agent_compute-ego1": 0.045797148688894805, "agent_compute-ego2": 0.0460925962104172, "complete-iteration": 1.347043013963543, "set_robot_commands": 0.006458157398661629, "deviation-center-line": 0.1398467777788016, "driven_lanedir_consec": 0.44840955910620695, "sim_compute_sim_state": 0.052483007556102315, "sim_compute_performance-ego0": 0.006364013327926886, "sim_compute_performance-ego1": 0.006189897412159404, "sim_compute_performance-ego2": 0.006204030552848441, "sim_compute_robot_state-ego0": 0.011554190369903064, "sim_compute_robot_state-ego1": 0.009084928231161148, "sim_compute_robot_state-ego2": 0.009697605351932714, "sim_compute_robot_state-parked0": 0.009908992736065974, "sim_compute_robot_state-parked1": 0.009955718869068583, "sim_compute_robot_state-parked2": 0.009964196408381228, "sim_compute_robot_state-parked3": 0.010380440070980886, "sim_compute_robot_state-parked4": 0.009446527137130989, "sim_compute_robot_state-parked5": 0.009297183302582288}, "udem1-0-0-ego2": {"driven_any": 0.4484649879563602, "get_ui_image": 0.1340569941723933, "step_physics": 0.8208649705667965, "survival_time": 3.049999999999997, "driven_lanedir": 0.4097509793208185, "get_state_dump": 0.04584924901118044, "sim_render-ego0": 0.00868793393744797, "sim_render-ego1": 0.008883999996497983, "sim_render-ego2": 0.008675508811825612, "in-drivable-lane": 0.14999999999999947, "deviation-heading": 0.7352695890794486, "agent_compute-ego0": 0.047864710698362255, "agent_compute-ego1": 0.045797148688894805, "agent_compute-ego2": 0.0460925962104172, "complete-iteration": 1.347043013963543, "set_robot_commands": 0.006458157398661629, "deviation-center-line": 0.25746356861009595, "driven_lanedir_consec": 0.4097509793208185, "sim_compute_sim_state": 0.052483007556102315, "sim_compute_performance-ego0": 0.006364013327926886, "sim_compute_performance-ego1": 0.006189897412159404, "sim_compute_performance-ego2": 0.006204030552848441, "sim_compute_robot_state-ego0": 0.011554190369903064, "sim_compute_robot_state-ego1": 0.009084928231161148, "sim_compute_robot_state-ego2": 0.009697605351932714, "sim_compute_robot_state-parked0": 0.009908992736065974, "sim_compute_robot_state-parked1": 0.009955718869068583, "sim_compute_robot_state-parked2": 0.009964196408381228, "sim_compute_robot_state-parked3": 0.010380440070980886, "sim_compute_robot_state-parked4": 0.009446527137130989, "sim_compute_robot_state-parked5": 0.009297183302582288}, "udem1-0-1-ego0": {"driven_any": 0.447590203469073, "get_ui_image": 0.1522679328918457, "step_physics": 1.0981566515125212, "survival_time": 3.049999999999997, "driven_lanedir": 0.4440591391491213, "get_state_dump": 0.04212859028675517, "sim_render-ego0": 0.009175120807084882, "sim_render-ego1": 0.00839025466168513, "sim_render-ego2": 0.008138840315771884, "in-drivable-lane": 0.0, "deviation-heading": 0.3758871708988174, "agent_compute-ego0": 0.04295662973747879, "agent_compute-ego1": 0.04213377686797595, "agent_compute-ego2": 0.04201526720015729, "complete-iteration": 1.6197361008065645, "set_robot_commands": 0.006342176531181961, "deviation-center-line": 0.16495557427671975, "driven_lanedir_consec": 0.4440591391491213, "sim_compute_sim_state": 0.05780729700307377, "sim_compute_performance-ego0": 0.006921639207933769, "sim_compute_performance-ego1": 0.005846426135203878, "sim_compute_performance-ego2": 0.005255257497068311, "sim_compute_robot_state-ego0": 0.010036734283947552, "sim_compute_robot_state-ego1": 0.009594639793771212, "sim_compute_robot_state-ego2": 0.008991405612132589, "sim_compute_robot_state-parked0": 0.00931142978980893, "sim_compute_robot_state-parked1": 0.008645155390755076, "sim_compute_robot_state-parked2": 0.008813389012070953, "sim_compute_robot_state-parked3": 0.008349891568793625, "sim_compute_robot_state-parked4": 0.00806734601005179, "sim_compute_robot_state-parked5": 0.008098324791329806}, "udem1-0-1-ego1": {"driven_any": 0.44759020346906503, "get_ui_image": 0.1522679328918457, "step_physics": 1.0981566515125212, "survival_time": 3.049999999999997, "driven_lanedir": 0.4475638204243837, "get_state_dump": 0.04212859028675517, "sim_render-ego0": 0.009175120807084882, "sim_render-ego1": 0.00839025466168513, "sim_render-ego2": 0.008138840315771884, "in-drivable-lane": 0.0, "deviation-heading": 0.030836127410108667, "agent_compute-ego0": 0.04295662973747879, "agent_compute-ego1": 0.04213377686797595, "agent_compute-ego2": 0.04201526720015729, "complete-iteration": 1.6197361008065645, "set_robot_commands": 0.006342176531181961, "deviation-center-line": 0.13466842791086536, "driven_lanedir_consec": 0.4475638204243837, "sim_compute_sim_state": 0.05780729700307377, "sim_compute_performance-ego0": 0.006921639207933769, "sim_compute_performance-ego1": 0.005846426135203878, "sim_compute_performance-ego2": 0.005255257497068311, "sim_compute_robot_state-ego0": 0.010036734283947552, "sim_compute_robot_state-ego1": 0.009594639793771212, "sim_compute_robot_state-ego2": 0.008991405612132589, "sim_compute_robot_state-parked0": 0.00931142978980893, "sim_compute_robot_state-parked1": 0.008645155390755076, "sim_compute_robot_state-parked2": 0.008813389012070953, "sim_compute_robot_state-parked3": 0.008349891568793625, "sim_compute_robot_state-parked4": 0.00806734601005179, "sim_compute_robot_state-parked5": 0.008098324791329806}, "udem1-0-1-ego2": {"driven_any": 0.4475902034690664, "get_ui_image": 0.1522679328918457, "step_physics": 1.0981566515125212, "survival_time": 3.049999999999997, "driven_lanedir": 0.392074025770182, "get_state_dump": 0.04212859028675517, "sim_render-ego0": 0.009175120807084882, "sim_render-ego1": 0.00839025466168513, "sim_render-ego2": 0.008138840315771884, "in-drivable-lane": 0.2499999999999991, "deviation-heading": 0.7340394766000586, "agent_compute-ego0": 0.04295662973747879, "agent_compute-ego1": 0.04213377686797595, "agent_compute-ego2": 0.04201526720015729, "complete-iteration": 1.6197361008065645, "set_robot_commands": 0.006342176531181961, "deviation-center-line": 0.24349720731491545, "driven_lanedir_consec": 0.392074025770182, "sim_compute_sim_state": 0.05780729700307377, "sim_compute_performance-ego0": 0.006921639207933769, "sim_compute_performance-ego1": 0.005846426135203878, "sim_compute_performance-ego2": 0.005255257497068311, "sim_compute_robot_state-ego0": 0.010036734283947552, "sim_compute_robot_state-ego1": 0.009594639793771212, "sim_compute_robot_state-ego2": 0.008991405612132589, "sim_compute_robot_state-parked0": 0.00931142978980893, "sim_compute_robot_state-parked1": 0.008645155390755076, "sim_compute_robot_state-parked2": 0.008813389012070953, "sim_compute_robot_state-parked3": 0.008349891568793625, "sim_compute_robot_state-parked4": 0.00806734601005179, "sim_compute_robot_state-parked5": 0.008098324791329806}}
set_robot_commands_max	0.006458157398661629
set_robot_commands_mean	0.006400166964921794
set_robot_commands_median	0.006400166964921795
set_robot_commands_min	0.006342176531181961
sim_compute_performance-ego0_max	0.006921639207933769
sim_compute_performance-ego0_mean	0.006642826267930327
sim_compute_performance-ego0_median	0.006642826267930328
sim_compute_performance-ego0_min	0.006364013327926886
sim_compute_performance-ego1_max	0.006189897412159404
sim_compute_performance-ego1_mean	0.006018161773681641
sim_compute_performance-ego1_median	0.006018161773681641
sim_compute_performance-ego1_min	0.005846426135203878
sim_compute_performance-ego2_max	0.006204030552848441
sim_compute_performance-ego2_mean	0.0057296440249583755
sim_compute_performance-ego2_median	0.005729644024958376
sim_compute_performance-ego2_min	0.005255257497068311
sim_compute_robot_state-ego0_max	0.011554190369903064
sim_compute_robot_state-ego0_mean	0.010795462326925308
sim_compute_robot_state-ego0_median	0.010795462326925308
sim_compute_robot_state-ego0_min	0.010036734283947552
sim_compute_robot_state-ego1_max	0.009594639793771212
sim_compute_robot_state-ego1_mean	0.00933978401246618
sim_compute_robot_state-ego1_median	0.00933978401246618
sim_compute_robot_state-ego1_min	0.009084928231161148
sim_compute_robot_state-ego2_max	0.009697605351932714
sim_compute_robot_state-ego2_mean	0.009344505482032653
sim_compute_robot_state-ego2_median	0.009344505482032653
sim_compute_robot_state-ego2_min	0.008991405612132589
sim_compute_robot_state-parked0_max	0.009908992736065974
sim_compute_robot_state-parked0_mean	0.009610211262937452
sim_compute_robot_state-parked0_median	0.009610211262937452
sim_compute_robot_state-parked0_min	0.00931142978980893
sim_compute_robot_state-parked1_max	0.009955718869068583
sim_compute_robot_state-parked1_mean	0.00930043712991183
sim_compute_robot_state-parked1_median	0.00930043712991183
sim_compute_robot_state-parked1_min	0.008645155390755076
sim_compute_robot_state-parked2_max	0.009964196408381228
sim_compute_robot_state-parked2_mean	0.009388792710226091
sim_compute_robot_state-parked2_median	0.00938879271022609
sim_compute_robot_state-parked2_min	0.008813389012070953
sim_compute_robot_state-parked3_max	0.010380440070980886
sim_compute_robot_state-parked3_mean	0.009365165819887255
sim_compute_robot_state-parked3_median	0.009365165819887255
sim_compute_robot_state-parked3_min	0.008349891568793625
sim_compute_robot_state-parked4_max	0.009446527137130989
sim_compute_robot_state-parked4_mean	0.008756936573591388
sim_compute_robot_state-parked4_median	0.00875693657359139
sim_compute_robot_state-parked4_min	0.00806734601005179
sim_compute_robot_state-parked5_max	0.009297183302582288
sim_compute_robot_state-parked5_mean	0.008697754046956047
sim_compute_robot_state-parked5_median	0.008697754046956047
sim_compute_robot_state-parked5_min	0.008098324791329806
sim_compute_sim_state_max	0.05780729700307377
sim_compute_sim_state_mean	0.05514515227958805
sim_compute_sim_state_median	0.05514515227958804
sim_compute_sim_state_min	0.052483007556102315
sim_render-ego0_max	0.009175120807084882
sim_render-ego0_mean	0.008931527372266426
sim_render-ego0_median	0.008931527372266426
sim_render-ego0_min	0.00868793393744797
sim_render-ego1_max	0.008883999996497983
sim_render-ego1_mean	0.008637127329091556
sim_render-ego1_median	0.008637127329091557
sim_render-ego1_min	0.00839025466168513
sim_render-ego2_max	0.008675508811825612
sim_render-ego2_mean	0.008407174563798747
sim_render-ego2_median	0.008407174563798747
sim_render-ego2_min	0.008138840315771884
simulation-passed	1
step_physics_max	1.0981566515125212
step_physics_mean	0.959510811039659
step_physics_median	0.9595108110396589
step_physics_min	0.8208649705667965
survival_time_max	3.049999999999997
survival_time_mean	3.049999999999997
survival_time_min	3.049999999999997

No reset possible

36055

9805

Bea Baselines 🐤

baseline-duckietown

aido5-LFV_multi-sim-validation

LFVmultibodyv-sim

error

reg05-1d8e1780ead1-1

2020-11-01 20:42:19+00:00

2020-11-01 20:43:36+00:00

0:01:17

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 49, in check_compatible_protocol
    raise IncompatibleProtocol(
zuper_nodes.compatibility.IncompatibleProtocol: For input "observations", cannot use type v2 as v21
│         k: observations
│        v1: dataclass aido_schemas.schemas.DB20ObservationsPlusState
│             field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
│                                field jpg_data : bytes
│                                       __doc__
│                                                         An image in JPG format.
│ 
│                                                         jpg_data
│             field  odometry : dataclass aido_schemas.schemas.DB20Odometry
│                                field resolution_rad : float
│                                field  axis_left_rad : float
│                                field axis_right_rad : float
│             field your_name : str
│             field     state : dataclass aido_schemas.schemas.DTSimState
│                                field t_effective : float
│                                field  duckiebots : Dict[str,DTSimRobotInfo]
│             field  map_data : str
│        v2: dataclass aido_schemas.schemas.DB20Observations
│             field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
│                               field jpg_data : bytes
│                                      __doc__
│                                                        An image in JPG format.
│ 
│                                                        jpg_data
│             field odometry : dataclass aido_schemas.schemas.DB20Odometry
│                               field resolution_rad : float
│                               field  axis_left_rad : float
│                               field axis_right_rad : float
│         r: CanBeUsed
│            │ result: False
│            │ why:
│            │ |Type <class 'aido_schemas.schemas.DB20ObservationsPlusState'>
│            │ | requires field "your_name"
│            │ |  of type <class 'str'>
│            │ |  but <class 'aido_schemas.schemas.DB20Observations'> does not have it.
│            │ M: Matches()
│            │ matches: {}
│ p1_inputs: Dict[str,type][4]
│            │ seed: int
│            │ get_commands:
│            │ dataclass aido_schemas.protocol_agent.GetCommands
│            │  field at_time : float
│            │ observations:
│            │ dataclass aido_schemas.schemas.DB20ObservationsPlusState
│            │  field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
│            │                     field jpg_data : bytes
│            │                            __doc__
│            │                                              An image in JPG format.
│            │
│            │                                              jpg_data
│            │  field  odometry : dataclass aido_schemas.schemas.DB20Odometry
│            │                     field resolution_rad : float
│            │                     field  axis_left_rad : float
│            │                     field axis_right_rad : float
│            │  field your_name : str
│            │  field     state : dataclass aido_schemas.schemas.DTSimState
│            │                     field t_effective : float
│            │                     field  duckiebots : Dict[str,DTSimRobotInfo]
│            │  field  map_data : str
│            │ episode_start:
│            │ dataclass aido_schemas.protocol_agent.EpisodeStart
│            │  field episode_name : str
│            │             __doc__    Marker for the start of an episode.
│ p2_inputs: dict[4]
│            │ observations:
│            │ dataclass aido_schemas.schemas.DB20Observations
│            │  field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
│            │                    field jpg_data : bytes
│            │                           __doc__
│            │                                             An image in JPG format.
│            │
│            │                                             jpg_data
│            │  field odometry : dataclass aido_schemas.schemas.DB20Odometry
│            │                    field resolution_rad : float
│            │                    field  axis_left_rad : float
│            │                    field axis_right_rad : float
│            │ seed: int
│            │ get_commands:
│            │ dataclass aido_schemas.protocol_agent.GetCommands
│            │  field at_time : float
│            │ episode_start:
│            │ dataclass aido_schemas.protocol_agent.EpisodeStart
│            │  field episode_name : str
│            │             __doc__    Marker for the start of an episode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 165, in main
    robot_ci._get_node_protocol(timeout=config.timeout_initialization)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 120, in _get_node_protocol
    check_compatible_protocol(self.node_protocol, self.expect_protocol)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 67, in check_compatible_protocol
    raise IncompatibleProtocol(msg, p1=p1, p2=p2) from e
zuper_nodes.compatibility.IncompatibleProtocol: Cannot say that p1 is a sub-protocol of p2
│ p1: InteractionProtocol
│     │ description: Particularization for Duckiebot1 observations and commands.
│     │ inputs:
│     │ Dict[str,type][4]
│     │ │ seed: int
│     │ │ get_commands:
│     │ │ dataclass aido_schemas.protocol_agent.GetCommands
│     │ │  field at_time : float
│     │ │ observations:
│     │ │ dataclass aido_schemas.schemas.DB20ObservationsPlusState
│     │ │  field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
│     │ │                     field jpg_data : bytes
│     │ │                            __doc__
│     │ │                                              An image in JPG format.
│     │ │
│     │ │                                              jpg_data
│     │ │  field  odometry : dataclass aido_schemas.schemas.DB20Odometry
│     │ │                     field resolution_rad : float
│     │ │                     field  axis_left_rad : float
│     │ │                     field axis_right_rad : float
│     │ │  field your_name : str
│     │ │  field     state : dataclass aido_schemas.schemas.DTSimState
│     │ │                     field t_effective : float
│     │ │                     field  duckiebots : Dict[str,DTSimRobotInfo]
│     │ │  field  map_data : str
│     │ │ episode_start:
│     │ │ dataclass aido_schemas.protocol_agent.EpisodeStart
│     │ │  field episode_name : str
│     │ │             __doc__    Marker for the start of an episode.
│     │ outputs:
│     │ Dict[str,type][1]
│     │ │ commands:
│     │ │ dataclass aido_schemas.schemas.Duckiebot1Commands
│     │ │  field wheels : dataclass aido_schemas.schemas.PWMCommands
│     │ │                  field  motor_left : float
│     │ │                  field motor_right : float
│     │ │                            __doc__
│     │ │                                              PWM commands are floats between -1 and 1.
│     │ │  field   LEDS : dataclass aido_schemas.schemas.LEDSCommands
│     │ │                  field      center : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field  front_left : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field front_right : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field   back_left : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field  back_right : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)
│ p2: InteractionProtocol
│     │ description: Particularization for DB20 observations and commands.
│     │ inputs:
│     │ dict[4]
│     │ │ observations:
│     │ │ dataclass aido_schemas.schemas.DB20Observations
│     │ │  field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
│     │ │                    field jpg_data : bytes
│     │ │                           __doc__
│     │ │                                             An image in JPG format.
│     │ │
│     │ │                                             jpg_data
│     │ │  field odometry : dataclass aido_schemas.schemas.DB20Odometry
│     │ │                    field resolution_rad : float
│     │ │                    field  axis_left_rad : float
│     │ │                    field axis_right_rad : float
│     │ │ seed: int
│     │ │ get_commands:
│     │ │ dataclass aido_schemas.protocol_agent.GetCommands
│     │ │  field at_time : float
│     │ │ episode_start:
│     │ │ dataclass aido_schemas.protocol_agent.EpisodeStart
│     │ │  field episode_name : str
│     │ │             __doc__    Marker for the start of an episode.
│     │ outputs:
│     │ dict[1]
│     │ │ commands:
│     │ │ dataclass aido_schemas.schemas.DB20Commands
│     │ │  field wheels : dataclass aido_schemas.schemas.PWMCommands
│     │ │                  field  motor_left : float
│     │ │                  field motor_right : float
│     │ │                            __doc__
│     │ │                                              PWM commands are floats between -1 and 1.
│     │ │  field   LEDS : dataclass aido_schemas.schemas.LEDSCommands
│     │ │                  field      center : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field  front_left : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field front_right : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field   back_left : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field  back_right : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 633, in go
    wrap(cie)
  File "experiment_manager.py", line 618, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 294, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible