Duckietown Challenges Home Challenges Submissions

Evaluator 775

ID775
evaluatoridsc-rudolf-33246
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-33246
versiond-c:4.0.18;d-c-r:4.0.28;d-s:4.0.18
first heard
last heard
statusinactive
# evaluating
# success30 19257
# timeout1 20642
# failed2 19765
# error20 19494
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
206422410jiang pengBaseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationtimeoutnoidsc-rudolf-332461:05:46
I can see how the jo [...]
I can see how the job 20642 is timeout because passed 3946 seconds and the timeout is 3600.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
206402375Liam Paull 🇨🇦minimal_agent_python2 (Python 2)aido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-332460:05:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6706320447655254
survival_time_median3.649999999999995
deviation-center-line_median0.1443022347216951
in-drivable-lane_median0.1999999999999993


other stats
agent_compute-ego_max0.05678640653009284
agent_compute-ego_mean0.053447609152976486
agent_compute-ego_median0.053859133805547445
agent_compute-ego_min0.04973095172160381
deviation-center-line_max0.4004784761211184
deviation-center-line_mean0.2180329391973995
deviation-center-line_min0.1241222516023625
deviation-heading_max1.0472953726467125
deviation-heading_mean0.5587116998597059
deviation-heading_median0.5584700619682197
deviation-heading_min0.3001803644882976
driven_any_max1.5796421483387642
driven_any_mean0.8626819028624159
driven_any_median0.9946421491379502
driven_any_min0.2748323161055837
driven_lanedir_consec_max1.1255773482598914
driven_lanedir_consec_mean0.6744516539239503
driven_lanedir_consec_min0.26694401727266204
driven_lanedir_max1.1255773482598914
driven_lanedir_mean0.6744516539239503
driven_lanedir_median0.6706320447655254
driven_lanedir_min0.26694401727266204
in-drivable-lane_max1.499999999999995
in-drivable-lane_mean0.5299999999999981
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9946421491379502, "sim_physics": 0.0537299783262488, "survival_time": 3.649999999999995, "driven_lanedir": 0.6706320447655254, "sim_render-ego": 0.05647324209343897, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.05678640653009284, "deviation-heading": 0.5584700619682197, "set_robot_commands": 0.07885381293623414, "deviation-center-line": 0.1443022347216951, "driven_lanedir_consec": 0.6706320447655254, "sim_compute_sim_state": 0.038855252200610015, "sim_compute_performance-ego": 0.06275676701166859, "sim_compute_robot_state-ego": 0.06253381624613723}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.009642148956158, "sim_physics": 0.0533325382181116, "survival_time": 3.699999999999995, "driven_lanedir": 0.8759181599115546, "sim_render-ego": 0.058060417304167874, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.053864994564571896, "deviation-heading": 1.0472953726467125, "set_robot_commands": 0.07658006693865801, "deviation-center-line": 0.29628367710760867, "driven_lanedir_consec": 0.8759181599115546, "sim_compute_sim_state": 0.040550496127154376, "sim_compute_performance-ego": 0.06139749127465326, "sim_compute_robot_state-ego": 0.062303266009768925}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2748323161055837, "sim_physics": 0.05270236968994141, "survival_time": 1.2500000000000004, "driven_lanedir": 0.26694401727266204, "sim_render-ego": 0.05647793769836426, "in-drivable-lane": 0, "agent_compute-ego": 0.052996559143066405, "deviation-heading": 0.3001803644882976, "set_robot_commands": 0.07689805984497071, "deviation-center-line": 0.1241222516023625, "driven_lanedir_consec": 0.26694401727266204, "sim_compute_sim_state": 0.03659077644348144, "sim_compute_performance-ego": 0.06172598838806152, "sim_compute_robot_state-ego": 0.06141665458679199}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4546507517736229, "sim_physics": 0.05698789776982488, "survival_time": 1.850000000000001, "driven_lanedir": 0.43318669941011834, "sim_render-ego": 0.0522392311611691, "in-drivable-lane": 0, "agent_compute-ego": 0.04973095172160381, "deviation-heading": 0.5707543029776994, "set_robot_commands": 0.07598577318964778, "deviation-center-line": 0.1249780564342128, "driven_lanedir_consec": 0.43318669941011834, "sim_compute_sim_state": 0.038262689435804215, "sim_compute_performance-ego": 0.05625249244071342, "sim_compute_robot_state-ego": 0.05770084020253774}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5796421483387642, "sim_physics": 0.05732239357062748, "survival_time": 5.599999999999988, "driven_lanedir": 1.1255773482598914, "sim_render-ego": 0.05370521545410156, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.053859133805547445, "deviation-heading": 0.31685839721760034, "set_robot_commands": 0.0769573301076889, "deviation-center-line": 0.4004784761211184, "driven_lanedir_consec": 1.1255773482598914, "sim_compute_sim_state": 0.03585785627365112, "sim_compute_performance-ego": 0.060069307684898376, "sim_compute_robot_state-ego": 0.05966354267937797}}
set_robot_commands_max0.07885381293623414
set_robot_commands_mean0.07705500860343992
set_robot_commands_median0.07689805984497071
set_robot_commands_min0.07598577318964778
sim_compute_performance-ego_max0.06275676701166859
sim_compute_performance-ego_mean0.06044040935999904
sim_compute_performance-ego_median0.06139749127465326
sim_compute_performance-ego_min0.05625249244071342
sim_compute_robot_state-ego_max0.06253381624613723
sim_compute_robot_state-ego_mean0.06072362394492277
sim_compute_robot_state-ego_median0.06141665458679199
sim_compute_robot_state-ego_min0.05770084020253774
sim_compute_sim_state_max0.040550496127154376
sim_compute_sim_state_mean0.03802341409614023
sim_compute_sim_state_median0.038262689435804215
sim_compute_sim_state_min0.03585785627365112
sim_physics_max0.05732239357062748
sim_physics_mean0.05481503551495083
sim_physics_median0.0537299783262488
sim_physics_min0.05270236968994141
sim_render-ego_max0.058060417304167874
sim_render-ego_mean0.05539120874224836
sim_render-ego_median0.05647324209343897
sim_render-ego_min0.0522392311611691
simulation-passed1
survival_time_max5.599999999999988
survival_time_mean3.209999999999996
survival_time_min1.2500000000000004
No reset possible
206342388Andrea Censi 🇨🇭Baseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationsuccessnoidsc-rudolf-332460:05:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.08789898284331343
survival_time_median1.2000000000000004
deviation-center-line_median0.06524818059054621
in-drivable-lane_median0


other stats
agent_compute-ego_max0.32079746442682605
agent_compute-ego_mean0.2852317145604827
agent_compute-ego_median0.2791124979654948
agent_compute-ego_min0.2521081946112893
deviation-center-line_max0.1030990886335362
deviation-center-line_mean0.07549990331660908
deviation-center-line_min0.05676773403376822
deviation-heading_max0.8368580470264028
deviation-heading_mean0.6915811149427633
deviation-heading_median0.7098988902525658
deviation-heading_min0.5100004994950081
driven_any_max0.23401978428280495
driven_any_mean0.1629080296621939
driven_any_median0.14707425382887424
driven_any_min0.12119029611023092
driven_lanedir_consec_max0.0956947057217079
driven_lanedir_consec_mean0.08247271431875292
driven_lanedir_consec_min0.05521690390842515
driven_lanedir_max0.0956947057217079
driven_lanedir_mean0.08247271431875292
driven_lanedir_median0.08789898284331343
driven_lanedir_min0.05521690390842515
in-drivable-lane_max0.5000000000000004
in-drivable-lane_mean0.17000000000000015
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.23401978428280495, "sim_physics": 0.11189120657303754, "survival_time": 1.7000000000000008, "driven_lanedir": 0.0956947057217079, "sim_render-ego": 0.05350069438709932, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.32079746442682605, "deviation-heading": 0.7098988902525658, "set_robot_commands": 0.07540913890389835, "deviation-center-line": 0.06524818059054621, "driven_lanedir_consec": 0.0956947057217079, "sim_compute_sim_state": 0.03625603984383976, "sim_compute_performance-ego": 0.05720804719363942, "sim_compute_robot_state-ego": 0.057994442827561325, "sim_compute_robot_state-npc0": 0.06101005217608284, "sim_compute_robot_state-npc1": 0.05921436057371251, "sim_compute_robot_state-npc2": 0.06196576707503375, "sim_compute_robot_state-npc3": 0.06246469301335952}, "udem1-1-0": {"driven_any": 0.18564949827517604, "sim_physics": 0.11152284485953194, "survival_time": 1.4000000000000006, "driven_lanedir": 0.05521690390842515, "sim_render-ego": 0.05906672137124198, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.26449321849005564, "deviation-heading": 0.8368580470264028, "set_robot_commands": 0.07694018738610404, "deviation-center-line": 0.05676773403376822, "driven_lanedir_consec": 0.05521690390842515, "sim_compute_sim_state": 0.034493659223829, "sim_compute_performance-ego": 0.06823574645178658, "sim_compute_robot_state-ego": 0.06629298414502825, "sim_compute_robot_state-npc0": 0.06542788233075823, "sim_compute_robot_state-npc1": 0.06067348378045218, "sim_compute_robot_state-npc2": 0.0642979655947004, "sim_compute_robot_state-npc3": 0.06317658935274396}, "udem1-2-0": {"driven_any": 0.12119029611023092, "sim_physics": 0.11153263395482844, "survival_time": 1.1000000000000003, "driven_lanedir": 0.08491203597025798, "sim_render-ego": 0.05368561094457453, "in-drivable-lane": 0, "agent_compute-ego": 0.2521081946112893, "deviation-heading": 0.5100004994950081, "set_robot_commands": 0.07509432055733421, "deviation-center-line": 0.09423712034467742, "driven_lanedir_consec": 0.08491203597025798, "sim_compute_sim_state": 0.033913677388971504, "sim_compute_performance-ego": 0.05648427659815008, "sim_compute_robot_state-ego": 0.060221444476734505, "sim_compute_robot_state-npc0": 0.0664411566474221, "sim_compute_robot_state-npc1": 0.06055774471976541, "sim_compute_robot_state-npc2": 0.05959376421841708, "sim_compute_robot_state-npc3": 0.06005946072665128}, "udem1-3-0": {"driven_any": 0.12660631581388324, "sim_physics": 0.10331515471140544, "survival_time": 1.2000000000000004, "driven_lanedir": 0.0886409431500601, "sim_render-ego": 0.05705675482749939, "in-drivable-lane": 0, "agent_compute-ego": 0.2791124979654948, "deviation-heading": 0.6100123056521026, "set_robot_commands": 0.07570679982503255, "deviation-center-line": 0.1030990886335362, "driven_lanedir_consec": 0.0886409431500601, "sim_compute_sim_state": 0.03545922040939331, "sim_compute_performance-ego": 0.05942166845003763, "sim_compute_robot_state-ego": 0.06308656930923462, "sim_compute_robot_state-npc0": 0.06431439518928528, "sim_compute_robot_state-npc1": 0.060271491607030235, "sim_compute_robot_state-npc2": 0.05835409959157308, "sim_compute_robot_state-npc3": 0.05824096997578939}, "udem1-4-0": {"driven_any": 0.14707425382887424, "sim_physics": 0.09697078621905784, "survival_time": 1.1500000000000004, "driven_lanedir": 0.08789898284331343, "sim_render-ego": 0.05804887025252632, "in-drivable-lane": 0, "agent_compute-ego": 0.3096471973087477, "deviation-heading": 0.7911358322877375, "set_robot_commands": 0.0746421710304592, "deviation-center-line": 0.05814739298051729, "driven_lanedir_consec": 0.08789898284331343, "sim_compute_sim_state": 0.03383073599442192, "sim_compute_performance-ego": 0.0601693754610808, "sim_compute_robot_state-ego": 0.06475820748702339, "sim_compute_robot_state-npc0": 0.06150674819946289, "sim_compute_robot_state-npc1": 0.05897691975469175, "sim_compute_robot_state-npc2": 0.06315609683161197, "sim_compute_robot_state-npc3": 0.06003559154012929}}
set_robot_commands_max0.07694018738610404
set_robot_commands_mean0.07555852354056566
set_robot_commands_median0.07540913890389835
set_robot_commands_min0.0746421710304592
sim_compute_performance-ego_max0.06823574645178658
sim_compute_performance-ego_mean0.0603038228309389
sim_compute_performance-ego_median0.05942166845003763
sim_compute_performance-ego_min0.05648427659815008
sim_compute_robot_state-ego_max0.06629298414502825
sim_compute_robot_state-ego_mean0.062470729649116416
sim_compute_robot_state-ego_median0.06308656930923462
sim_compute_robot_state-ego_min0.057994442827561325
sim_compute_robot_state-npc0_max0.0664411566474221
sim_compute_robot_state-npc0_mean0.06374004690860227
sim_compute_robot_state-npc0_median0.06431439518928528
sim_compute_robot_state-npc0_min0.06101005217608284
sim_compute_robot_state-npc1_max0.06067348378045218
sim_compute_robot_state-npc1_mean0.059938800087130414
sim_compute_robot_state-npc1_median0.060271491607030235
sim_compute_robot_state-npc1_min0.05897691975469175
sim_compute_robot_state-npc2_max0.0642979655947004
sim_compute_robot_state-npc2_mean0.061473538662267256
sim_compute_robot_state-npc2_median0.06196576707503375
sim_compute_robot_state-npc2_min0.05835409959157308
sim_compute_robot_state-npc3_max0.06317658935274396
sim_compute_robot_state-npc3_mean0.06079546092173469
sim_compute_robot_state-npc3_median0.06005946072665128
sim_compute_robot_state-npc3_min0.05824096997578939
sim_compute_sim_state_max0.03625603984383976
sim_compute_sim_state_mean0.0347906665720911
sim_compute_sim_state_median0.034493659223829
sim_compute_sim_state_min0.03383073599442192
sim_physics_max0.11189120657303754
sim_physics_mean0.10704652526357224
sim_physics_median0.11152284485953194
sim_physics_min0.09697078621905784
sim_render-ego_max0.05906672137124198
sim_render-ego_mean0.05627173035658831
sim_render-ego_median0.05705675482749939
sim_render-ego_min0.05350069438709932
simulation-passed1
survival_time_max1.7000000000000008
survival_time_mean1.3100000000000005
survival_time_min1.1000000000000003
No reset possible
206112379Liam Paull 🇨🇦minimal_agent_python2 (Python 2)aido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-332460:10:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.558649192637226
survival_time_median5.549999999999988
deviation-center-line_median0.3651792130172341
in-drivable-lane_median0


other stats
agent_compute-ego_max0.0782500339659634
agent_compute-ego_mean0.05715702208750413
agent_compute-ego_median0.051715508103370667
agent_compute-ego_min0.051433277379779915
deviation-center-line_max0.5182957084389981
deviation-center-line_mean0.30910185599825146
deviation-center-line_min0.10671872096010238
deviation-heading_max0.6191860504142408
deviation-heading_mean0.5051570710006759
deviation-heading_median0.4990264797640249
deviation-heading_min0.42218734391092383
driven_any_max2.7646421483387584
driven_any_mean1.465650120385121
driven_any_median1.564642148338816
driven_any_min0.3796734051356721
driven_lanedir_consec_max1.90426734520812
driven_lanedir_consec_mean1.1962362176687749
driven_lanedir_consec_min0.3665322870232244
driven_lanedir_max1.9043179621963535
driven_lanedir_mean1.1963002021939713
driven_lanedir_median1.55885728532232
driven_lanedir_min0.3665322870232244
in-drivable-lane_max2.8500000000000165
in-drivable-lane_mean0.8600000000000023
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.564642148338816, "sim_physics": 0.10009732761898556, "survival_time": 5.549999999999988, "driven_lanedir": 1.55885728532232, "sim_render-ego": 0.057684597668347055, "in-drivable-lane": 0, "agent_compute-ego": 0.0527735980781349, "deviation-heading": 0.4743658651449014, "set_robot_commands": 0.07543867128389375, "deviation-center-line": 0.3651792130172341, "driven_lanedir_consec": 1.558649192637226, "sim_compute_sim_state": 0.03470725626558871, "sim_compute_performance-ego": 0.06095409178519034, "sim_compute_robot_state-ego": 0.06147345766290888, "sim_compute_robot_state-npc0": 0.06814623952985883, "sim_compute_robot_state-npc1": 0.06476463713087477, "sim_compute_robot_state-npc2": 0.06343985463047887, "sim_compute_robot_state-npc3": 0.06244247024123733}, "udem1-1-0": {"driven_any": 0.45465075177361847, "sim_physics": 0.10116803968274916, "survival_time": 1.850000000000001, "driven_lanedir": 0.429423773621628, "sim_render-ego": 0.05618938884219608, "in-drivable-lane": 0, "agent_compute-ego": 0.05161269291027172, "deviation-heading": 0.6191860504142408, "set_robot_commands": 0.07271761507601351, "deviation-center-line": 0.13176206253373424, "driven_lanedir_consec": 0.429423773621628, "sim_compute_sim_state": 0.034025340466885955, "sim_compute_performance-ego": 0.05798723890974715, "sim_compute_robot_state-ego": 0.05524267377080144, "sim_compute_robot_state-npc0": 0.0651129065333186, "sim_compute_robot_state-npc1": 0.06093483357816129, "sim_compute_robot_state-npc2": 0.05948231026933, "sim_compute_robot_state-npc3": 0.0591950545439849}, "udem1-2-0": {"driven_any": 2.1646421483387406, "sim_physics": 0.10255572180084836, "survival_time": 7.549999999999981, "driven_lanedir": 1.7223697028063305, "sim_render-ego": 0.05626682098338146, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.0782500339659634, "deviation-heading": 0.5110196157692881, "set_robot_commands": 0.07529771091132764, "deviation-center-line": 0.4235535750411885, "driven_lanedir_consec": 1.7223084898536762, "sim_compute_sim_state": 0.03382501539015612, "sim_compute_performance-ego": 0.05944425064996378, "sim_compute_robot_state-ego": 0.059008629906256466, "sim_compute_robot_state-npc0": 0.07210452982921474, "sim_compute_robot_state-npc1": 0.0627912243470451, "sim_compute_robot_state-npc2": 0.06081809744929636, "sim_compute_robot_state-npc3": 0.06132900162248422}, "udem1-3-0": {"driven_any": 2.7646421483387584, "sim_physics": 0.103621390477525, "survival_time": 9.55, "driven_lanedir": 1.9043179621963535, "sim_render-ego": 0.05495892394899698, "in-drivable-lane": 2.8500000000000165, "agent_compute-ego": 0.051433277379779915, "deviation-heading": 0.4990264797640249, "set_robot_commands": 0.07390652401909154, "deviation-center-line": 0.5182957084389981, "driven_lanedir_consec": 1.90426734520812, "sim_compute_sim_state": 0.033269015906368875, "sim_compute_performance-ego": 0.06064662384113092, "sim_compute_robot_state-ego": 0.05959187627462816, "sim_compute_robot_state-npc0": 0.06523966914072087, "sim_compute_robot_state-npc1": 0.06064374034941508, "sim_compute_robot_state-npc2": 0.0593186198728871, "sim_compute_robot_state-npc3": 0.0597899646659172}, "udem1-4-0": {"driven_any": 0.3796734051356721, "sim_physics": 0.09501408040523528, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3665322870232244, "sim_render-ego": 0.053573235869407654, "in-drivable-lane": 0, "agent_compute-ego": 0.051715508103370667, "deviation-heading": 0.42218734391092383, "set_robot_commands": 0.0753510594367981, "deviation-center-line": 0.10671872096010238, "driven_lanedir_consec": 0.3665322870232244, "sim_compute_sim_state": 0.032357774674892426, "sim_compute_performance-ego": 0.05864739418029785, "sim_compute_robot_state-ego": 0.05894072353839874, "sim_compute_robot_state-npc0": 0.06957337260246277, "sim_compute_robot_state-npc1": 0.06344632059335709, "sim_compute_robot_state-npc2": 0.05994729697704315, "sim_compute_robot_state-npc3": 0.057668983936309814}}
set_robot_commands_max0.07543867128389375
set_robot_commands_mean0.0745423161454249
set_robot_commands_median0.07529771091132764
set_robot_commands_min0.07271761507601351
sim_compute_performance-ego_max0.06095409178519034
sim_compute_performance-ego_mean0.05953591987326601
sim_compute_performance-ego_median0.05944425064996378
sim_compute_performance-ego_min0.05798723890974715
sim_compute_robot_state-ego_max0.06147345766290888
sim_compute_robot_state-ego_mean0.05885147223059874
sim_compute_robot_state-ego_median0.059008629906256466
sim_compute_robot_state-ego_min0.05524267377080144
sim_compute_robot_state-npc0_max0.07210452982921474
sim_compute_robot_state-npc0_mean0.06803534352711517
sim_compute_robot_state-npc0_median0.06814623952985883
sim_compute_robot_state-npc0_min0.0651129065333186
sim_compute_robot_state-npc1_max0.06476463713087477
sim_compute_robot_state-npc1_mean0.06251615119977066
sim_compute_robot_state-npc1_median0.0627912243470451
sim_compute_robot_state-npc1_min0.06064374034941508
sim_compute_robot_state-npc2_max0.06343985463047887
sim_compute_robot_state-npc2_mean0.0606012358398071
sim_compute_robot_state-npc2_median0.05994729697704315
sim_compute_robot_state-npc2_min0.0593186198728871
sim_compute_robot_state-npc3_max0.06244247024123733
sim_compute_robot_state-npc3_mean0.06008509500198669
sim_compute_robot_state-npc3_median0.0597899646659172
sim_compute_robot_state-npc3_min0.057668983936309814
sim_compute_sim_state_max0.03470725626558871
sim_compute_sim_state_mean0.033636880540778416
sim_compute_sim_state_median0.03382501539015612
sim_compute_sim_state_min0.032357774674892426
sim_physics_max0.103621390477525
sim_physics_mean0.10049131199706868
sim_physics_median0.10116803968274916
sim_physics_min0.09501408040523528
sim_render-ego_max0.057684597668347055
sim_render-ego_mean0.055734593462465856
sim_render-ego_median0.05618938884219608
sim_render-ego_min0.053573235869407654
simulation-passed1
survival_time_max9.55
survival_time_mean5.219999999999994
survival_time_min1.6000000000000008
No reset possible
206012400Liam Paull 🇨🇦random_agentaido2-LFVI-sim-validationstep1-simulationsuccessnoidsc-rudolf-332460:06:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7060476436119825
survival_time_median2.9499999999999975
deviation-center-line_median0.11000911211661404
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1287508487701416
agent_compute-ego_mean0.12334307981749712
agent_compute-ego_median0.12249666452407836
agent_compute-ego_min0.1209161321995622
deviation-center-line_max0.2756124593780862
deviation-center-line_mean0.14761657707365936
deviation-center-line_min0.05521015531316102
deviation-heading_max1.16360603086641
deviation-heading_mean0.4999185982159845
deviation-heading_median0.3379975413110555
deviation-heading_min0.23494529737543027
driven_any_max2.1872512115945857
driven_any_mean1.055944540531118
driven_any_median1.167808122478256
driven_any_min0.3209290725136122
driven_lanedir_consec_max0.9419039350715476
driven_lanedir_consec_mean0.6173219551829218
driven_lanedir_consec_min0.30305117192114617
driven_lanedir_max1.1635498459086595
driven_lanedir_mean0.6971981394313693
driven_lanedir_median0.7060476436119825
driven_lanedir_min0.30305117192114617
in-drivable-lane_max2.299999999999992
in-drivable-lane_mean0.6699999999999976
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.1872512115945857, "sim_physics": 0.10450493389705444, "survival_time": 5.299999999999989, "driven_lanedir": 0.9436286328096756, "sim_render-ego": 0.05239306081016109, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.12321770191192628, "deviation-heading": 1.16360603086641, "set_robot_commands": 0.07777566280005113, "deviation-center-line": 0.2756124593780862, "driven_lanedir_consec": 0.9419039350715476, "sim_compute_sim_state": 0.03425300346230561, "sim_compute_performance-ego": 0.058311399423851155, "sim_compute_robot_state-ego": 0.06338446095304669, "sim_compute_robot_state-npc0": 0.06483846565462509, "sim_compute_robot_state-npc1": 0.06447941852065753, "sim_compute_robot_state-npc2": 0.05972539928724181, "sim_compute_robot_state-npc3": 0.060283141316107985}, "udem1-1-0": {"driven_any": 0.4006933846040692, "sim_physics": 0.0917643904685974, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3697134029053832, "sim_render-ego": 0.05403044819831848, "in-drivable-lane": 0, "agent_compute-ego": 0.12249666452407836, "deviation-heading": 0.4544237660323392, "set_robot_commands": 0.07676642139752705, "deviation-center-line": 0.08336658676187406, "driven_lanedir_consec": 0.3697134029053832, "sim_compute_sim_state": 0.032696157693862915, "sim_compute_performance-ego": 0.05794504284858704, "sim_compute_robot_state-ego": 0.0591015617052714, "sim_compute_robot_state-npc0": 0.06487654646237691, "sim_compute_robot_state-npc1": 0.059556434551874794, "sim_compute_robot_state-npc2": 0.05818075935045878, "sim_compute_robot_state-npc3": 0.056616127490997314}, "udem1-2-0": {"driven_any": 1.167808122478256, "sim_physics": 0.10349999443959382, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1635498459086595, "sim_render-ego": 0.05422429715172719, "in-drivable-lane": 0, "agent_compute-ego": 0.1209161321995622, "deviation-heading": 0.23494529737543027, "set_robot_commands": 0.0752485808679613, "deviation-center-line": 0.21388457179856157, "driven_lanedir_consec": 0.7658936224045496, "sim_compute_sim_state": 0.034266823429172324, "sim_compute_performance-ego": 0.05840616711115433, "sim_compute_robot_state-ego": 0.05997444007356288, "sim_compute_robot_state-npc0": 0.06744260303044723, "sim_compute_robot_state-npc1": 0.0618669097706423, "sim_compute_robot_state-npc2": 0.05834143040543896, "sim_compute_robot_state-npc3": 0.05925762047201901}, "udem1-3-0": {"driven_any": 1.2030409114650664, "sim_physics": 0.10536868693464892, "survival_time": 2.9499999999999975, "driven_lanedir": 0.7060476436119825, "sim_render-ego": 0.05760255910582462, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.12133405168177716, "deviation-heading": 0.3379975413110555, "set_robot_commands": 0.0766767041157868, "deviation-center-line": 0.11000911211661404, "driven_lanedir_consec": 0.7060476436119825, "sim_compute_sim_state": 0.033942703473365914, "sim_compute_performance-ego": 0.06023741172531904, "sim_compute_robot_state-ego": 0.058327945612244685, "sim_compute_robot_state-npc0": 0.06588957269312971, "sim_compute_robot_state-npc1": 0.060953980785305215, "sim_compute_robot_state-npc2": 0.06128528158543473, "sim_compute_robot_state-npc3": 0.06209641391948118}, "udem1-4-0": {"driven_any": 0.3209290725136122, "sim_physics": 0.08604545593261718, "survival_time": 1.0000000000000002, "driven_lanedir": 0.30305117192114617, "sim_render-ego": 0.05222640037536621, "in-drivable-lane": 0, "agent_compute-ego": 0.1287508487701416, "deviation-heading": 0.30862035549468736, "set_robot_commands": 0.07961833477020264, "deviation-center-line": 0.05521015531316102, "driven_lanedir_consec": 0.30305117192114617, "sim_compute_sim_state": 0.031536006927490236, "sim_compute_performance-ego": 0.05796959400177002, "sim_compute_robot_state-ego": 0.056800448894500734, "sim_compute_robot_state-npc0": 0.059348011016845705, "sim_compute_robot_state-npc1": 0.05947275161743164, "sim_compute_robot_state-npc2": 0.0581373929977417, "sim_compute_robot_state-npc3": 0.0573498010635376}}
set_robot_commands_max0.07961833477020264
set_robot_commands_mean0.07721714079030578
set_robot_commands_median0.07676642139752705
set_robot_commands_min0.0752485808679613
sim_compute_performance-ego_max0.06023741172531904
sim_compute_performance-ego_mean0.05857392302213632
sim_compute_performance-ego_median0.058311399423851155
sim_compute_performance-ego_min0.05794504284858704
sim_compute_robot_state-ego_max0.06338446095304669
sim_compute_robot_state-ego_mean0.05951777144772528
sim_compute_robot_state-ego_median0.0591015617052714
sim_compute_robot_state-ego_min0.056800448894500734
sim_compute_robot_state-npc0_max0.06744260303044723
sim_compute_robot_state-npc0_mean0.06447903977148493
sim_compute_robot_state-npc0_median0.06487654646237691
sim_compute_robot_state-npc0_min0.059348011016845705
sim_compute_robot_state-npc1_max0.06447941852065753
sim_compute_robot_state-npc1_mean0.061265899049182296
sim_compute_robot_state-npc1_median0.060953980785305215
sim_compute_robot_state-npc1_min0.05947275161743164
sim_compute_robot_state-npc2_max0.06128528158543473
sim_compute_robot_state-npc2_mean0.0591340527252632
sim_compute_robot_state-npc2_median0.05834143040543896
sim_compute_robot_state-npc2_min0.0581373929977417
sim_compute_robot_state-npc3_max0.06209641391948118
sim_compute_robot_state-npc3_mean0.05912062085242862
sim_compute_robot_state-npc3_median0.05925762047201901
sim_compute_robot_state-npc3_min0.056616127490997314
sim_compute_sim_state_max0.034266823429172324
sim_compute_sim_state_mean0.0333389389972394
sim_compute_sim_state_median0.033942703473365914
sim_compute_sim_state_min0.031536006927490236
sim_physics_max0.10536868693464892
sim_physics_mean0.09823669233450236
sim_physics_median0.10349999443959382
sim_physics_min0.08604545593261718
sim_render-ego_max0.05760255910582462
sim_render-ego_mean0.054095353128279525
sim_render-ego_median0.05403044819831848
sim_render-ego_min0.05222640037536621
simulation-passed1
survival_time_max5.299999999999989
survival_time_mean2.679999999999997
survival_time_min1.0000000000000002
No reset possible
205882405Victor Guerra 🇫🇷Baseline solution using reinforcement learningaido2-LFV-sim-validationstep1-simulationsuccessnoidsc-rudolf-332460:05:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07243486682219613
survival_time_median1.2500000000000004
deviation-center-line_median0.06020878522451826
in-drivable-lane_median0.20000000000000015


other stats
agent_compute-ego_max0.2496512889862061
agent_compute-ego_mean0.2088247048300627
agent_compute-ego_median0.20547913468402365
agent_compute-ego_min0.17793285846710205
deviation-center-line_max0.1028235989781259
deviation-center-line_mean0.07242562422667773
deviation-center-line_min0.03928639936178569
deviation-heading_max0.8254127101623295
deviation-heading_mean0.6480676633784258
deviation-heading_median0.7062861912068601
deviation-heading_min0.49219420148533705
driven_any_max0.2257295670416291
driven_any_mean0.17517236474899828
driven_any_median0.14959863638115625
driven_any_min0.14045047435386326
driven_lanedir_consec_max0.11806158098669384
driven_lanedir_consec_mean0.08756593907328591
driven_lanedir_consec_min0.0686009820560578
driven_lanedir_max0.11806158098669384
driven_lanedir_mean0.08756593907328591
driven_lanedir_median0.07243486682219613
driven_lanedir_min0.0686009820560578
in-drivable-lane_max0.6000000000000005
in-drivable-lane_mean0.27000000000000024
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2257295670416291, "sim_physics": 0.10026463781084333, "survival_time": 1.7500000000000009, "driven_lanedir": 0.07243486682219613, "sim_render-ego": 0.053470339093889506, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.2180484090532575, "deviation-heading": 0.7062861912068601, "set_robot_commands": 0.07228192601885114, "deviation-center-line": 0.06020878522451826, "driven_lanedir_consec": 0.07243486682219613, "sim_compute_sim_state": 0.037279912403651645, "sim_compute_performance-ego": 0.05506845882960728, "sim_compute_robot_state-ego": 0.058618416104997906, "sim_compute_robot_state-npc0": 0.06651131766183035, "sim_compute_robot_state-npc1": 0.06257472038269044, "sim_compute_robot_state-npc2": 0.06185496875217983, "sim_compute_robot_state-npc3": 0.06544286864144462}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2167118482856377, "sim_physics": 0.09155301614241168, "survival_time": 1.6500000000000008, "driven_lanedir": 0.07137457237269151, "sim_render-ego": 0.051891081260912346, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.19301183295972416, "deviation-heading": 0.8254127101623295, "set_robot_commands": 0.07787839571634929, "deviation-center-line": 0.05770699581838093, "driven_lanedir_consec": 0.07137457237269151, "sim_compute_sim_state": 0.036004528854832504, "sim_compute_performance-ego": 0.05485856894290808, "sim_compute_robot_state-ego": 0.05987117507240989, "sim_compute_robot_state-npc0": 0.06541369178078392, "sim_compute_robot_state-npc1": 0.06346782048543294, "sim_compute_robot_state-npc2": 0.059212229468605736, "sim_compute_robot_state-npc3": 0.060939059113011215}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.14045047435386326, "sim_physics": 0.0851606908051864, "survival_time": 1.1500000000000004, "driven_lanedir": 0.10735769312879027, "sim_render-ego": 0.057975810507069465, "in-drivable-lane": 0, "agent_compute-ego": 0.20547913468402365, "deviation-heading": 0.49219420148533705, "set_robot_commands": 0.07954031488169795, "deviation-center-line": 0.10210234175057792, "driven_lanedir_consec": 0.10735769312879027, "sim_compute_sim_state": 0.03375910676043967, "sim_compute_performance-ego": 0.05994338574616805, "sim_compute_robot_state-ego": 0.05853818810504416, "sim_compute_robot_state-npc0": 0.06421149295309315, "sim_compute_robot_state-npc1": 0.06201123154681662, "sim_compute_robot_state-npc2": 0.06217558487601902, "sim_compute_robot_state-npc3": 0.0600139161814814}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.14959863638115625, "sim_physics": 0.09246511260668436, "survival_time": 1.2000000000000004, "driven_lanedir": 0.11806158098669384, "sim_render-ego": 0.05413226286570231, "in-drivable-lane": 0, "agent_compute-ego": 0.17793285846710205, "deviation-heading": 0.5089793695773352, "set_robot_commands": 0.08006731669108073, "deviation-center-line": 0.1028235989781259, "driven_lanedir_consec": 0.11806158098669384, "sim_compute_sim_state": 0.03457008798917135, "sim_compute_performance-ego": 0.05994477868080139, "sim_compute_robot_state-ego": 0.059733301401138306, "sim_compute_robot_state-npc0": 0.06364298860232036, "sim_compute_robot_state-npc1": 0.060607711474100746, "sim_compute_robot_state-npc2": 0.05969261129697164, "sim_compute_robot_state-npc3": 0.06160671512285868}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14337129768270512, "sim_physics": 0.07866951942443848, "survival_time": 1.2500000000000004, "driven_lanedir": 0.0686009820560578, "sim_render-ego": 0.05757745742797851, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.2496512889862061, "deviation-heading": 0.7074658444602671, "set_robot_commands": 0.0769071102142334, "deviation-center-line": 0.03928639936178569, "driven_lanedir_consec": 0.0686009820560578, "sim_compute_sim_state": 0.0342691707611084, "sim_compute_performance-ego": 0.05968266487121582, "sim_compute_robot_state-ego": 0.05848849296569824, "sim_compute_robot_state-npc0": 0.06443952560424805, "sim_compute_robot_state-npc1": 0.06103955268859863, "sim_compute_robot_state-npc2": 0.05863986015319824, "sim_compute_robot_state-npc3": 0.058666257858276366}}
set_robot_commands_max0.08006731669108073
set_robot_commands_mean0.07733501270444251
set_robot_commands_median0.07787839571634929
set_robot_commands_min0.07228192601885114
sim_compute_performance-ego_max0.05994477868080139
sim_compute_performance-ego_mean0.05789957141414013
sim_compute_performance-ego_median0.05968266487121582
sim_compute_performance-ego_min0.05485856894290808
sim_compute_robot_state-ego_max0.05987117507240989
sim_compute_robot_state-ego_mean0.0590499147298577
sim_compute_robot_state-ego_median0.058618416104997906
sim_compute_robot_state-ego_min0.05848849296569824
sim_compute_robot_state-npc0_max0.06651131766183035
sim_compute_robot_state-npc0_mean0.06484380332045517
sim_compute_robot_state-npc0_median0.06443952560424805
sim_compute_robot_state-npc0_min0.06364298860232036
sim_compute_robot_state-npc1_max0.06346782048543294
sim_compute_robot_state-npc1_mean0.06194020731552787
sim_compute_robot_state-npc1_median0.06201123154681662
sim_compute_robot_state-npc1_min0.060607711474100746
sim_compute_robot_state-npc2_max0.06217558487601902
sim_compute_robot_state-npc2_mean0.060315050909394895
sim_compute_robot_state-npc2_median0.05969261129697164
sim_compute_robot_state-npc2_min0.05863986015319824
sim_compute_robot_state-npc3_max0.06544286864144462
sim_compute_robot_state-npc3_mean0.06133376338341445
sim_compute_robot_state-npc3_median0.060939059113011215
sim_compute_robot_state-npc3_min0.058666257858276366
sim_compute_sim_state_max0.037279912403651645
sim_compute_sim_state_mean0.035176561353840716
sim_compute_sim_state_median0.03457008798917135
sim_compute_sim_state_min0.03375910676043967
sim_physics_max0.10026463781084333
sim_physics_mean0.08962259535791287
sim_physics_median0.09155301614241168
sim_physics_min0.07866951942443848
sim_render-ego_max0.057975810507069465
sim_render-ego_mean0.05500939023111042
sim_render-ego_median0.05413226286570231
sim_render-ego_min0.051891081260912346
simulation-passed1
survival_time_max1.7500000000000009
survival_time_mean1.4000000000000008
survival_time_min1.1500000000000004
No reset possible
202232981Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-332460:23:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8008143770358938
survival_time_median12.450000000000042
deviation-center-line_median0.651314455550869
in-drivable-lane_median0.4000000000000057


other stats
agent_compute-ego_max0.18725166169766388
agent_compute-ego_mean0.18036862736661383
agent_compute-ego_median0.17834162937020356
agent_compute-ego_min0.17537219524383546
deviation-center-line_max1.4964157571636751
deviation-center-line_mean0.7536880173488576
deviation-center-line_min0.3125241048581934
deviation-heading_max3.738396223165421
deviation-heading_mean1.9549111299567692
deviation-heading_median1.694684418575096
deviation-heading_min1.0682910497424034
driven_any_max1.483912155456037
driven_any_mean1.0856173141150445
driven_any_median1.0296361691229878
driven_any_min0.5211120085224937
driven_lanedir_consec_max1.475996544584743
driven_lanedir_consec_mean0.8714921388224063
driven_lanedir_consec_min0.4687246296361285
driven_lanedir_max1.4761012689509658
driven_lanedir_mean0.9257650531409476
driven_lanedir_median0.8008143770358938
driven_lanedir_min0.4687246296361285
in-drivable-lane_max3.1500000000000448
in-drivable-lane_mean1.3200000000000178
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.483912155456037, "sim_physics": 0.10983540534973144, "survival_time": 14.950000000000076, "driven_lanedir": 1.4761012689509658, "sim_render-ego": 0.05305982033411662, "in-drivable-lane": 0, "agent_compute-ego": 0.17537219524383546, "deviation-heading": 1.094848202369492, "set_robot_commands": 0.0750193174680074, "deviation-center-line": 0.651314455550869, "driven_lanedir_consec": 1.475996544584743, "sim_compute_sim_state": 0.03338125149408976, "sim_compute_performance-ego": 0.057450101375579835, "sim_compute_robot_state-ego": 0.05711700201034546, "sim_compute_robot_state-npc0": 0.06298070907592773, "sim_compute_robot_state-npc1": 0.05972101052602132, "sim_compute_robot_state-npc2": 0.05834337790807088, "sim_compute_robot_state-npc3": 0.05829809268315633}, "udem1-1-0": {"driven_any": 0.5211120085224937, "sim_physics": 0.09514791785546069, "survival_time": 5.299999999999989, "driven_lanedir": 0.4687246296361285, "sim_render-ego": 0.05378356969581461, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.17834162937020356, "deviation-heading": 1.694684418575096, "set_robot_commands": 0.07335621455930313, "deviation-center-line": 0.3125241048581934, "driven_lanedir_consec": 0.4687246296361285, "sim_compute_sim_state": 0.03289946070257223, "sim_compute_performance-ego": 0.059047379583682655, "sim_compute_robot_state-ego": 0.05767589245202406, "sim_compute_robot_state-npc0": 0.06522229932389169, "sim_compute_robot_state-npc1": 0.06159006199746762, "sim_compute_robot_state-npc2": 0.05952432470501594, "sim_compute_robot_state-npc3": 0.05954018178975807}, "udem1-2-0": {"driven_any": 1.0252966970145891, "sim_physics": 0.11200165940097058, "survival_time": 12.450000000000042, "driven_lanedir": 0.6964009596627739, "sim_render-ego": 0.05515017471160276, "in-drivable-lane": 3.1500000000000448, "agent_compute-ego": 0.17783608589785166, "deviation-heading": 2.1783357559314327, "set_robot_commands": 0.07562872300665062, "deviation-center-line": 0.8338261727744044, "driven_lanedir_consec": 0.6660015498526705, "sim_compute_sim_state": 0.034140759203807415, "sim_compute_performance-ego": 0.05800259448438285, "sim_compute_robot_state-ego": 0.05879049416047981, "sim_compute_robot_state-npc0": 0.0645240157483572, "sim_compute_robot_state-npc1": 0.06005794264705305, "sim_compute_robot_state-npc2": 0.058609347745596646, "sim_compute_robot_state-npc3": 0.05817215318181907}, "udem1-3-0": {"driven_any": 1.3681295404591132, "sim_physics": 0.11111217737197876, "survival_time": 14.950000000000076, "driven_lanedir": 1.1867840304189752, "sim_render-ego": 0.05524134635925293, "in-drivable-lane": 0.4000000000000057, "agent_compute-ego": 0.1830415646235148, "deviation-heading": 3.738396223165421, "set_robot_commands": 0.07613960107167562, "deviation-center-line": 1.4964157571636751, "driven_lanedir_consec": 0.9459235930025958, "sim_compute_sim_state": 0.03331776698430379, "sim_compute_performance-ego": 0.05844210465749105, "sim_compute_robot_state-ego": 0.058521092732747394, "sim_compute_robot_state-npc0": 0.06432050148646037, "sim_compute_robot_state-npc1": 0.06094820102055867, "sim_compute_robot_state-npc2": 0.05920590321222941, "sim_compute_robot_state-npc3": 0.05928309599558512}, "udem1-4-0": {"driven_any": 1.0296361691229878, "sim_physics": 0.10364278732921205, "survival_time": 11.050000000000022, "driven_lanedir": 0.8008143770358938, "sim_render-ego": 0.05768607860237225, "in-drivable-lane": 2.80000000000004, "agent_compute-ego": 0.18725166169766388, "deviation-heading": 1.0682910497424034, "set_robot_commands": 0.07583521286286919, "deviation-center-line": 0.47435959639714664, "driven_lanedir_consec": 0.8008143770358938, "sim_compute_sim_state": 0.03392293118783252, "sim_compute_performance-ego": 0.059145800128781414, "sim_compute_robot_state-ego": 0.05945039658524871, "sim_compute_robot_state-npc0": 0.06582006933462566, "sim_compute_robot_state-npc1": 0.062431997842918155, "sim_compute_robot_state-npc2": 0.0604403148409468, "sim_compute_robot_state-npc3": 0.061252707269936126}}
set_robot_commands_max0.07613960107167562
set_robot_commands_mean0.07519581379370119
set_robot_commands_median0.07562872300665062
set_robot_commands_min0.07335621455930313
sim_compute_performance-ego_max0.059145800128781414
sim_compute_performance-ego_mean0.05841759604598355
sim_compute_performance-ego_median0.05844210465749105
sim_compute_performance-ego_min0.057450101375579835
sim_compute_robot_state-ego_max0.05945039658524871
sim_compute_robot_state-ego_mean0.05831097558816909
sim_compute_robot_state-ego_median0.058521092732747394
sim_compute_robot_state-ego_min0.05711700201034546
sim_compute_robot_state-npc0_max0.06582006933462566
sim_compute_robot_state-npc0_mean0.06457351899385252
sim_compute_robot_state-npc0_median0.0645240157483572
sim_compute_robot_state-npc0_min0.06298070907592773
sim_compute_robot_state-npc1_max0.062431997842918155
sim_compute_robot_state-npc1_mean0.06094984280680377
sim_compute_robot_state-npc1_median0.06094820102055867
sim_compute_robot_state-npc1_min0.05972101052602132
sim_compute_robot_state-npc2_max0.0604403148409468
sim_compute_robot_state-npc2_mean0.05922465368237193
sim_compute_robot_state-npc2_median0.05920590321222941
sim_compute_robot_state-npc2_min0.05834337790807088
sim_compute_robot_state-npc3_max0.061252707269936126
sim_compute_robot_state-npc3_mean0.059309246184050944
sim_compute_robot_state-npc3_median0.05928309599558512
sim_compute_robot_state-npc3_min0.05817215318181907
sim_compute_sim_state_max0.034140759203807415
sim_compute_sim_state_mean0.03353243391452114
sim_compute_sim_state_median0.03338125149408976
sim_compute_sim_state_min0.03289946070257223
sim_physics_max0.11200165940097058
sim_physics_mean0.1063479894614707
sim_physics_median0.10983540534973144
sim_physics_min0.09514791785546069
sim_render-ego_max0.05768607860237225
sim_render-ego_mean0.05498419794063183
sim_render-ego_median0.05515017471160276
sim_render-ego_min0.05305982033411662
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.740000000000045
survival_time_min5.299999999999989
No reset possible
202202985Artem Ioselevskiichallenge-aido_LF-template-tensorflowaido2-LF-sim-testingstep1-simulationerrornoidsc-rudolf-332460:01:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 299, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 299, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
201652660Egor Zamotaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-332460:16:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6221509631973021
survival_time_median9.850000000000003
deviation-center-line_median0.46771045061219657
in-drivable-lane_median1.2500000000000178


other stats
agent_compute-ego_max0.060650377465574536
agent_compute-ego_mean0.059150685384702306
agent_compute-ego_median0.05933216038872214
agent_compute-ego_min0.057782143751780195
deviation-center-line_max1.0712966629299412
deviation-center-line_mean0.5390199594890948
deviation-center-line_min0.13707591378128714
deviation-heading_max5.7595024866444
deviation-heading_mean3.420227409707814
deviation-heading_median4.398848703549558
deviation-heading_min0.5301941248844619
driven_any_max2.3406504222359255
driven_any_mean1.429632116883734
driven_any_median1.5287753940621565
driven_any_min0.21945576820722149
driven_lanedir_consec_max1.1061182904977245
driven_lanedir_consec_mean0.6725018724771742
driven_lanedir_consec_min0.1937673077851083
driven_lanedir_max1.8340552903275975
driven_lanedir_mean0.8779312470383399
driven_lanedir_median0.6454741296536382
driven_lanedir_min0.1937673077851083
in-drivable-lane_max6.050000000000072
in-drivable-lane_mean2.2000000000000193
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.3336136726322976, "sim_physics": 0.10642710129419962, "survival_time": 14.950000000000076, "driven_lanedir": 1.8340552903275975, "sim_render-ego": 0.05124106327692668, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.057782143751780195, "deviation-heading": 5.7595024866444, "set_robot_commands": 0.07275460720062256, "deviation-center-line": 1.0712966629299412, "driven_lanedir_consec": 1.1061182904977245, "sim_compute_sim_state": 0.03150747378667196, "sim_compute_performance-ego": 0.055335789521535235, "sim_compute_robot_state-ego": 0.05562243064244588, "sim_compute_robot_state-npc0": 0.059459562301635745, "sim_compute_robot_state-npc1": 0.056310217380523685, "sim_compute_robot_state-npc2": 0.055386106173197426, "sim_compute_robot_state-npc3": 0.056303977966308594}, "udem1-1-0": {"driven_any": 0.7256653272810686, "sim_physics": 0.09125309629538624, "survival_time": 4.849999999999991, "driven_lanedir": 0.6221509631973021, "sim_render-ego": 0.05137414047398518, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.05781835624852131, "deviation-heading": 1.881560536082185, "set_robot_commands": 0.07514341098746073, "deviation-center-line": 0.2421716300566502, "driven_lanedir_consec": 0.6221509631973021, "sim_compute_sim_state": 0.03131709147974388, "sim_compute_performance-ego": 0.05513314119319326, "sim_compute_robot_state-ego": 0.05537840263130739, "sim_compute_robot_state-npc0": 0.05947286566508185, "sim_compute_robot_state-npc1": 0.05716671402921382, "sim_compute_robot_state-npc2": 0.05766191187593126, "sim_compute_robot_state-npc3": 0.05939490770556263}, "udem1-2-0": {"driven_any": 1.5287753940621565, "sim_physics": 0.10895194014922012, "survival_time": 9.850000000000003, "driven_lanedir": 0.6454741296536382, "sim_render-ego": 0.05403744387747673, "in-drivable-lane": 3.550000000000008, "agent_compute-ego": 0.06017038906891334, "deviation-heading": 4.398848703549558, "set_robot_commands": 0.07476493428806363, "deviation-center-line": 0.46771045061219657, "driven_lanedir_consec": 0.3542067814608556, "sim_compute_sim_state": 0.03245988109995266, "sim_compute_performance-ego": 0.05693311739694044, "sim_compute_robot_state-ego": 0.05789988053026538, "sim_compute_robot_state-npc0": 0.061423400936998086, "sim_compute_robot_state-npc1": 0.0589454621832988, "sim_compute_robot_state-npc2": 0.05842755651716049, "sim_compute_robot_state-npc3": 0.05850657351731044}, "udem1-3-0": {"driven_any": 0.21945576820722149, "sim_physics": 0.09951058556051816, "survival_time": 1.7000000000000008, "driven_lanedir": 0.1937673077851083, "sim_render-ego": 0.052713387152727914, "in-drivable-lane": 0, "agent_compute-ego": 0.05933216038872214, "deviation-heading": 0.5301941248844619, "set_robot_commands": 0.07418292410233442, "deviation-center-line": 0.13707591378128714, "driven_lanedir_consec": 0.1937673077851083, "sim_compute_sim_state": 0.030876938034506404, "sim_compute_performance-ego": 0.055432277567246384, "sim_compute_robot_state-ego": 0.05754693816689884, "sim_compute_robot_state-npc0": 0.0635237273047952, "sim_compute_robot_state-npc1": 0.05982342888327206, "sim_compute_robot_state-npc2": 0.06011361234328326, "sim_compute_robot_state-npc3": 0.05937053175533519}, "udem1-4-0": {"driven_any": 2.3406504222359255, "sim_physics": 0.11348430582340932, "survival_time": 14.900000000000077, "driven_lanedir": 1.0942085442280536, "sim_render-ego": 0.05395575337762001, "in-drivable-lane": 6.050000000000072, "agent_compute-ego": 0.060650377465574536, "deviation-heading": 4.531031197378464, "set_robot_commands": 0.07527775092412961, "deviation-center-line": 0.7768451400653992, "driven_lanedir_consec": 1.0862660194448803, "sim_compute_sim_state": 0.03283856379105741, "sim_compute_performance-ego": 0.05767398472600335, "sim_compute_robot_state-ego": 0.058033274324148294, "sim_compute_robot_state-npc0": 0.062228414036283555, "sim_compute_robot_state-npc1": 0.05919182140555158, "sim_compute_robot_state-npc2": 0.058579906521227534, "sim_compute_robot_state-npc3": 0.05972687110004809}}
set_robot_commands_max0.07527775092412961
set_robot_commands_mean0.07442472550052219
set_robot_commands_median0.07476493428806363
set_robot_commands_min0.07275460720062256
sim_compute_performance-ego_max0.05767398472600335
sim_compute_performance-ego_mean0.05610166208098373
sim_compute_performance-ego_median0.055432277567246384
sim_compute_performance-ego_min0.05513314119319326
sim_compute_robot_state-ego_max0.058033274324148294
sim_compute_robot_state-ego_mean0.05689618525901315
sim_compute_robot_state-ego_median0.05754693816689884
sim_compute_robot_state-ego_min0.05537840263130739
sim_compute_robot_state-npc0_max0.0635237273047952
sim_compute_robot_state-npc0_mean0.06122159404895888
sim_compute_robot_state-npc0_median0.061423400936998086
sim_compute_robot_state-npc0_min0.059459562301635745
sim_compute_robot_state-npc1_max0.05982342888327206
sim_compute_robot_state-npc1_mean0.058287528776371986
sim_compute_robot_state-npc1_median0.0589454621832988
sim_compute_robot_state-npc1_min0.056310217380523685
sim_compute_robot_state-npc2_max0.06011361234328326
sim_compute_robot_state-npc2_mean0.05803381868615999
sim_compute_robot_state-npc2_median0.05842755651716049
sim_compute_robot_state-npc2_min0.055386106173197426
sim_compute_robot_state-npc3_max0.05972687110004809
sim_compute_robot_state-npc3_mean0.058660572408912995
sim_compute_robot_state-npc3_median0.05937053175533519
sim_compute_robot_state-npc3_min0.056303977966308594
sim_compute_sim_state_max0.03283856379105741
sim_compute_sim_state_mean0.031799989638386456
sim_compute_sim_state_median0.03150747378667196
sim_compute_sim_state_min0.030876938034506404
sim_physics_max0.11348430582340932
sim_physics_mean0.10392540582454672
sim_physics_median0.10642710129419962
sim_physics_min0.09125309629538624
sim_render-ego_max0.05403744387747673
sim_render-ego_mean0.0526643576317473
sim_render-ego_median0.052713387152727914
sim_render-ego_min0.05124106327692668
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.25000000000003
survival_time_min1.7000000000000008
No reset possible
201632800Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationfailednoidsc-rudolf-332460:01:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
201602873Peter Almasi 🇭🇺challenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-332460:03:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07925249884761987
survival_time_median1.4500000000000006
deviation-center-line_median0.049028289949967746
in-drivable-lane_median0.20000000000000015


other stats
agent_compute-ego_max0.2087745415536981
agent_compute-ego_mean0.1839058143106773
agent_compute-ego_median0.1780347994395665
agent_compute-ego_min0.1724935844540596
deviation-center-line_max0.083604837604804
deviation-center-line_mean0.05615856210112875
deviation-center-line_min0.029679779654841486
deviation-heading_max0.777832359406052
deviation-heading_mean0.6964012528884002
deviation-heading_median0.7010676526208377
deviation-heading_min0.6164206612473526
driven_any_max0.2122160565115654
driven_any_mean0.17738567984889825
driven_any_median0.19452420240084772
driven_any_min0.09941331537443084
driven_lanedir_consec_max0.11106526084346856
driven_lanedir_consec_mean0.08315733159484535
driven_lanedir_consec_min0.05680863192090868
driven_lanedir_max0.11106526084346856
driven_lanedir_mean0.08315733159484535
driven_lanedir_median0.07925249884761987
driven_lanedir_min0.05680863192090868
in-drivable-lane_max0.4500000000000004
in-drivable-lane_mean0.2400000000000002
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2122160565115654, "sim_physics": 0.05413228889991497, "survival_time": 1.4500000000000006, "driven_lanedir": 0.11106526084346856, "sim_render-ego": 0.05775672813941692, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.17626751702407312, "deviation-heading": 0.7622333746836965, "set_robot_commands": 0.07653211725169215, "deviation-center-line": 0.07286978819047983, "driven_lanedir_consec": 0.11106526084346856, "sim_compute_sim_state": 0.03811711278455011, "sim_compute_performance-ego": 0.05988282992922027, "sim_compute_robot_state-ego": 0.061958987137366986}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19452420240084772, "sim_physics": 0.05412037670612335, "survival_time": 1.6000000000000008, "driven_lanedir": 0.07925249884761987, "sim_render-ego": 0.061725907027721405, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.1724935844540596, "deviation-heading": 0.6244522164840617, "set_robot_commands": 0.07988141477108002, "deviation-center-line": 0.029679779654841486, "driven_lanedir_consec": 0.07925249884761987, "sim_compute_sim_state": 0.04009275883436203, "sim_compute_performance-ego": 0.061559706926345825, "sim_compute_robot_state-ego": 0.06354360282421112}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09941331537443084, "sim_physics": 0.04399538040161133, "survival_time": 0.9500000000000004, "driven_lanedir": 0.05680863192090868, "sim_render-ego": 0.05712637148405377, "in-drivable-lane": 0, "agent_compute-ego": 0.2087745415536981, "deviation-heading": 0.6164206612473526, "set_robot_commands": 0.07684378874929328, "deviation-center-line": 0.083604837604804, "driven_lanedir_consec": 0.05680863192090868, "sim_compute_sim_state": 0.04024293548182437, "sim_compute_performance-ego": 0.0624350999530993, "sim_compute_robot_state-ego": 0.063742060410349}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.18588405553503864, "sim_physics": 0.05105664048876081, "survival_time": 1.4000000000000006, "driven_lanedir": 0.06339685179954335, "sim_render-ego": 0.05883265393120902, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.1780347994395665, "deviation-heading": 0.777832359406052, "set_robot_commands": 0.07766612938472203, "deviation-center-line": 0.045610115105550686, "driven_lanedir_consec": 0.06339685179954335, "sim_compute_sim_state": 0.04152614729745047, "sim_compute_performance-ego": 0.06756092820848737, "sim_compute_robot_state-ego": 0.06620717900139945}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1948907694226087, "sim_physics": 0.05138431746384193, "survival_time": 1.4500000000000006, "driven_lanedir": 0.10526341456268629, "sim_render-ego": 0.05838551192448057, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.18395862908198915, "deviation-heading": 0.7010676526208377, "set_robot_commands": 0.07443984623613029, "deviation-center-line": 0.049028289949967746, "driven_lanedir_consec": 0.10526341456268629, "sim_compute_sim_state": 0.039649297451150825, "sim_compute_performance-ego": 0.06138101117364291, "sim_compute_robot_state-ego": 0.05991957927572316}}
set_robot_commands_max0.07988141477108002
set_robot_commands_mean0.07707265927858356
set_robot_commands_median0.07684378874929328
set_robot_commands_min0.07443984623613029
sim_compute_performance-ego_max0.06756092820848737
sim_compute_performance-ego_mean0.06256391523815914
sim_compute_performance-ego_median0.061559706926345825
sim_compute_performance-ego_min0.05988282992922027
sim_compute_robot_state-ego_max0.06620717900139945
sim_compute_robot_state-ego_mean0.06307428172980994
sim_compute_robot_state-ego_median0.06354360282421112
sim_compute_robot_state-ego_min0.05991957927572316
sim_compute_sim_state_max0.04152614729745047
sim_compute_sim_state_mean0.03992565036986756
sim_compute_sim_state_median0.04009275883436203
sim_compute_sim_state_min0.03811711278455011
sim_physics_max0.05413228889991497
sim_physics_mean0.05093780079205048
sim_physics_median0.05138431746384193
sim_physics_min0.04399538040161133
sim_render-ego_max0.061725907027721405
sim_render-ego_mean0.058765434501376335
sim_render-ego_median0.05838551192448057
sim_render-ego_min0.05712637148405377
simulation-passed1
survival_time_max1.6000000000000008
survival_time_mean1.3700000000000006
survival_time_min0.9500000000000004
No reset possible
201003058Andrea Censi 🇨🇭rotationaido2-LFV-sim-testingstep1-simulationsuccessnoidsc-rudolf-332460:24:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0003125715775303961
survival_time_median14.950000000000076
deviation-center-line_median0.478243101326462
in-drivable-lane_median7.650000000000043


other stats
agent_compute-ego_max0.13832538843154907
agent_compute-ego_mean0.13385793463389078
agent_compute-ego_median0.13648879925409954
agent_compute-ego_min0.1274816640218099
deviation-center-line_max0.6209550267779761
deviation-center-line_mean0.4172259140872213
deviation-center-line_min0.02532878110195172
deviation-heading_max5.820018247123898
deviation-heading_mean5.66465523994005
deviation-heading_median5.766106818286449
deviation-heading_min5.484319536528106
driven_any_max0.028934981635126217
driven_any_mean0.026549538326383237
driven_any_median0.0259583636542601
driven_any_min0.02415889791701752
driven_lanedir_consec_max0.002754464494397091
driven_lanedir_consec_mean-0.0001884023213521102
driven_lanedir_consec_min-0.004302922900186967
driven_lanedir_max0.002754464494397091
driven_lanedir_mean-0.0001884023213521102
driven_lanedir_median0.0003125715775303961
driven_lanedir_min-0.004302922900186967
in-drivable-lane_max7.650000000000044
in-drivable-lane_mean7.630000000000043
in-drivable-lane_min7.550000000000042
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.028934981635126217, "sim_physics": 0.038162017663319905, "survival_time": 14.950000000000076, "driven_lanedir": 0.002754464494397091, "sim_render-ego": 0.05258587916692098, "in-drivable-lane": 7.550000000000042, "agent_compute-ego": 0.1274816640218099, "deviation-heading": 5.767844541062104, "set_robot_commands": 0.07490266958872477, "deviation-center-line": 0.556068910796392, "driven_lanedir_consec": 0.002754464494397091, "sim_compute_sim_state": 0.03274937788645427, "sim_compute_performance-ego": 0.05686197439829509, "sim_compute_robot_state-ego": 0.05789941628774007, "sim_compute_robot_state-npc0": 0.06082530657450358, "sim_compute_robot_state-npc1": 0.05843212842941284, "sim_compute_robot_state-npc2": 0.05696588675181071, "sim_compute_robot_state-npc3": 0.05644970575968424}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.0259583636542601, "sim_physics": 0.03787256717681885, "survival_time": 14.950000000000076, "driven_lanedir": -0.004302922900186967, "sim_render-ego": 0.05218948523203532, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.12973972797393798, "deviation-heading": 5.820018247123898, "set_robot_commands": 0.07546864668528239, "deviation-center-line": 0.6209550267779761, "driven_lanedir_consec": -0.004302922900186967, "sim_compute_sim_state": 0.03221759796142578, "sim_compute_performance-ego": 0.058798359235127766, "sim_compute_robot_state-ego": 0.05811221917470296, "sim_compute_robot_state-npc0": 0.06244476874669393, "sim_compute_robot_state-npc1": 0.05889809370040894, "sim_compute_robot_state-npc2": 0.057568023999532064, "sim_compute_robot_state-npc3": 0.05773507356643677}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.0257546511423514, "sim_physics": 0.040308782259623206, "survival_time": 14.950000000000076, "driven_lanedir": 0.0025125861000567795, "sim_render-ego": 0.05621159791946411, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.13648879925409954, "deviation-heading": 5.484987056699692, "set_robot_commands": 0.07507770697275798, "deviation-center-line": 0.478243101326462, "driven_lanedir_consec": 0.0025125861000567795, "sim_compute_sim_state": 0.03435249964396159, "sim_compute_performance-ego": 0.05991277694702148, "sim_compute_robot_state-ego": 0.06013510386149089, "sim_compute_robot_state-npc0": 0.06694666624069213, "sim_compute_robot_state-npc1": 0.061988698641459145, "sim_compute_robot_state-npc2": 0.06093803246815999, "sim_compute_robot_state-npc3": 0.0615154774983724}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.02415889791701752, "sim_physics": 0.038954977989196775, "survival_time": 14.950000000000076, "driven_lanedir": -0.00221871087855785, "sim_render-ego": 0.05590744654337565, "in-drivable-lane": 7.650000000000044, "agent_compute-ego": 0.13832538843154907, "deviation-heading": 5.484319536528106, "set_robot_commands": 0.0761488143603007, "deviation-center-line": 0.4055337504333249, "driven_lanedir_consec": -0.00221871087855785, "sim_compute_sim_state": 0.033733997344970706, "sim_compute_performance-ego": 0.060727118651072186, "sim_compute_robot_state-ego": 0.059450523853302, "sim_compute_robot_state-npc0": 0.06559658924738566, "sim_compute_robot_state-npc1": 0.06137882391611735, "sim_compute_robot_state-npc2": 0.06149664004643758, "sim_compute_robot_state-npc3": 0.06113213062286377}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.02794079728316096, "sim_physics": 0.03884616454442342, "survival_time": 14.950000000000076, "driven_lanedir": 0.0003125715775303961, "sim_render-ego": 0.05523032426834106, "in-drivable-lane": 7.650000000000042, "agent_compute-ego": 0.13725409348805745, "deviation-heading": 5.766106818286449, "set_robot_commands": 0.07809575080871582, "deviation-center-line": 0.02532878110195172, "driven_lanedir_consec": 0.0003125715775303961, "sim_compute_sim_state": 0.03374590714772542, "sim_compute_performance-ego": 0.05925206184387207, "sim_compute_robot_state-ego": 0.05988582770029704, "sim_compute_robot_state-npc0": 0.06451289097468059, "sim_compute_robot_state-npc1": 0.061338642438252766, "sim_compute_robot_state-npc2": 0.06065812587738037, "sim_compute_robot_state-npc3": 0.06042586882909139}}
set_robot_commands_max0.07809575080871582
set_robot_commands_mean0.07593871768315633
set_robot_commands_median0.07546864668528239
set_robot_commands_min0.07490266958872477
sim_compute_performance-ego_max0.060727118651072186
sim_compute_performance-ego_mean0.05911045821507773
sim_compute_performance-ego_median0.05925206184387207
sim_compute_performance-ego_min0.05686197439829509
sim_compute_robot_state-ego_max0.06013510386149089
sim_compute_robot_state-ego_mean0.0590966181755066
sim_compute_robot_state-ego_median0.059450523853302
sim_compute_robot_state-ego_min0.05789941628774007
sim_compute_robot_state-npc0_max0.06694666624069213
sim_compute_robot_state-npc0_mean0.06406524435679119
sim_compute_robot_state-npc0_median0.06451289097468059
sim_compute_robot_state-npc0_min0.06082530657450358
sim_compute_robot_state-npc1_max0.061988698641459145
sim_compute_robot_state-npc1_mean0.06040727742513021
sim_compute_robot_state-npc1_median0.061338642438252766
sim_compute_robot_state-npc1_min0.05843212842941284
sim_compute_robot_state-npc2_max0.06149664004643758
sim_compute_robot_state-npc2_mean0.05952534182866413
sim_compute_robot_state-npc2_median0.06065812587738037
sim_compute_robot_state-npc2_min0.05696588675181071
sim_compute_robot_state-npc3_max0.0615154774983724
sim_compute_robot_state-npc3_mean0.059451651255289714
sim_compute_robot_state-npc3_median0.06042586882909139
sim_compute_robot_state-npc3_min0.05644970575968424
sim_compute_sim_state_max0.03435249964396159
sim_compute_sim_state_mean0.033359875996907554
sim_compute_sim_state_median0.033733997344970706
sim_compute_sim_state_min0.03221759796142578
sim_physics_max0.040308782259623206
sim_physics_mean0.03882890192667643
sim_physics_median0.03884616454442342
sim_physics_min0.03787256717681885
sim_render-ego_max0.05621159791946411
sim_render-ego_mean0.054424946626027426
sim_render-ego_median0.05523032426834106
sim_render-ego_min0.05218948523203532
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
200862900Julian ZillyBaseline-IL-logs-tensorflowaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-332460:07:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6676541566021847
survival_time_median5.999999999999987
deviation-center-line_median0.22416012517925588
in-drivable-lane_median0.3999999999999986


other stats
agent_compute-ego_max0.19325972194514
agent_compute-ego_mean0.18629561131548172
agent_compute-ego_median0.1886447249232112
agent_compute-ego_min0.1792412734924153
deviation-center-line_max0.6379378246805854
deviation-center-line_mean0.34629148504051355
deviation-center-line_min0.1919187206778496
deviation-heading_max1.684227335028884
deviation-heading_mean0.9000456640051425
deviation-heading_median0.8899845750964701
deviation-heading_min0.4454648122297241
driven_any_max1.5799469375122617
driven_any_mean0.8584241132140015
driven_any_median0.9946918742759614
driven_any_min0.26967730827997427
driven_lanedir_consec_max1.1787689708466962
driven_lanedir_consec_mean0.6790509993172117
driven_lanedir_consec_min0.2618809529592845
driven_lanedir_max1.1787689708466962
driven_lanedir_mean0.6790509993172117
driven_lanedir_median0.6676541566021847
driven_lanedir_min0.2618809529592845
in-drivable-lane_max2.250000000000015
in-drivable-lane_mean0.8600000000000015
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9946918742759614, "sim_physics": 0.02781138221422831, "survival_time": 5.999999999999987, "driven_lanedir": 0.6676541566021847, "sim_render-ego": 0.06180068055788676, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.1886710524559021, "deviation-heading": 0.9349413623969528, "set_robot_commands": 0.07593809763590495, "deviation-center-line": 0.22416012517925588, "driven_lanedir_consec": 0.6676541566021847, "sim_compute_sim_state": 0.04008029699325562, "sim_compute_performance-ego": 0.06362756490707397, "sim_compute_robot_state-ego": 0.06675458550453187}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.003427023861872, "sim_physics": 0.02818840594331095, "survival_time": 6.0499999999999865, "driven_lanedir": 0.8641315628348967, "sim_render-ego": 0.0643103477383448, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.19325972194514, "deviation-heading": 1.684227335028884, "set_robot_commands": 0.07770866204884426, "deviation-center-line": 0.48252470362328614, "driven_lanedir_consec": 0.8641315628348967, "sim_compute_sim_state": 0.04132292881484859, "sim_compute_performance-ego": 0.0675524187482093, "sim_compute_robot_state-ego": 0.0683505476013688}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.26967730827997427, "sim_physics": 0.02819778468157794, "survival_time": 1.850000000000001, "driven_lanedir": 0.2618809529592845, "sim_render-ego": 0.06174883326968631, "in-drivable-lane": 0, "agent_compute-ego": 0.1886447249232112, "deviation-heading": 0.4454648122297241, "set_robot_commands": 0.074096815006153, "deviation-center-line": 0.1919187206778496, "driven_lanedir_consec": 0.2618809529592845, "sim_compute_sim_state": 0.03731290714160816, "sim_compute_performance-ego": 0.06411133585749446, "sim_compute_robot_state-ego": 0.06329732972222406}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.44437742213993825, "sim_physics": 0.02949609672814085, "survival_time": 2.849999999999998, "driven_lanedir": 0.42281935334299625, "sim_render-ego": 0.05835079310233133, "in-drivable-lane": 0, "agent_compute-ego": 0.18166128376074003, "deviation-heading": 0.8899845750964701, "set_robot_commands": 0.07299321576168663, "deviation-center-line": 0.1949160510415908, "driven_lanedir_consec": 0.42281935334299625, "sim_compute_sim_state": 0.03810523267377887, "sim_compute_performance-ego": 0.0626817084195321, "sim_compute_robot_state-ego": 0.06565618515014648}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5799469375122617, "sim_physics": 0.026371588681470905, "survival_time": 9.349999999999998, "driven_lanedir": 1.1787689708466962, "sim_render-ego": 0.058269496907524886, "in-drivable-lane": 2.250000000000015, "agent_compute-ego": 0.1792412734924153, "deviation-heading": 0.5456102352736815, "set_robot_commands": 0.07437748322512376, "deviation-center-line": 0.6379378246805854, "driven_lanedir_consec": 1.1787689708466962, "sim_compute_sim_state": 0.03733185395837467, "sim_compute_performance-ego": 0.06175092069860448, "sim_compute_robot_state-ego": 0.06412051450759969}}
set_robot_commands_max0.07770866204884426
set_robot_commands_mean0.07502285473554252
set_robot_commands_median0.07437748322512376
set_robot_commands_min0.07299321576168663
sim_compute_performance-ego_max0.0675524187482093
sim_compute_performance-ego_mean0.06394478972618287
sim_compute_performance-ego_median0.06362756490707397
sim_compute_performance-ego_min0.06175092069860448
sim_compute_robot_state-ego_max0.0683505476013688
sim_compute_robot_state-ego_mean0.06563583249717418
sim_compute_robot_state-ego_median0.06565618515014648
sim_compute_robot_state-ego_min0.06329732972222406
sim_compute_sim_state_max0.04132292881484859
sim_compute_sim_state_mean0.038830643916373184
sim_compute_sim_state_median0.03810523267377887
sim_compute_sim_state_min0.03731290714160816
sim_physics_max0.02949609672814085
sim_physics_mean0.02801305164974579
sim_physics_median0.02818840594331095
sim_physics_min0.026371588681470905
sim_render-ego_max0.0643103477383448
sim_render-ego_mean0.060896030315154816
sim_render-ego_median0.06174883326968631
sim_render-ego_min0.058269496907524886
simulation-passed1
survival_time_max9.349999999999998
survival_time_mean5.2199999999999935
survival_time_min1.850000000000001
No reset possible
200612907Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-332460:17:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.3935235228150438
survival_time_median8.349999999999984
deviation-center-line_median0.532584747249235
in-drivable-lane_median0


other stats
agent_compute-ego_max0.19466336727142333
agent_compute-ego_mean0.1845494587038054
agent_compute-ego_median0.18601566347582588
agent_compute-ego_min0.17376606067021688
deviation-center-line_max1.0926561022224814
deviation-center-line_mean0.5330307166595671
deviation-center-line_min0.1829676816078264
deviation-heading_max0.982962904582818
deviation-heading_mean0.8300818928985108
deviation-heading_median0.8497664605806897
deviation-heading_min0.6643836524907397
driven_any_max2.5533671935123077
driven_any_mean1.3898452211799102
driven_any_median1.4003273616565732
driven_any_min0.3783149598878067
driven_lanedir_consec_max2.2947836186459902
driven_lanedir_consec_mean1.2481774211187848
driven_lanedir_consec_min0.36500236206727954
driven_lanedir_max2.2948136156936503
driven_lanedir_mean1.2482595945843264
driven_lanedir_median1.3938733172402218
driven_lanedir_min0.36500236206727954
in-drivable-lane_max2.250000000000032
in-drivable-lane_mean0.7400000000000105
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.4003273616565732, "sim_physics": 0.10530953207415734, "survival_time": 8.349999999999984, "driven_lanedir": 1.3938733172402218, "sim_render-ego": 0.0611341927579777, "in-drivable-lane": 0, "agent_compute-ego": 0.19262546265196656, "deviation-heading": 0.7881985014433806, "set_robot_commands": 0.07816180925883219, "deviation-center-line": 0.532584747249235, "driven_lanedir_consec": 1.3935235228150438, "sim_compute_sim_state": 0.03629195904303454, "sim_compute_performance-ego": 0.06270049860377512, "sim_compute_robot_state-ego": 0.06075540131437565, "sim_compute_robot_state-npc0": 0.07045211620673449, "sim_compute_robot_state-npc1": 0.06546957193020575, "sim_compute_robot_state-npc2": 0.06400136033931893, "sim_compute_robot_state-npc3": 0.06442963434550576}, "udem1-1-0": {"driven_any": 0.4481960084807194, "sim_physics": 0.0957751726282054, "survival_time": 2.8999999999999977, "driven_lanedir": 0.42260832602765186, "sim_render-ego": 0.05867804329970787, "in-drivable-lane": 0, "agent_compute-ego": 0.18601566347582588, "deviation-heading": 0.982962904582818, "set_robot_commands": 0.07664346283879774, "deviation-center-line": 0.20822374703391688, "driven_lanedir_consec": 0.42260832602765186, "sim_compute_sim_state": 0.03434097355809705, "sim_compute_performance-ego": 0.06020947982525003, "sim_compute_robot_state-ego": 0.060079282727734794, "sim_compute_robot_state-npc0": 0.06614522687320051, "sim_compute_robot_state-npc1": 0.06093887625069454, "sim_compute_robot_state-npc2": 0.06008547338946112, "sim_compute_robot_state-npc3": 0.059813117158824}, "udem1-2-0": {"driven_any": 2.169020582362143, "sim_physics": 0.1068028403263466, "survival_time": 12.750000000000046, "driven_lanedir": 1.7650003518928292, "sim_render-ego": 0.05375693078134574, "in-drivable-lane": 2.250000000000032, "agent_compute-ego": 0.17567673944959453, "deviation-heading": 0.8650979453949253, "set_robot_commands": 0.07476814961900898, "deviation-center-line": 0.6487213051843762, "driven_lanedir_consec": 1.7649692760379576, "sim_compute_sim_state": 0.03261387581918754, "sim_compute_performance-ego": 0.056865996940463195, "sim_compute_robot_state-ego": 0.057914382336186426, "sim_compute_robot_state-npc0": 0.06388567756204044, "sim_compute_robot_state-npc1": 0.06065423254873238, "sim_compute_robot_state-npc2": 0.058497983334111235, "sim_compute_robot_state-npc3": 0.05817364524392521}, "udem1-3-0": {"driven_any": 2.5533671935123077, "sim_physics": 0.11486276070276896, "survival_time": 14.950000000000076, "driven_lanedir": 2.2948136156936503, "sim_render-ego": 0.05306158542633057, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.17376606067021688, "deviation-heading": 0.8497664605806897, "set_robot_commands": 0.0737524422009786, "deviation-center-line": 1.0926561022224814, "driven_lanedir_consec": 2.2947836186459902, "sim_compute_sim_state": 0.0323017414410909, "sim_compute_performance-ego": 0.05764521757761638, "sim_compute_robot_state-ego": 0.05775403340657552, "sim_compute_robot_state-npc0": 0.06288119157155354, "sim_compute_robot_state-npc1": 0.057975890636444094, "sim_compute_robot_state-npc2": 0.057344985802968346, "sim_compute_robot_state-npc3": 0.05754843711853028}, "udem1-4-0": {"driven_any": 0.3783149598878067, "sim_physics": 0.10428412437438964, "survival_time": 2.499999999999999, "driven_lanedir": 0.36500236206727954, "sim_render-ego": 0.06156817436218262, "in-drivable-lane": 0, "agent_compute-ego": 0.19466336727142333, "deviation-heading": 0.6643836524907397, "set_robot_commands": 0.07643141269683838, "deviation-center-line": 0.1829676816078264, "driven_lanedir_consec": 0.36500236206727954, "sim_compute_sim_state": 0.03728843688964844, "sim_compute_performance-ego": 0.06340924739837646, "sim_compute_robot_state-ego": 0.06463944911956787, "sim_compute_robot_state-npc0": 0.0729574728012085, "sim_compute_robot_state-npc1": 0.06969345092773438, "sim_compute_robot_state-npc2": 0.06959816455841064, "sim_compute_robot_state-npc3": 0.06646714687347412}}
set_robot_commands_max0.07816180925883219
set_robot_commands_mean0.07595145532289119
set_robot_commands_median0.07643141269683838
set_robot_commands_min0.0737524422009786
sim_compute_performance-ego_max0.06340924739837646
sim_compute_performance-ego_mean0.060166088069096235
sim_compute_performance-ego_median0.06020947982525003
sim_compute_performance-ego_min0.056865996940463195
sim_compute_robot_state-ego_max0.06463944911956787
sim_compute_robot_state-ego_mean0.06022850978088805
sim_compute_robot_state-ego_median0.060079282727734794
sim_compute_robot_state-ego_min0.05775403340657552
sim_compute_robot_state-npc0_max0.0729574728012085
sim_compute_robot_state-npc0_mean0.0672643370029475
sim_compute_robot_state-npc0_median0.06614522687320051
sim_compute_robot_state-npc0_min0.06288119157155354
sim_compute_robot_state-npc1_max0.06969345092773438
sim_compute_robot_state-npc1_mean0.06294640445876223
sim_compute_robot_state-npc1_median0.06093887625069454
sim_compute_robot_state-npc1_min0.057975890636444094
sim_compute_robot_state-npc2_max0.06959816455841064
sim_compute_robot_state-npc2_mean0.06190559348485405
sim_compute_robot_state-npc2_median0.06008547338946112
sim_compute_robot_state-npc2_min0.057344985802968346
sim_compute_robot_state-npc3_max0.06646714687347412
sim_compute_robot_state-npc3_mean0.06128639614805187
sim_compute_robot_state-npc3_median0.059813117158824
sim_compute_robot_state-npc3_min0.05754843711853028
sim_compute_sim_state_max0.03728843688964844
sim_compute_sim_state_mean0.0345673973502117
sim_compute_sim_state_median0.03434097355809705
sim_compute_sim_state_min0.0323017414410909
sim_physics_max0.11486276070276896
sim_physics_mean0.10540688602117358
sim_physics_median0.10530953207415734
sim_physics_min0.0957751726282054
sim_render-ego_max0.06156817436218262
sim_render-ego_mean0.05763978532550891
sim_render-ego_median0.05867804329970787
sim_render-ego_min0.05306158542633057
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.29000000000002
survival_time_min2.499999999999999
No reset possible
199752499Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-332460:18:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3243819307678468
survival_time_median13.65000000000006
deviation-center-line_median0.2869107117868838
in-drivable-lane_median6.6500000000000306


other stats
agent_compute-ego_max0.1844794339749403
agent_compute-ego_mean0.17981326637422448
agent_compute-ego_median0.18082117265270603
agent_compute-ego_min0.17247338448801347
deviation-center-line_max0.34953397713238277
deviation-center-line_mean0.22355335314794536
deviation-center-line_min0.0804191632885854
deviation-heading_max5.859756520130735
deviation-heading_mean3.626490063826627
deviation-heading_median5.44522937089152
deviation-heading_min0.5700934719194761
driven_any_max1.295051553772256
driven_any_mean0.7843020407889736
driven_any_median1.1664552100968275
driven_any_min0.10938506813327968
driven_lanedir_consec_max0.35215712247409425
driven_lanedir_consec_mean0.22352471217223752
driven_lanedir_consec_min0.04470713557079087
driven_lanedir_max0.35215712247409425
driven_lanedir_mean0.22360060298895396
driven_lanedir_median0.3247613848514288
driven_lanedir_min0.04470713557079087
in-drivable-lane_max7.700000000000045
in-drivable-lane_mean4.560000000000025
in-drivable-lane_min0.4000000000000003
per-episodes
details{"udem1-0-0": {"driven_any": 1.2238478307772354, "sim_physics": 0.02892929792404175, "survival_time": 14.950000000000076, "driven_lanedir": 0.3277186917430064, "sim_render-ego": 0.06458154280980428, "in-drivable-lane": 7.700000000000045, "agent_compute-ego": 0.18330469528834023, "deviation-heading": 5.620467808269468, "set_robot_commands": 0.07796835660934448, "deviation-center-line": 0.2869107117868838, "driven_lanedir_consec": 0.3277186917430064, "sim_compute_sim_state": 0.0387438956896464, "sim_compute_performance-ego": 0.06634584188461304, "sim_compute_robot_state-ego": 0.06382453203201294, "sim_compute_robot_state-npc0": 0.07332891861597697, "sim_compute_robot_state-npc1": 0.07073748032251993, "sim_compute_robot_state-npc2": 0.06992053906122843, "sim_compute_robot_state-npc3": 0.06927472511927286}, "udem1-1-0": {"driven_any": 1.1664552100968275, "sim_physics": 0.03014954367836753, "survival_time": 13.65000000000006, "driven_lanedir": 0.3247613848514288, "sim_render-ego": 0.06925895362546593, "in-drivable-lane": 6.6500000000000306, "agent_compute-ego": 0.1844794339749403, "deviation-heading": 5.44522937089152, "set_robot_commands": 0.08040571824098244, "deviation-center-line": 0.30757191695900954, "driven_lanedir_consec": 0.3243819307678468, "sim_compute_sim_state": 0.040629974651686, "sim_compute_performance-ego": 0.06725577033046401, "sim_compute_robot_state-ego": 0.06472726881285727, "sim_compute_robot_state-npc0": 0.07538319856692584, "sim_compute_robot_state-npc1": 0.07134211631048293, "sim_compute_robot_state-npc2": 0.07113172457768367, "sim_compute_robot_state-npc3": 0.07121939449519901}, "udem1-2-0": {"driven_any": 0.10938506813327968, "sim_physics": 0.03344106674194336, "survival_time": 1.5500000000000007, "driven_lanedir": 0.04470713557079087, "sim_render-ego": 0.07135225880530573, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.17247338448801347, "deviation-heading": 0.5700934719194761, "set_robot_commands": 0.08053430434196227, "deviation-center-line": 0.0804191632885854, "driven_lanedir_consec": 0.04470713557079087, "sim_compute_sim_state": 0.04281551607193485, "sim_compute_performance-ego": 0.06975790762132214, "sim_compute_robot_state-ego": 0.0662601532474641, "sim_compute_robot_state-npc0": 0.08114566341523201, "sim_compute_robot_state-npc1": 0.07752456203583748, "sim_compute_robot_state-npc2": 0.0747644055274225, "sim_compute_robot_state-npc3": 0.0762120908306491}, "udem1-3-0": {"driven_any": 0.12677054116527017, "sim_physics": 0.0313157650732225, "survival_time": 1.5500000000000007, "driven_lanedir": 0.06865868030544942, "sim_render-ego": 0.07226677863828597, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.18082117265270603, "deviation-heading": 0.6369031479219379, "set_robot_commands": 0.07929149750740297, "deviation-center-line": 0.09333099657286537, "driven_lanedir_consec": 0.06865868030544942, "sim_compute_sim_state": 0.042868714178762125, "sim_compute_performance-ego": 0.07157336511919575, "sim_compute_robot_state-ego": 0.0658465354673324, "sim_compute_robot_state-npc0": 0.07817900565362745, "sim_compute_robot_state-npc1": 0.07606604791456653, "sim_compute_robot_state-npc2": 0.07496909941396405, "sim_compute_robot_state-npc3": 0.07458420722715316}, "udem1-4-0": {"driven_any": 1.295051553772256, "sim_physics": 0.02984785000483195, "survival_time": 14.950000000000076, "driven_lanedir": 0.35215712247409425, "sim_render-ego": 0.06991183757781982, "in-drivable-lane": 7.550000000000047, "agent_compute-ego": 0.1779876454671224, "deviation-heading": 5.859756520130735, "set_robot_commands": 0.07895257472991943, "deviation-center-line": 0.34953397713238277, "driven_lanedir_consec": 0.35215712247409425, "sim_compute_sim_state": 0.04167113701502482, "sim_compute_performance-ego": 0.06900490760803223, "sim_compute_robot_state-ego": 0.06596819877624512, "sim_compute_robot_state-npc0": 0.07815701007843018, "sim_compute_robot_state-npc1": 0.07474640925725301, "sim_compute_robot_state-npc2": 0.07349064509073894, "sim_compute_robot_state-npc3": 0.07380898793538411}}
set_robot_commands_max0.08053430434196227
set_robot_commands_mean0.07943049028592233
set_robot_commands_median0.07929149750740297
set_robot_commands_min0.07796835660934448
sim_compute_performance-ego_max0.07157336511919575
sim_compute_performance-ego_mean0.06878755851272543
sim_compute_performance-ego_median0.06900490760803223
sim_compute_performance-ego_min0.06634584188461304
sim_compute_robot_state-ego_max0.0662601532474641
sim_compute_robot_state-ego_mean0.06532533766718238
sim_compute_robot_state-ego_median0.0658465354673324
sim_compute_robot_state-ego_min0.06382453203201294
sim_compute_robot_state-npc0_max0.08114566341523201
sim_compute_robot_state-npc0_mean0.07723875926603849
sim_compute_robot_state-npc0_median0.07815701007843018
sim_compute_robot_state-npc0_min0.07332891861597697
sim_compute_robot_state-npc1_max0.07752456203583748
sim_compute_robot_state-npc1_mean0.07408332316813196
sim_compute_robot_state-npc1_median0.07474640925725301
sim_compute_robot_state-npc1_min0.07073748032251993
sim_compute_robot_state-npc2_max0.07496909941396405
sim_compute_robot_state-npc2_mean0.07285528273420752
sim_compute_robot_state-npc2_median0.07349064509073894
sim_compute_robot_state-npc2_min0.06992053906122843
sim_compute_robot_state-npc3_max0.0762120908306491
sim_compute_robot_state-npc3_mean0.07301988112153165
sim_compute_robot_state-npc3_median0.07380898793538411
sim_compute_robot_state-npc3_min0.06927472511927286
sim_compute_sim_state_max0.042868714178762125
sim_compute_sim_state_mean0.04134584752141083
sim_compute_sim_state_median0.04167113701502482
sim_compute_sim_state_min0.0387438956896464
sim_physics_max0.03344106674194336
sim_physics_mean0.03073670468448142
sim_physics_median0.03014954367836753
sim_physics_min0.02892929792404175
sim_render-ego_max0.07226677863828597
sim_render-ego_mean0.06947427429133635
sim_render-ego_median0.06991183757781982
sim_render-ego_min0.06458154280980428
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.330000000000044
survival_time_min1.5500000000000007
No reset possible
199662552Andrea Censi 🇨🇭challenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-validationstep1-simulationerrornoidsc-rudolf-332460:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 > 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199492641Egor Zamotaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-332460:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 > 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199402832Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-332460:00:39
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199222894Peter Almasi 🇭🇺Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-332460:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 281, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 359, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 281, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 359, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 > 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
199042677Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-332460:00:54
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 > 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
198892771Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationerrornoidsc-rudolf-332460:00:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 > 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
198762867Peter Almasi 🇭🇺Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-332460:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 > 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
198672925Bhairav Mehtachallenge-aido_LF-template-pytorchaido2-LFV-sim-validationstep1-simulationerrornoidsc-rudolf-332460:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 > 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
198592961Julian ZillyBaseline-IL-logs-tensorflowaido2-LFV-sim-validationstep1-simulationerrornoidsc-rudolf-332460:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 250, in run_episode
    sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "episode_start".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 209, in on_received_episode_start
                   ||     self.update_observations(context)
                   ||   File "gym_bridge.py", line 274, in update_observations
                   ||     jpg_data = rgb2jpg(obs)
                   ||   File "gym_bridge.py", line 352, in rgb2jpg
                   ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
                   || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
                   || > Unsupported depth of input image:
                   || >     'VDepth::contains(depth)'
                   || > where
                   || >     'depth' is 6 (CV_64F)
                   ||
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 250, in run_episode
 >     sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "episode_start".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 209, in on_received_episode_start
 >                    ||     self.update_observations(context)
 >                    ||   File "gym_bridge.py", line 274, in update_observations
 >                    ||     jpg_data = rgb2jpg(obs)
 >                    ||   File "gym_bridge.py", line 352, in rgb2jpg
 >                    ||     bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
 >                    || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
 >                    || > Unsupported depth of input image:
 >                    || >     'VDepth::contains(depth)'
 >                    || > where
 >                    || >     'depth' is 6 (CV_64F)
 >                    ||
 >                    ||
 > 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
198522999Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LFV-sim-validationstep1-simulationerrornoidsc-rudolf-332460:00:38
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
198352612Konstantin Chaikachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-332460:08:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4677520238097679
survival_time_median2.849999999999998
deviation-center-line_median0.13993923038273243
in-drivable-lane_median0.7999999999999972


other stats
agent_compute-ego_max0.07009203471834698
agent_compute-ego_mean0.06666212618693204
agent_compute-ego_median0.06665563887091959
agent_compute-ego_min0.06359887750525224
deviation-center-line_max0.441991081977021
deviation-center-line_mean0.24301419493149473
deviation-center-line_min0.11233303566656118
deviation-heading_max1.965590298952019
deviation-heading_mean0.904977224642509
deviation-heading_median0.6817498444220604
deviation-heading_min0.23880859753921196
driven_any_max2.234618045439434
driven_any_mean1.1136680430892796
driven_any_median0.7854280860806753
driven_any_min0.3734823939695258
driven_lanedir_consec_max1.4162453958283412
driven_lanedir_consec_mean0.7217431069832176
driven_lanedir_consec_min0.3618460409658957
driven_lanedir_max1.4162453958283412
driven_lanedir_mean0.7217431069832176
driven_lanedir_median0.4677520238097679
driven_lanedir_min0.3618460409658957
in-drivable-lane_max3.2999999999999883
in-drivable-lane_mean0.9999999999999964
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.234618045439434, "sim_physics": 0.029188895681101806, "survival_time": 7.84999999999998, "driven_lanedir": 0.9622559790225852, "sim_render-ego": 0.05845137310635512, "in-drivable-lane": 3.2999999999999883, "agent_compute-ego": 0.06665563887091959, "deviation-heading": 1.965590298952019, "set_robot_commands": 0.07661760384869423, "deviation-center-line": 0.441991081977021, "driven_lanedir_consec": 0.9622559790225852, "sim_compute_sim_state": 0.034257645819597185, "sim_compute_performance-ego": 0.06204591890808883, "sim_compute_robot_state-ego": 0.06228702235373722, "sim_compute_robot_state-npc0": 0.06673459490393377, "sim_compute_robot_state-npc1": 0.0626428841025966, "sim_compute_robot_state-npc2": 0.06139412199615673, "sim_compute_robot_state-npc3": 0.06230243603894665}, "udem1-1-0": {"driven_any": 0.4285089027009204, "sim_physics": 0.02875020002063952, "survival_time": 1.900000000000001, "driven_lanedir": 0.40061609528949793, "sim_render-ego": 0.058278334768194905, "in-drivable-lane": 0, "agent_compute-ego": 0.06359887750525224, "deviation-heading": 0.6817498444220604, "set_robot_commands": 0.07381533948998702, "deviation-center-line": 0.13993923038273243, "driven_lanedir_consec": 0.40061609528949793, "sim_compute_sim_state": 0.03445967247611598, "sim_compute_performance-ego": 0.05877351760864258, "sim_compute_robot_state-ego": 0.06304193797864412, "sim_compute_robot_state-npc0": 0.07089608593990929, "sim_compute_robot_state-npc1": 0.06392345930400647, "sim_compute_robot_state-npc2": 0.0617933336057161, "sim_compute_robot_state-npc3": 0.06089727502120169}, "udem1-2-0": {"driven_any": 0.7854280860806753, "sim_physics": 0.02909943513702928, "survival_time": 2.849999999999998, "driven_lanedir": 0.4677520238097679, "sim_render-ego": 0.05629041320399234, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.0646305335195441, "deviation-heading": 0.5453417041518706, "set_robot_commands": 0.07660778363545735, "deviation-center-line": 0.1193983417591152, "driven_lanedir_consec": 0.4677520238097679, "sim_compute_sim_state": 0.034863275394105074, "sim_compute_performance-ego": 0.059759487185561865, "sim_compute_robot_state-ego": 0.06285809634024636, "sim_compute_robot_state-npc0": 0.06844671567281087, "sim_compute_robot_state-npc1": 0.06399547426324141, "sim_compute_robot_state-npc2": 0.06178894795869526, "sim_compute_robot_state-npc3": 0.06294849044398258}, "udem1-3-0": {"driven_any": 0.3734823939695258, "sim_physics": 0.02861583674395526, "survival_time": 1.3500000000000003, "driven_lanedir": 0.3618460409658957, "sim_render-ego": 0.061253750765765155, "in-drivable-lane": 0, "agent_compute-ego": 0.06833354632059734, "deviation-heading": 0.23880859753921196, "set_robot_commands": 0.0843590807031702, "deviation-center-line": 0.11233303566656118, "driven_lanedir_consec": 0.3618460409658957, "sim_compute_sim_state": 0.0335462799778691, "sim_compute_performance-ego": 0.06012724064014576, "sim_compute_robot_state-ego": 0.062129577000935875, "sim_compute_robot_state-npc0": 0.07137072527850116, "sim_compute_robot_state-npc1": 0.06339702782807527, "sim_compute_robot_state-npc2": 0.06237853897942437, "sim_compute_robot_state-npc3": 0.061624491656268085}, "udem1-4-0": {"driven_any": 1.746302787255842, "sim_physics": 0.033283169307405984, "survival_time": 6.299999999999986, "driven_lanedir": 1.4162453958283412, "sim_render-ego": 0.06144185482509552, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.07009203471834698, "deviation-heading": 1.093395678147382, "set_robot_commands": 0.0761538895349654, "deviation-center-line": 0.401409284872044, "driven_lanedir_consec": 1.4162453958283412, "sim_compute_sim_state": 0.03792622921958802, "sim_compute_performance-ego": 0.06728101533556742, "sim_compute_robot_state-ego": 0.06775643901219444, "sim_compute_robot_state-npc0": 0.07267470208425371, "sim_compute_robot_state-npc1": 0.06852366243089948, "sim_compute_robot_state-npc2": 0.06678599403018043, "sim_compute_robot_state-npc3": 0.06706766287485759}}
set_robot_commands_max0.0843590807031702
set_robot_commands_mean0.07751073944245483
set_robot_commands_median0.07660778363545735
set_robot_commands_min0.07381533948998702
sim_compute_performance-ego_max0.06728101533556742
sim_compute_performance-ego_mean0.0615974359356013
sim_compute_performance-ego_median0.06012724064014576
sim_compute_performance-ego_min0.05877351760864258
sim_compute_robot_state-ego_max0.06775643901219444
sim_compute_robot_state-ego_mean0.0636146145371516
sim_compute_robot_state-ego_median0.06285809634024636
sim_compute_robot_state-ego_min0.062129577000935875
sim_compute_robot_state-npc0_max0.07267470208425371
sim_compute_robot_state-npc0_mean0.07002456477588176
sim_compute_robot_state-npc0_median0.07089608593990929
sim_compute_robot_state-npc0_min0.06673459490393377
sim_compute_robot_state-npc1_max0.06852366243089948
sim_compute_robot_state-npc1_mean0.06449650158576384
sim_compute_robot_state-npc1_median0.06392345930400647
sim_compute_robot_state-npc1_min0.0626428841025966
sim_compute_robot_state-npc2_max0.06678599403018043
sim_compute_robot_state-npc2_mean0.06282818731403458
sim_compute_robot_state-npc2_median0.0617933336057161
sim_compute_robot_state-npc2_min0.06139412199615673
sim_compute_robot_state-npc3_max0.06706766287485759
sim_compute_robot_state-npc3_mean0.06296807120705132
sim_compute_robot_state-npc3_median0.06230243603894665
sim_compute_robot_state-npc3_min0.06089727502120169
sim_compute_sim_state_max0.03792622921958802
sim_compute_sim_state_mean0.03501062057745507
sim_compute_sim_state_median0.03445967247611598
sim_compute_sim_state_min0.0335462799778691
sim_physics_max0.033283169307405984
sim_physics_mean0.029787507378026372
sim_physics_median0.02909943513702928
sim_physics_min0.02861583674395526
sim_render-ego_max0.06144185482509552
sim_render-ego_mean0.05914314533388061
sim_render-ego_median0.05845137310635512
sim_render-ego_min0.05629041320399234
simulation-passed1
survival_time_max7.84999999999998
survival_time_mean4.049999999999993
survival_time_min1.3500000000000003
No reset possible
198312672Rami Al-Naim 🇷🇺Modidfied configaido2-LFVI-sim-testingstep1-simulationerrornoidsc-rudolf-332460:00:39
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
198112952Bhairav MehtaBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-332460:09:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.09801388411773826
survival_time_median1.4000000000000006
deviation-center-line_median0.09563366960335694
in-drivable-lane_median0.5000000000000003


other stats
agent_compute-ego_max0.17811396635240978
agent_compute-ego_mean0.16514818600278683
agent_compute-ego_median0.16576786663221277
agent_compute-ego_min0.15380703884622324
deviation-center-line_max0.4739398897334668
deviation-center-line_mean0.15080036478137418
deviation-center-line_min0.02010668322386927
deviation-heading_max5.784994751351238
deviation-heading_mean1.6407911816237877
deviation-heading_median0.6453170694670025
deviation-heading_min0.507676652434632
driven_any_max1.9839949758682296
driven_any_mean0.5242233354811612
driven_any_median0.14752592801898554
driven_any_min0.12898387478989817
driven_lanedir_consec_max0.5926756032537952
driven_lanedir_consec_mean0.18319731081960913
driven_lanedir_consec_min0.032904277287397754
driven_lanedir_max0.5926756032537952
driven_lanedir_mean0.18319731081960913
driven_lanedir_median0.09801388411773826
driven_lanedir_min0.032904277287397754
in-drivable-lane_max7.1000000000000325
in-drivable-lane_mean1.6500000000000068
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.22314129424671883, "sim_physics": 0.028914516036574904, "survival_time": 1.850000000000001, "driven_lanedir": 0.08695393432989551, "sim_render-ego": 0.0624075580287624, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.1728202587849385, "deviation-heading": 0.7367910928268436, "set_robot_commands": 0.08103298496555637, "deviation-center-line": 0.061011120319653674, "driven_lanedir_consec": 0.08695393432989551, "sim_compute_sim_state": 0.03606189908208074, "sim_compute_performance-ego": 0.06243779208209064, "sim_compute_robot_state-ego": 0.06591836826221363, "sim_compute_robot_state-npc0": 0.07225090748554952, "sim_compute_robot_state-npc1": 0.06651485288465345, "sim_compute_robot_state-npc2": 0.06565982586628683, "sim_compute_robot_state-npc3": 0.06597576914606867}, "udem1-1-0": {"driven_any": 1.9839949758682296, "sim_physics": 0.029129890931977168, "survival_time": 14.40000000000007, "driven_lanedir": 0.5926756032537952, "sim_render-ego": 0.06198187006844415, "in-drivable-lane": 7.1000000000000325, "agent_compute-ego": 0.17811396635240978, "deviation-heading": 5.784994751351238, "set_robot_commands": 0.07947959668106502, "deviation-center-line": 0.4739398897334668, "driven_lanedir_consec": 0.5926756032537952, "sim_compute_sim_state": 0.035556686421235405, "sim_compute_performance-ego": 0.0625302866101265, "sim_compute_robot_state-ego": 0.06287322772873773, "sim_compute_robot_state-npc0": 0.06979274915324317, "sim_compute_robot_state-npc1": 0.06570009307728873, "sim_compute_robot_state-npc2": 0.06444099545478821, "sim_compute_robot_state-npc3": 0.06450085590283076}, "udem1-2-0": {"driven_any": 0.1374706044819733, "sim_physics": 0.030526596566905147, "survival_time": 1.1500000000000004, "driven_lanedir": 0.10543885510921892, "sim_render-ego": 0.06274563333262569, "in-drivable-lane": 0, "agent_compute-ego": 0.15380703884622324, "deviation-heading": 0.507676652434632, "set_robot_commands": 0.0742585451706596, "deviation-center-line": 0.10331046102652404, "driven_lanedir_consec": 0.10543885510921892, "sim_compute_sim_state": 0.031861636949622116, "sim_compute_performance-ego": 0.06113586218460747, "sim_compute_robot_state-ego": 0.0619024193805197, "sim_compute_robot_state-npc0": 0.06785259039505669, "sim_compute_robot_state-npc1": 0.06467345486516538, "sim_compute_robot_state-npc2": 0.06242414142774499, "sim_compute_robot_state-npc3": 0.06177968564240829}, "udem1-3-0": {"driven_any": 0.12898387478989817, "sim_physics": 0.027201745821082073, "survival_time": 1.1500000000000004, "driven_lanedir": 0.09801388411773826, "sim_render-ego": 0.06039228646651558, "in-drivable-lane": 0, "agent_compute-ego": 0.16576786663221277, "deviation-heading": 0.5291763420392231, "set_robot_commands": 0.0737293181212052, "deviation-center-line": 0.09563366960335694, "driven_lanedir_consec": 0.09801388411773826, "sim_compute_sim_state": 0.03258997461070185, "sim_compute_performance-ego": 0.06136170677516772, "sim_compute_robot_state-ego": 0.05983931085337763, "sim_compute_robot_state-npc0": 0.06037675816079845, "sim_compute_robot_state-npc1": 0.06007627818895423, "sim_compute_robot_state-npc2": 0.05526094851286515, "sim_compute_robot_state-npc3": 0.05709599412005881}, "udem1-4-0": {"driven_any": 0.14752592801898554, "sim_physics": 0.025530338287353516, "survival_time": 1.4000000000000006, "driven_lanedir": 0.032904277287397754, "sim_render-ego": 0.054538437298366, "in-drivable-lane": 0.5000000000000003, "agent_compute-ego": 0.15523179939814977, "deviation-heading": 0.6453170694670025, "set_robot_commands": 0.07504643712724958, "deviation-center-line": 0.02010668322386927, "driven_lanedir_consec": 0.032904277287397754, "sim_compute_sim_state": 0.034931344645363946, "sim_compute_performance-ego": 0.0599327598299299, "sim_compute_robot_state-ego": 0.05903010708945138, "sim_compute_robot_state-npc0": 0.06484224115099226, "sim_compute_robot_state-npc1": 0.06495555809565953, "sim_compute_robot_state-npc2": 0.06320622137614659, "sim_compute_robot_state-npc3": 0.06193867751530239}}
set_robot_commands_max0.08103298496555637
set_robot_commands_mean0.07670937641314715
set_robot_commands_median0.07504643712724958
set_robot_commands_min0.0737293181212052
sim_compute_performance-ego_max0.0625302866101265
sim_compute_performance-ego_mean0.06147968149638444
sim_compute_performance-ego_median0.06136170677516772
sim_compute_performance-ego_min0.0599327598299299
sim_compute_robot_state-ego_max0.06591836826221363
sim_compute_robot_state-ego_mean0.06191268666286002
sim_compute_robot_state-ego_median0.0619024193805197
sim_compute_robot_state-ego_min0.05903010708945138
sim_compute_robot_state-npc0_max0.07225090748554952
sim_compute_robot_state-npc0_mean0.06702304926912803
sim_compute_robot_state-npc0_median0.06785259039505669
sim_compute_robot_state-npc0_min0.06037675816079845
sim_compute_robot_state-npc1_max0.06651485288465345
sim_compute_robot_state-npc1_mean0.06438404742234427
sim_compute_robot_state-npc1_median0.06495555809565953
sim_compute_robot_state-npc1_min0.06007627818895423
sim_compute_robot_state-npc2_max0.06565982586628683
sim_compute_robot_state-npc2_mean0.06219842652756635
sim_compute_robot_state-npc2_median0.06320622137614659
sim_compute_robot_state-npc2_min0.05526094851286515
sim_compute_robot_state-npc3_max0.06597576914606867
sim_compute_robot_state-npc3_mean0.062258196465333794
sim_compute_robot_state-npc3_median0.06193867751530239
sim_compute_robot_state-npc3_min0.05709599412005881
sim_compute_sim_state_max0.03606189908208074
sim_compute_sim_state_mean0.03420030834180081
sim_compute_sim_state_median0.034931344645363946
sim_compute_sim_state_min0.031861636949622116
sim_physics_max0.030526596566905147
sim_physics_mean0.028260617528778564
sim_physics_median0.028914516036574904
sim_physics_min0.025530338287353516
sim_render-ego_max0.06274563333262569
sim_render-ego_mean0.060413157038942754
sim_render-ego_median0.06198187006844415
sim_render-ego_min0.054538437298366
simulation-passed1
survival_time_max14.40000000000007
survival_time_mean3.990000000000014
survival_time_min1.1500000000000004
No reset possible
198063026Manfred Diazchallenge-aido_LF-template-pytorchaido2-LFVI-sim-testingstep1-simulationerrornoidsc-rudolf-332460:00:39
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
197892555Andrea Censi 🇨🇭challenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-332460:08:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4677520238097679
survival_time_median2.849999999999998
deviation-center-line_median0.13993923038273243
in-drivable-lane_median0.7999999999999972


other stats
agent_compute-ego_max0.0709813506739914
agent_compute-ego_mean0.0687108650640252
agent_compute-ego_median0.06848332238575769
agent_compute-ego_min0.0674101953153257
deviation-center-line_max0.441991081977021
deviation-center-line_mean0.24301419493149473
deviation-center-line_min0.11233303566656118
deviation-heading_max1.965590298952019
deviation-heading_mean0.904977224642509
deviation-heading_median0.6817498444220604
deviation-heading_min0.23880859753921196
driven_any_max2.234618045439434
driven_any_mean1.1136680430892796
driven_any_median0.7854280860806753
driven_any_min0.3734823939695258
driven_lanedir_consec_max1.4162453958283412
driven_lanedir_consec_mean0.7217431069832176
driven_lanedir_consec_min0.3618460409658957
driven_lanedir_max1.4162453958283412
driven_lanedir_mean0.7217431069832176
driven_lanedir_median0.4677520238097679
driven_lanedir_min0.3618460409658957
in-drivable-lane_max3.2999999999999883
in-drivable-lane_mean0.9999999999999964
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.234618045439434, "sim_physics": 0.029389149064471008, "survival_time": 7.84999999999998, "driven_lanedir": 0.9622559790225852, "sim_render-ego": 0.06579044821915353, "in-drivable-lane": 3.2999999999999883, "agent_compute-ego": 0.0709813506739914, "deviation-heading": 1.965590298952019, "set_robot_commands": 0.07787789964372185, "deviation-center-line": 0.441991081977021, "driven_lanedir_consec": 0.9622559790225852, "sim_compute_sim_state": 0.03774471951138442, "sim_compute_performance-ego": 0.06529980708079733, "sim_compute_robot_state-ego": 0.06406367356610146, "sim_compute_robot_state-npc0": 0.07391062056183055, "sim_compute_robot_state-npc1": 0.06860452700572409, "sim_compute_robot_state-npc2": 0.06786986824813163, "sim_compute_robot_state-npc3": 0.06812818035198624}, "udem1-1-0": {"driven_any": 0.4285089027009204, "sim_physics": 0.02824357308839497, "survival_time": 1.900000000000001, "driven_lanedir": 0.40061609528949793, "sim_render-ego": 0.06426944230732165, "in-drivable-lane": 0, "agent_compute-ego": 0.06874886311982807, "deviation-heading": 0.6817498444220604, "set_robot_commands": 0.07352631343038459, "deviation-center-line": 0.13993923038273243, "driven_lanedir_consec": 0.40061609528949793, "sim_compute_sim_state": 0.039216348999424985, "sim_compute_performance-ego": 0.06758800305818256, "sim_compute_robot_state-ego": 0.06338714298449065, "sim_compute_robot_state-npc0": 0.07569186938436408, "sim_compute_robot_state-npc1": 0.06858401549489875, "sim_compute_robot_state-npc2": 0.06630341630232961, "sim_compute_robot_state-npc3": 0.06846818798466732}, "udem1-2-0": {"driven_any": 0.7854280860806753, "sim_physics": 0.03065202528970283, "survival_time": 2.849999999999998, "driven_lanedir": 0.4677520238097679, "sim_render-ego": 0.06719152550948293, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.06793059382522315, "deviation-heading": 0.5453417041518706, "set_robot_commands": 0.07498486836751302, "deviation-center-line": 0.1193983417591152, "driven_lanedir_consec": 0.4677520238097679, "sim_compute_sim_state": 0.03959087739910996, "sim_compute_performance-ego": 0.0683384610895525, "sim_compute_robot_state-ego": 0.06720802658482601, "sim_compute_robot_state-npc0": 0.07396563730741802, "sim_compute_robot_state-npc1": 0.07120530647143983, "sim_compute_robot_state-npc2": 0.07159014333758437, "sim_compute_robot_state-npc3": 0.06935066089295504}, "udem1-3-0": {"driven_any": 0.3734823939695258, "sim_physics": 0.030418290032280818, "survival_time": 1.3500000000000003, "driven_lanedir": 0.3618460409658957, "sim_render-ego": 0.06434775281835485, "in-drivable-lane": 0, "agent_compute-ego": 0.0674101953153257, "deviation-heading": 0.23880859753921196, "set_robot_commands": 0.07396052501819751, "deviation-center-line": 0.11233303566656118, "driven_lanedir_consec": 0.3618460409658957, "sim_compute_sim_state": 0.03971721507884838, "sim_compute_performance-ego": 0.06788672341240777, "sim_compute_robot_state-ego": 0.06746433399341724, "sim_compute_robot_state-npc0": 0.07449144787258571, "sim_compute_robot_state-npc1": 0.07000201719778555, "sim_compute_robot_state-npc2": 0.07036006009137188, "sim_compute_robot_state-npc3": 0.06960975682293927}, "udem1-4-0": {"driven_any": 1.746302787255842, "sim_physics": 0.031003533847748288, "survival_time": 6.299999999999986, "driven_lanedir": 1.4162453958283412, "sim_render-ego": 0.06734917277381533, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.06848332238575769, "deviation-heading": 1.093395678147382, "set_robot_commands": 0.07628075849442255, "deviation-center-line": 0.401409284872044, "driven_lanedir_consec": 1.4162453958283412, "sim_compute_sim_state": 0.03876064126453702, "sim_compute_performance-ego": 0.06734476581452385, "sim_compute_robot_state-ego": 0.06559567035190643, "sim_compute_robot_state-npc0": 0.07553630215781075, "sim_compute_robot_state-npc1": 0.07107299093216185, "sim_compute_robot_state-npc2": 0.0709642285392398, "sim_compute_robot_state-npc3": 0.0690013018865434}}
set_robot_commands_max0.07787789964372185
set_robot_commands_mean0.0753260729908479
set_robot_commands_median0.07498486836751302
set_robot_commands_min0.07352631343038459
sim_compute_performance-ego_max0.0683384610895525
sim_compute_performance-ego_mean0.0672915520910928
sim_compute_performance-ego_median0.06758800305818256
sim_compute_performance-ego_min0.06529980708079733
sim_compute_robot_state-ego_max0.06746433399341724
sim_compute_robot_state-ego_mean0.06554376949614835
sim_compute_robot_state-ego_median0.06559567035190643
sim_compute_robot_state-ego_min0.06338714298449065
sim_compute_robot_state-npc0_max0.07569186938436408
sim_compute_robot_state-npc0_mean0.07471917545680182
sim_compute_robot_state-npc0_median0.07449144787258571
sim_compute_robot_state-npc0_min0.07391062056183055
sim_compute_robot_state-npc1_max0.07120530647143983
sim_compute_robot_state-npc1_mean0.06989377142040201
sim_compute_robot_state-npc1_median0.07000201719778555
sim_compute_robot_state-npc1_min0.06858401549489875
sim_compute_robot_state-npc2_max0.07159014333758437
sim_compute_robot_state-npc2_mean0.06941754330373145
sim_compute_robot_state-npc2_median0.07036006009137188
sim_compute_robot_state-npc2_min0.06630341630232961
sim_compute_robot_state-npc3_max0.06960975682293927
sim_compute_robot_state-npc3_mean0.06891161758781825
sim_compute_robot_state-npc3_median0.0690013018865434
sim_compute_robot_state-npc3_min0.06812818035198624
sim_compute_sim_state_max0.03971721507884838
sim_compute_sim_state_mean0.039005960450660945
sim_compute_sim_state_median0.039216348999424985
sim_compute_sim_state_min0.03774471951138442
sim_physics_max0.031003533847748288
sim_physics_mean0.02994131426451958
sim_physics_median0.030418290032280818
sim_physics_min0.02824357308839497
sim_render-ego_max0.06734917277381533
sim_render-ego_mean0.06578966832562565
sim_render-ego_median0.06579044821915353
sim_render-ego_min0.06426944230732165
simulation-passed1
survival_time_max7.84999999999998
survival_time_mean4.049999999999993
survival_time_min1.3500000000000003
No reset possible
197722624Andrea Censi 🇨🇭challenge-aido_LF-template-randomaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-332460:06:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.630782078032722
survival_time_median2.6499999999999986
deviation-center-line_median0.10342694179960472
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.15114526478749402
agent_compute-ego_mean0.13980198092666082
agent_compute-ego_median0.13615774114926657
agent_compute-ego_min0.13432445349516692
deviation-center-line_max0.24274593434117447
deviation-center-line_mean0.1423794188959262
deviation-center-line_min0.05838775199208855
deviation-heading_max0.9510803390140998
deviation-heading_mean0.5404741772455786
deviation-heading_median0.4662935751765816
deviation-heading_min0.3138996563005005
driven_any_max2.1937495917222662
driven_any_mean1.101203967779493
driven_any_median1.072953759306336
driven_any_min0.3121624499492532
driven_lanedir_consec_max1.8128454170816104
driven_lanedir_consec_mean0.8194262040404128
driven_lanedir_consec_min0.29255031695938905
driven_lanedir_max1.8128454170816104
driven_lanedir_mean0.8194262040404128
driven_lanedir_median0.630782078032722
driven_lanedir_min0.29255031695938905
in-drivable-lane_max1.0499999999999965
in-drivable-lane_mean0.4999999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.4650912640796612, "sim_physics": 0.028308444552951388, "survival_time": 3.599999999999995, "driven_lanedir": 0.9279625761376364, "sim_render-ego": 0.055013676484425865, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.13615774114926657, "deviation-heading": 0.626786666223299, "set_robot_commands": 0.0747376216782464, "deviation-center-line": 0.24274593434117447, "driven_lanedir_consec": 0.9279625761376364, "sim_compute_sim_state": 0.03246772620413038, "sim_compute_performance-ego": 0.05734368827607897, "sim_compute_robot_state-ego": 0.0578535430961185, "sim_compute_robot_state-npc0": 0.06326954232321845, "sim_compute_robot_state-npc1": 0.05936732888221741, "sim_compute_robot_state-npc2": 0.056814491748809814, "sim_compute_robot_state-npc3": 0.057790928416781955}, "udem1-1-0": {"driven_any": 0.46206277383994854, "sim_physics": 0.025950829188028973, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4329906319907062, "sim_render-ego": 0.058877256181504994, "in-drivable-lane": 0, "agent_compute-ego": 0.13432445349516692, "deviation-heading": 0.4662935751765816, "set_robot_commands": 0.07609537795737938, "deviation-center-line": 0.09391921424095308, "driven_lanedir_consec": 0.4329906319907062, "sim_compute_sim_state": 0.03479305903116862, "sim_compute_performance-ego": 0.06372461495576082, "sim_compute_robot_state-ego": 0.05947549254805953, "sim_compute_robot_state-npc0": 0.06402115468625669, "sim_compute_robot_state-npc1": 0.06089176072014703, "sim_compute_robot_state-npc2": 0.05974543536150897, "sim_compute_robot_state-npc3": 0.06373633278740777}, "udem1-2-0": {"driven_any": 2.1937495917222662, "sim_physics": 0.027817721505766932, "survival_time": 5.14999999999999, "driven_lanedir": 1.8128454170816104, "sim_render-ego": 0.058762265640555075, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.13562874655121737, "deviation-heading": 0.9510803390140998, "set_robot_commands": 0.07571619228251929, "deviation-center-line": 0.21341725210581003, "driven_lanedir_consec": 1.8128454170816104, "sim_compute_sim_state": 0.033398679159219985, "sim_compute_performance-ego": 0.05975827198584103, "sim_compute_robot_state-ego": 0.05948422950448342, "sim_compute_robot_state-npc0": 0.0651864519397032, "sim_compute_robot_state-npc1": 0.06119574852360105, "sim_compute_robot_state-npc2": 0.05970198668322517, "sim_compute_robot_state-npc3": 0.06060180386293282}, "udem1-3-0": {"driven_any": 1.072953759306336, "sim_physics": 0.03114795684814453, "survival_time": 2.6499999999999986, "driven_lanedir": 0.630782078032722, "sim_render-ego": 0.06495135235336591, "in-drivable-lane": 0.8999999999999977, "agent_compute-ego": 0.15114526478749402, "deviation-heading": 0.34431064951341206, "set_robot_commands": 0.079897219280027, "deviation-center-line": 0.10342694179960472, "driven_lanedir_consec": 0.630782078032722, "sim_compute_sim_state": 0.03772405408463388, "sim_compute_performance-ego": 0.06959912462054559, "sim_compute_robot_state-ego": 0.06285055178516316, "sim_compute_robot_state-npc0": 0.0747852235470178, "sim_compute_robot_state-npc1": 0.07067674510883835, "sim_compute_robot_state-npc2": 0.06939680621309101, "sim_compute_robot_state-npc3": 0.06847329859463673}, "udem1-4-0": {"driven_any": 0.3121624499492532, "sim_physics": 0.026031858042666788, "survival_time": 0.9500000000000004, "driven_lanedir": 0.29255031695938905, "sim_render-ego": 0.056798269874171206, "in-drivable-lane": 0, "agent_compute-ego": 0.14175369865015933, "deviation-heading": 0.3138996563005005, "set_robot_commands": 0.07278202709398772, "deviation-center-line": 0.05838775199208855, "driven_lanedir_consec": 0.29255031695938905, "sim_compute_sim_state": 0.033537601169786956, "sim_compute_performance-ego": 0.05934080324674908, "sim_compute_robot_state-ego": 0.05924060470179507, "sim_compute_robot_state-npc0": 0.06584430995740388, "sim_compute_robot_state-npc1": 0.06110951774998715, "sim_compute_robot_state-npc2": 0.06086261648880808, "sim_compute_robot_state-npc3": 0.0593411922454834}}
set_robot_commands_max0.079897219280027
set_robot_commands_mean0.07584568765843196
set_robot_commands_median0.07571619228251929
set_robot_commands_min0.07278202709398772
sim_compute_performance-ego_max0.06959912462054559
sim_compute_performance-ego_mean0.06195330061699509
sim_compute_performance-ego_median0.05975827198584103
sim_compute_performance-ego_min0.05734368827607897
sim_compute_robot_state-ego_max0.06285055178516316
sim_compute_robot_state-ego_mean0.05978088432712394
sim_compute_robot_state-ego_median0.05947549254805953
sim_compute_robot_state-ego_min0.0578535430961185
sim_compute_robot_state-npc0_max0.0747852235470178
sim_compute_robot_state-npc0_mean0.06662133649072
sim_compute_robot_state-npc0_median0.0651864519397032
sim_compute_robot_state-npc0_min0.06326954232321845
sim_compute_robot_state-npc1_max0.07067674510883835
sim_compute_robot_state-npc1_mean0.06264822019695819
sim_compute_robot_state-npc1_median0.06110951774998715
sim_compute_robot_state-npc1_min0.05936732888221741
sim_compute_robot_state-npc2_max0.06939680621309101
sim_compute_robot_state-npc2_mean0.06130426729908861
sim_compute_robot_state-npc2_median0.05974543536150897
sim_compute_robot_state-npc2_min0.056814491748809814
sim_compute_robot_state-npc3_max0.06847329859463673
sim_compute_robot_state-npc3_mean0.06198871118144853
sim_compute_robot_state-npc3_median0.06060180386293282
sim_compute_robot_state-npc3_min0.057790928416781955
sim_compute_sim_state_max0.03772405408463388
sim_compute_sim_state_mean0.03438422392978797
sim_compute_sim_state_median0.033537601169786956
sim_compute_sim_state_min0.03246772620413038
sim_physics_max0.03114795684814453
sim_physics_mean0.027851362027511723
sim_physics_median0.027817721505766932
sim_physics_min0.025950829188028973
sim_render-ego_max0.06495135235336591
sim_render-ego_mean0.05888056410680461
sim_render-ego_median0.058762265640555075
sim_render-ego_min0.055013676484425865
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.739999999999997
survival_time_min0.9500000000000004
No reset possible
197652738Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationfailednoidsc-rudolf-332460:01:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
197412812Andrea Censi 🇨🇭challenge-aido_LF-template-random - random_agentaido2-LFVI-sim-testingstep1-simulationsuccessnoidsc-rudolf-332460:06:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.630782078032722
survival_time_median2.6499999999999986
deviation-center-line_median0.10342694179960472
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.1450802608601098
agent_compute-ego_mean0.13917801208434477
agent_compute-ego_median0.14022362232208252
agent_compute-ego_min0.12825546441254793
deviation-center-line_max0.24274593434117447
deviation-center-line_mean0.1423794188959262
deviation-center-line_min0.05838775199208855
deviation-heading_max0.9510803390140998
deviation-heading_mean0.5404741772455786
deviation-heading_median0.4662935751765816
deviation-heading_min0.3138996563005005
driven_any_max2.1937495917222662
driven_any_mean1.101203967779493
driven_any_median1.072953759306336
driven_any_min0.3121624499492532
driven_lanedir_consec_max1.8128454170816104
driven_lanedir_consec_mean0.8194262040404128
driven_lanedir_consec_min0.29255031695938905
driven_lanedir_max1.8128454170816104
driven_lanedir_mean0.8194262040404128
driven_lanedir_median0.630782078032722
driven_lanedir_min0.29255031695938905
in-drivable-lane_max1.0499999999999965
in-drivable-lane_mean0.4999999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.4650912640796612, "sim_physics": 0.030597743060853742, "survival_time": 3.599999999999995, "driven_lanedir": 0.9279625761376364, "sim_render-ego": 0.06025903092490302, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.14022362232208252, "deviation-heading": 0.626786666223299, "set_robot_commands": 0.07595055964257982, "deviation-center-line": 0.24274593434117447, "driven_lanedir_consec": 0.9279625761376364, "sim_compute_sim_state": 0.034972555107540555, "sim_compute_performance-ego": 0.06141610278023614, "sim_compute_robot_state-ego": 0.06132174531618754, "sim_compute_robot_state-npc0": 0.06809276673528883, "sim_compute_robot_state-npc1": 0.0618470741642846, "sim_compute_robot_state-npc2": 0.060876968834135264, "sim_compute_robot_state-npc3": 0.06254673666424221}, "udem1-1-0": {"driven_any": 0.46206277383994854, "sim_physics": 0.02667938338385688, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4329906319907062, "sim_render-ego": 0.0552418761783176, "in-drivable-lane": 0, "agent_compute-ego": 0.12825546441254793, "deviation-heading": 0.4662935751765816, "set_robot_commands": 0.0734138841982241, "deviation-center-line": 0.09391921424095308, "driven_lanedir_consec": 0.4329906319907062, "sim_compute_sim_state": 0.03685825842398184, "sim_compute_performance-ego": 0.059030082490709096, "sim_compute_robot_state-ego": 0.0597659393593117, "sim_compute_robot_state-npc0": 0.07185859150356716, "sim_compute_robot_state-npc1": 0.06484429041544597, "sim_compute_robot_state-npc2": 0.06341024681373879, "sim_compute_robot_state-npc3": 0.06478121545579699}, "udem1-2-0": {"driven_any": 2.1937495917222662, "sim_physics": 0.028160046605230533, "survival_time": 5.14999999999999, "driven_lanedir": 1.8128454170816104, "sim_render-ego": 0.06099356030954898, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1450802608601098, "deviation-heading": 0.9510803390140998, "set_robot_commands": 0.07888521500004148, "deviation-center-line": 0.21341725210581003, "driven_lanedir_consec": 1.8128454170816104, "sim_compute_sim_state": 0.0352782184637866, "sim_compute_performance-ego": 0.061290234037973346, "sim_compute_robot_state-ego": 0.06054500237251948, "sim_compute_robot_state-npc0": 0.0703089190918265, "sim_compute_robot_state-npc1": 0.06423728905835198, "sim_compute_robot_state-npc2": 0.06183774494430394, "sim_compute_robot_state-npc3": 0.06231366546408644}, "udem1-3-0": {"driven_any": 1.072953759306336, "sim_physics": 0.028749825819483345, "survival_time": 2.6499999999999986, "driven_lanedir": 0.630782078032722, "sim_render-ego": 0.05890901583545613, "in-drivable-lane": 0.8999999999999977, "agent_compute-ego": 0.14440296730905208, "deviation-heading": 0.34431064951341206, "set_robot_commands": 0.07459864526424768, "deviation-center-line": 0.10342694179960472, "driven_lanedir_consec": 0.630782078032722, "sim_compute_sim_state": 0.03516151320259526, "sim_compute_performance-ego": 0.06536402792300817, "sim_compute_robot_state-ego": 0.05987291965844496, "sim_compute_robot_state-npc0": 0.06914793320421903, "sim_compute_robot_state-npc1": 0.06275238181060215, "sim_compute_robot_state-npc2": 0.06115642583595132, "sim_compute_robot_state-npc3": 0.06420688809088941}, "udem1-4-0": {"driven_any": 0.3121624499492532, "sim_physics": 0.026812766727648284, "survival_time": 0.9500000000000004, "driven_lanedir": 0.29255031695938905, "sim_render-ego": 0.055312671159443105, "in-drivable-lane": 0, "agent_compute-ego": 0.1379277455179315, "deviation-heading": 0.3138996563005005, "set_robot_commands": 0.07576574777301989, "deviation-center-line": 0.05838775199208855, "driven_lanedir_consec": 0.29255031695938905, "sim_compute_sim_state": 0.03606422323929636, "sim_compute_performance-ego": 0.06105493244371916, "sim_compute_robot_state-ego": 0.05922082850807592, "sim_compute_robot_state-npc0": 0.06839861367878161, "sim_compute_robot_state-npc1": 0.06278986679880243, "sim_compute_robot_state-npc2": 0.061834749422575296, "sim_compute_robot_state-npc3": 0.06223005997507196}}
set_robot_commands_max0.07888521500004148
set_robot_commands_mean0.0757228103756226
set_robot_commands_median0.07576574777301989
set_robot_commands_min0.0734138841982241
sim_compute_performance-ego_max0.06536402792300817
sim_compute_performance-ego_mean0.06163107593512919
sim_compute_performance-ego_median0.061290234037973346
sim_compute_performance-ego_min0.059030082490709096
sim_compute_robot_state-ego_max0.06132174531618754
sim_compute_robot_state-ego_mean0.06014528704290791
sim_compute_robot_state-ego_median0.05987291965844496
sim_compute_robot_state-ego_min0.05922082850807592
sim_compute_robot_state-npc0_max0.07185859150356716
sim_compute_robot_state-npc0_mean0.06956136484273663
sim_compute_robot_state-npc0_median0.06914793320421903
sim_compute_robot_state-npc0_min0.06809276673528883
sim_compute_robot_state-npc1_max0.06484429041544597
sim_compute_robot_state-npc1_mean0.06329418044949743
sim_compute_robot_state-npc1_median0.06278986679880243
sim_compute_robot_state-npc1_min0.0618470741642846
sim_compute_robot_state-npc2_max0.06341024681373879
sim_compute_robot_state-npc2_mean0.06182322717014092
sim_compute_robot_state-npc2_median0.061834749422575296
sim_compute_robot_state-npc2_min0.060876968834135264
sim_compute_robot_state-npc3_max0.06478121545579699
sim_compute_robot_state-npc3_mean0.0632157131300174
sim_compute_robot_state-npc3_median0.06254673666424221
sim_compute_robot_state-npc3_min0.06223005997507196
sim_compute_sim_state_max0.03685825842398184
sim_compute_sim_state_mean0.03566695368744012
sim_compute_sim_state_median0.0352782184637866
sim_compute_sim_state_min0.034972555107540555
sim_physics_max0.030597743060853742
sim_physics_mean0.02819995311941456
sim_physics_median0.028160046605230533
sim_physics_min0.02667938338385688
sim_render-ego_max0.06099356030954898
sim_render-ego_mean0.05814323088153377
sim_render-ego_median0.05890901583545613
sim_render-ego_min0.0552418761783176
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.739999999999997
survival_time_min0.9500000000000004
No reset possible
197303046Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LFV-sim-testingstep1-simulationerrornoidsc-rudolf-332460:00:38
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
197223039Manfred Diazchallenge-aido_LF-template-pytorchaido2-LFVI-sim-validationstep1-simulationerrornoidsc-rudolf-332460:00:38
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
197083019Manfred Diazchallenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationerrornoidsc-rudolf-332460:00:42
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
196952999Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LFV-sim-validationstep1-simulationerrornoidsc-rudolf-332460:02:19
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
196732369Liam Paull 🇨🇦minimal_agent (Python 3)aido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-332460:11:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.225306900765771
survival_time_median10.750000000000018
deviation-center-line_median0.40864173779456053
in-drivable-lane_median1.7000000000000242


other stats
agent_compute-ego_max0.142839252948761
agent_compute-ego_mean0.13622266034823372
agent_compute-ego_median0.13585373532077122
agent_compute-ego_min0.13137908051483824
deviation-center-line_max0.6491801892887803
deviation-center-line_mean0.3683230725655418
deviation-center-line_min0.1475671628461062
deviation-heading_max2.2060076411946548
deviation-heading_mean1.4163758252990906
deviation-heading_median1.5250264276913703
deviation-heading_min0.6970592634293067
driven_any_max1.6057043265958648
driven_any_mean1.3484469345214642
driven_any_median1.5756972277649912
driven_any_min0.9900494571900692
driven_lanedir_consec_max1.4904214722299334
driven_lanedir_consec_mean1.0721437270256324
driven_lanedir_consec_min0.6474115509746436
driven_lanedir_max1.4904214722299334
driven_lanedir_mean1.0721437270256324
driven_lanedir_median1.225306900765771
driven_lanedir_min0.6474115509746436
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean1.4300000000000082
in-drivable-lane_min0.25000000000000355
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.993745776226499, "sim_physics": 0.016528687031149007, "survival_time": 6.949999999999983, "driven_lanedir": 0.6474115509746436, "sim_render-ego": 0.05586245077119457, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.13473530638989784, "deviation-heading": 0.8273534093107037, "set_robot_commands": 0.0740783917818138, "deviation-center-line": 0.1475671628461062, "driven_lanedir_consec": 0.6474115509746436, "sim_compute_sim_state": 0.036624112575174235, "sim_compute_performance-ego": 0.059183199628651574, "sim_compute_robot_state-ego": 0.06257833851327141}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9900494571900692, "sim_physics": 0.016362369495586757, "survival_time": 6.849999999999984, "driven_lanedir": 0.764431461654983, "sim_render-ego": 0.05535648513014299, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.13137908051483824, "deviation-heading": 0.6970592634293067, "set_robot_commands": 0.07564102124123678, "deviation-center-line": 0.21999312889725264, "driven_lanedir_consec": 0.764431461654983, "sim_compute_sim_state": 0.037275568412168184, "sim_compute_performance-ego": 0.06069723358989632, "sim_compute_robot_state-ego": 0.06114056510646848}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6057043265958648, "sim_physics": 0.015906713468611507, "survival_time": 11.150000000000023, "driven_lanedir": 1.4904214722299334, "sim_render-ego": 0.0569964770244376, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.13585373532077122, "deviation-heading": 2.2060076411946548, "set_robot_commands": 0.07473794654880404, "deviation-center-line": 0.6491801892887803, "driven_lanedir_consec": 1.4904214722299334, "sim_compute_sim_state": 0.03860053994730449, "sim_compute_performance-ego": 0.06085798879375373, "sim_compute_robot_state-ego": 0.06287404667636204}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5770378848298965, "sim_physics": 0.016621382291926893, "survival_time": 10.750000000000018, "driven_lanedir": 1.225306900765771, "sim_render-ego": 0.057171859297641486, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.13630592656690022, "deviation-heading": 1.8264323848694184, "set_robot_commands": 0.07612832867821982, "deviation-center-line": 0.40864173779456053, "driven_lanedir_consec": 1.225306900765771, "sim_compute_sim_state": 0.03967019347257392, "sim_compute_performance-ego": 0.06293664089469023, "sim_compute_robot_state-ego": 0.06490368732186251}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5756972277649912, "sim_physics": 0.016357932929639465, "survival_time": 10.800000000000018, "driven_lanedir": 1.233147249502831, "sim_render-ego": 0.0593922668033176, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.142839252948761, "deviation-heading": 1.5250264276913703, "set_robot_commands": 0.0763581637982969, "deviation-center-line": 0.4162331440010094, "driven_lanedir_consec": 1.233147249502831, "sim_compute_sim_state": 0.04095030272448504, "sim_compute_performance-ego": 0.06419146502459491, "sim_compute_robot_state-ego": 0.06567237222636188}}
set_robot_commands_max0.0763581637982969
set_robot_commands_mean0.07538877040967427
set_robot_commands_median0.07564102124123678
set_robot_commands_min0.0740783917818138
sim_compute_performance-ego_max0.06419146502459491
sim_compute_performance-ego_mean0.06157330558631735
sim_compute_performance-ego_median0.06085798879375373
sim_compute_performance-ego_min0.059183199628651574
sim_compute_robot_state-ego_max0.06567237222636188
sim_compute_robot_state-ego_mean0.06343380196886525
sim_compute_robot_state-ego_median0.06287404667636204
sim_compute_robot_state-ego_min0.06114056510646848
sim_compute_sim_state_max0.04095030272448504
sim_compute_sim_state_mean0.03862414342634118
sim_compute_sim_state_median0.03860053994730449
sim_compute_sim_state_min0.036624112575174235
sim_physics_max0.016621382291926893
sim_physics_mean0.01635541704338273
sim_physics_median0.016362369495586757
sim_physics_min0.015906713468611507
sim_render-ego_max0.0593922668033176
sim_render-ego_mean0.05695590780534685
sim_render-ego_median0.0569964770244376
sim_render-ego_min0.05535648513014299
simulation-passed1
survival_time_max11.150000000000023
survival_time_mean9.300000000000004
survival_time_min6.849999999999984
No reset possible
196302413jiang pengBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationsuccessnoidsc-rudolf-332460:33:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-1.3614573264245535
survival_time_median14.950000000000076
deviation-center-line_median1.0119696714086834
in-drivable-lane_median4.050000000000022


other stats
agent_compute-ego_max0.5954549074172973
agent_compute-ego_mean0.37777660179138184
agent_compute-ego_median0.33645135005315147
agent_compute-ego_min0.2879247800509135
deviation-center-line_max1.0119699909612991
deviation-center-line_mean1.0119697191394268
deviation-center-line_min1.0119693200897382
deviation-heading_max6.81542792438532
deviation-heading_mean6.815427924385318
deviation-heading_median6.815427924385318
deviation-heading_min6.815427924385317
driven_any_max4.390824152784938
driven_any_mean4.3908241527849325
driven_any_median4.3908241527849325
driven_any_min4.390824152784927
driven_lanedir_consec_max-1.361452200425545
driven_lanedir_consec_mean-1.3614579701548792
driven_lanedir_consec_min-1.3614641213545289
driven_lanedir_max-2.315814608416598
driven_lanedir_mean-2.3158170164441083
driven_lanedir_median-2.3158169926021728
driven_lanedir_min-2.315819376788188
in-drivable-lane_max4.050000000000022
in-drivable-lane_mean4.050000000000022
in-drivable-lane_min4.050000000000022
per-episodes
details{"udem1-0-0": {"driven_any": 4.390824152784927, "sim_physics": 0.03682499885559082, "survival_time": 14.950000000000076, "driven_lanedir": -2.315816992602138, "sim_render-ego": 0.05796148777008057, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.5954549074172973, "deviation-heading": 6.815427924385318, "set_robot_commands": 0.08343569119771321, "deviation-center-line": 1.0119693200897382, "driven_lanedir_consec": -1.361457326424502, "sim_compute_sim_state": 0.036085017522176105, "sim_compute_performance-ego": 0.063086097240448, "sim_compute_robot_state-ego": 0.0663538384437561, "sim_compute_robot_state-npc0": 0.06617480039596557, "sim_compute_robot_state-npc1": 0.06339077472686767, "sim_compute_robot_state-npc2": 0.062066729068756106, "sim_compute_robot_state-npc3": 0.06304520050684612}, "udem1-1-0": {"driven_any": 4.390824152784938, "sim_physics": 0.029602299531300863, "survival_time": 14.950000000000076, "driven_lanedir": -2.315814608416598, "sim_render-ego": 0.055731852054595944, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.3424364638328552, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.07708704074223836, "deviation-center-line": 1.0119699909612991, "driven_lanedir_consec": -1.361452200425545, "sim_compute_sim_state": 0.03388276735941569, "sim_compute_performance-ego": 0.058748443126678464, "sim_compute_robot_state-ego": 0.05959009329477946, "sim_compute_robot_state-npc0": 0.06407865524291992, "sim_compute_robot_state-npc1": 0.059642892678578696, "sim_compute_robot_state-npc2": 0.059108774662017825, "sim_compute_robot_state-npc3": 0.05963360150655111}, "udem1-2-0": {"driven_any": 4.390824152784927, "sim_physics": 0.029423399766286214, "survival_time": 14.950000000000076, "driven_lanedir": -2.315819376788188, "sim_render-ego": 0.054352144400278725, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.32661550760269165, "deviation-heading": 6.815427924385317, "set_robot_commands": 0.07512371937433879, "deviation-center-line": 1.0119699909612945, "driven_lanedir_consec": -1.3614641213545289, "sim_compute_sim_state": 0.033070571422576904, "sim_compute_performance-ego": 0.058502033551534015, "sim_compute_robot_state-ego": 0.05999716599782308, "sim_compute_robot_state-npc0": 0.06324790000915527, "sim_compute_robot_state-npc1": 0.06063417673110962, "sim_compute_robot_state-npc2": 0.05958703835805257, "sim_compute_robot_state-npc3": 0.05999994913736979}, "udem1-3-0": {"driven_any": 4.3908241527849325, "sim_physics": 0.029370884895324707, "survival_time": 14.950000000000076, "driven_lanedir": -2.3158169926021728, "sim_render-ego": 0.05579089879989624, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.33645135005315147, "deviation-heading": 6.81542792438532, "set_robot_commands": 0.07605928421020508, "deviation-center-line": 1.0119696714086834, "driven_lanedir_consec": -1.3614573264245535, "sim_compute_sim_state": 0.033592976729075116, "sim_compute_performance-ego": 0.059514792760213216, "sim_compute_robot_state-ego": 0.06211841901143392, "sim_compute_robot_state-npc0": 0.06309885660807292, "sim_compute_robot_state-npc1": 0.05998828570048014, "sim_compute_robot_state-npc2": 0.0581760557492574, "sim_compute_robot_state-npc3": 0.05924548784891765}, "udem1-4-0": {"driven_any": 4.390824152784936, "sim_physics": 0.02741037607192993, "survival_time": 14.950000000000076, "driven_lanedir": -2.3158171118114455, "sim_render-ego": 0.055860225359598795, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.2879247800509135, "deviation-heading": 6.815427924385317, "set_robot_commands": 0.0751665465037028, "deviation-center-line": 1.0119696222761183, "driven_lanedir_consec": -1.3614588761452664, "sim_compute_sim_state": 0.03361968199412028, "sim_compute_performance-ego": 0.059235560894012454, "sim_compute_robot_state-ego": 0.059108924865722653, "sim_compute_robot_state-npc0": 0.06447351137797037, "sim_compute_robot_state-npc1": 0.060101466178894045, "sim_compute_robot_state-npc2": 0.0596777089436849, "sim_compute_robot_state-npc3": 0.05977907021840413}}
set_robot_commands_max0.08343569119771321
set_robot_commands_mean0.07737445640563964
set_robot_commands_median0.07605928421020508
set_robot_commands_min0.07512371937433879
sim_compute_performance-ego_max0.063086097240448
sim_compute_performance-ego_mean0.05981738551457723
sim_compute_performance-ego_median0.059235560894012454
sim_compute_performance-ego_min0.058502033551534015
sim_compute_robot_state-ego_max0.0663538384437561
sim_compute_robot_state-ego_mean0.06143368832270304
sim_compute_robot_state-ego_median0.05999716599782308
sim_compute_robot_state-ego_min0.059108924865722653
sim_compute_robot_state-npc0_max0.06617480039596557
sim_compute_robot_state-npc0_mean0.0642147447268168
sim_compute_robot_state-npc0_median0.06407865524291992
sim_compute_robot_state-npc0_min0.06309885660807292
sim_compute_robot_state-npc1_max0.06339077472686767
sim_compute_robot_state-npc1_mean0.060751519203186034
sim_compute_robot_state-npc1_median0.060101466178894045
sim_compute_robot_state-npc1_min0.059642892678578696
sim_compute_robot_state-npc2_max0.062066729068756106
sim_compute_robot_state-npc2_mean0.059723261356353766
sim_compute_robot_state-npc2_median0.05958703835805257
sim_compute_robot_state-npc2_min0.0581760557492574
sim_compute_robot_state-npc3_max0.06304520050684612
sim_compute_robot_state-npc3_mean0.06034066184361776
sim_compute_robot_state-npc3_median0.05977907021840413
sim_compute_robot_state-npc3_min0.05924548784891765
sim_compute_sim_state_max0.036085017522176105
sim_compute_sim_state_mean0.03405020300547282
sim_compute_sim_state_median0.03361968199412028
sim_compute_sim_state_min0.033070571422576904
sim_physics_max0.03682499885559082
sim_physics_mean0.030526391824086507
sim_physics_median0.029423399766286214
sim_physics_min0.02741037607192993
sim_render-ego_max0.05796148777008057
sim_render-ego_mean0.05593932167689005
sim_render-ego_median0.05579089879989624
sim_render-ego_min0.054352144400278725
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
195772495Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LFV-sim-testingstep1-simulationsuccessnoidsc-rudolf-332460:15:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.04880828996381803
survival_time_median1.6000000000000008
deviation-center-line_median0.02409580864467076
in-drivable-lane_median0.6500000000000005


other stats
agent_compute-ego_max0.7241345802942912
agent_compute-ego_mean0.5062842353673581
agent_compute-ego_median0.5265567779541016
agent_compute-ego_min0.2733384025552885
deviation-center-line_max0.6554598259562793
deviation-center-line_mean0.17425480447012384
deviation-center-line_min0.017905165971407382
deviation-heading_max5.670167677297847
deviation-heading_mean2.1476022416081184
deviation-heading_median0.5982832892133024
deviation-heading_min0.5151647649652875
driven_any_max1.7348342809811168
driven_any_mean0.63432246733355
driven_any_median0.15069498752406346
driven_any_min0.14304267025882522
driven_lanedir_consec_max0.5987111364969651
driven_lanedir_consec_mean0.21532915055868632
driven_lanedir_consec_min0.043895275273072354
driven_lanedir_max0.5987111364969651
driven_lanedir_mean0.21532915055868632
driven_lanedir_median0.04880828996381803
driven_lanedir_min0.043895275273072354
in-drivable-lane_max7.350000000000042
in-drivable-lane_mean2.6900000000000084
in-drivable-lane_min0.5000000000000004
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.1445396245023429, "sim_physics": 0.0539071798324585, "survival_time": 1.5000000000000009, "driven_lanedir": 0.04880828996381803, "sim_render-ego": 0.07742172876993815, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.7241345802942912, "deviation-heading": 0.5860698170276714, "set_robot_commands": 0.10265983740488688, "deviation-center-line": 0.02409580864467076, "driven_lanedir_consec": 0.04880828996381803, "sim_compute_sim_state": 0.04642435709635417, "sim_compute_performance-ego": 0.0819778839747111, "sim_compute_robot_state-ego": 0.08644642829895019, "sim_compute_robot_state-npc0": 0.08152352174123129, "sim_compute_robot_state-npc1": 0.08008261521657307, "sim_compute_robot_state-npc2": 0.08007870515187582, "sim_compute_robot_state-npc3": 0.08009171485900879}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.14304267025882522, "sim_physics": 0.053884685039520264, "survival_time": 1.6000000000000008, "driven_lanedir": 0.04627274106164192, "sim_render-ego": 0.07540065050125122, "in-drivable-lane": 0.6500000000000005, "agent_compute-ego": 0.7202081233263016, "deviation-heading": 0.5151647649652875, "set_robot_commands": 0.0976441726088524, "deviation-center-line": 0.017905165971407382, "driven_lanedir_consec": 0.04627274106164192, "sim_compute_sim_state": 0.04981505125761032, "sim_compute_performance-ego": 0.08190088719129562, "sim_compute_robot_state-ego": 0.08630355447530746, "sim_compute_robot_state-npc0": 0.07771892845630646, "sim_compute_robot_state-npc1": 0.07992468774318695, "sim_compute_robot_state-npc2": 0.07841034233570099, "sim_compute_robot_state-npc3": 0.08282067626714706}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.7348342809811168, "sim_physics": 0.03296011606852214, "survival_time": 14.950000000000076, "driven_lanedir": 0.5987111364969651, "sim_render-ego": 0.05929597536722819, "in-drivable-lane": 7.350000000000042, "agent_compute-ego": 0.5265567779541016, "deviation-heading": 5.670167677297847, "set_robot_commands": 0.0765505305926005, "deviation-center-line": 0.6554598259562793, "driven_lanedir_consec": 0.5987111364969651, "sim_compute_sim_state": 0.03668177843093872, "sim_compute_performance-ego": 0.06463789145151774, "sim_compute_robot_state-ego": 0.06778395573298136, "sim_compute_robot_state-npc0": 0.06634111801783243, "sim_compute_robot_state-npc1": 0.06429068088531494, "sim_compute_robot_state-npc2": 0.06331510305404663, "sim_compute_robot_state-npc3": 0.06296097040176392}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.15069498752406346, "sim_physics": 0.02774625619252523, "survival_time": 1.5000000000000009, "driven_lanedir": 0.043895275273072354, "sim_render-ego": 0.05714109738667806, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.2871832927068075, "deviation-heading": 0.5982832892133024, "set_robot_commands": 0.07037963072458903, "deviation-center-line": 0.0228194397414489, "driven_lanedir_consec": 0.043895275273072354, "sim_compute_sim_state": 0.034592596689860027, "sim_compute_performance-ego": 0.06194412708282471, "sim_compute_robot_state-ego": 0.06280388832092285, "sim_compute_robot_state-npc0": 0.06478198369344075, "sim_compute_robot_state-npc1": 0.05965320269266764, "sim_compute_robot_state-npc2": 0.06047190030415853, "sim_compute_robot_state-npc3": 0.06650589307149252}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.998500773401402, "sim_physics": 0.02503630242061094, "survival_time": 9.149999999999997, "driven_lanedir": 0.3389583099979342, "sim_render-ego": 0.05406307262149665, "in-drivable-lane": 4.449999999999999, "agent_compute-ego": 0.2733384025552885, "deviation-heading": 3.368325659536483, "set_robot_commands": 0.07492702906248999, "deviation-center-line": 0.15099378203681296, "driven_lanedir_consec": 0.3389583099979342, "sim_compute_sim_state": 0.03358068361959822, "sim_compute_performance-ego": 0.061262703984161546, "sim_compute_robot_state-ego": 0.06094827808317591, "sim_compute_robot_state-npc0": 0.0641779938682181, "sim_compute_robot_state-npc1": 0.0603519137439832, "sim_compute_robot_state-npc2": 0.059566061353422906, "sim_compute_robot_state-npc3": 0.06011886023432831}}
set_robot_commands_max0.10265983740488688
set_robot_commands_mean0.08443224007868375
set_robot_commands_median0.0765505305926005
set_robot_commands_min0.07037963072458903
sim_compute_performance-ego_max0.0819778839747111
sim_compute_performance-ego_mean0.07034469873690215
sim_compute_performance-ego_median0.06463789145151774
sim_compute_performance-ego_min0.061262703984161546
sim_compute_robot_state-ego_max0.08644642829895019
sim_compute_robot_state-ego_mean0.07285722098226757
sim_compute_robot_state-ego_median0.06778395573298136
sim_compute_robot_state-ego_min0.06094827808317591
sim_compute_robot_state-npc0_max0.08152352174123129
sim_compute_robot_state-npc0_mean0.0709087091554058
sim_compute_robot_state-npc0_median0.06634111801783243
sim_compute_robot_state-npc0_min0.0641779938682181
sim_compute_robot_state-npc1_max0.08008261521657307
sim_compute_robot_state-npc1_mean0.06886062005634516
sim_compute_robot_state-npc1_median0.06429068088531494
sim_compute_robot_state-npc1_min0.05965320269266764
sim_compute_robot_state-npc2_max0.08007870515187582
sim_compute_robot_state-npc2_mean0.06836842243984098
sim_compute_robot_state-npc2_median0.06331510305404663
sim_compute_robot_state-npc2_min0.059566061353422906
sim_compute_robot_state-npc3_max0.08282067626714706
sim_compute_robot_state-npc3_mean0.07049962296674812
sim_compute_robot_state-npc3_median0.06650589307149252
sim_compute_robot_state-npc3_min0.06011886023432831
sim_compute_sim_state_max0.04981505125761032
sim_compute_sim_state_mean0.04021889341887229
sim_compute_sim_state_median0.03668177843093872
sim_compute_sim_state_min0.03358068361959822
sim_physics_max0.0539071798324585
sim_physics_mean0.038706907910727416
sim_physics_median0.03296011606852214
sim_physics_min0.02503630242061094
sim_render-ego_max0.07742172876993815
sim_render-ego_mean0.06466450492931845
sim_render-ego_median0.05929597536722819
sim_render-ego_min0.05406307262149665
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean5.740000000000014
survival_time_min1.5000000000000009
No reset possible
195602506Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LFVI-sim-testingstep1-simulationerrornoidsc-rudolf-332460:00:58
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195452524Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerrornoidsc-rudolf-332460:01:47
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
195272548Andrea Censi 🇨🇭challenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-332460:04:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5487126868955534
survival_time_median2.3499999999999996
deviation-center-line_median0.11041377901227004
in-drivable-lane_median0


other stats
agent_compute-ego_max0.06443031838065699
agent_compute-ego_mean0.06230393330209083
agent_compute-ego_median0.0620167051873556
agent_compute-ego_min0.05993227644281073
deviation-center-line_max0.12791029264553877
deviation-center-line_mean0.10518143804729678
deviation-center-line_min0.06917252689874298
deviation-heading_max0.4712184191829178
deviation-heading_mean0.3828337640550056
deviation-heading_median0.3636820162885191
deviation-heading_min0.3257229985354382
driven_any_max1.259664216011687
driven_any_mean0.7702827269903463
driven_any_median0.6642785413158997
driven_any_min0.3059207793076624
driven_lanedir_consec_max0.9402632878459154
driven_lanedir_consec_mean0.5880385612453785
driven_lanedir_consec_min0.2802213062291129
driven_lanedir_max0.9402632878459154
driven_lanedir_mean0.5880385612453785
driven_lanedir_median0.5487126868955534
driven_lanedir_min0.2802213062291129
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.559999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.017903482041707854, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.05841532276897896, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.0620167051873556, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.0735974660733851, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.03907519433556533, "sim_compute_performance-ego": 0.06179415598148253, "sim_compute_robot_state-ego": 0.06283330045095305}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.015322144214923564, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.055759585820711575, "in-drivable-lane": 0, "agent_compute-ego": 0.0631408324608436, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.07548999786376953, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.035924663910498984, "sim_compute_performance-ego": 0.05960659797375019, "sim_compute_robot_state-ego": 0.0613555724804218}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.01650640812325985, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.05522303885601936, "in-drivable-lane": 0, "agent_compute-ego": 0.06199953403878719, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.0736330417876548, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.03645266370570406, "sim_compute_performance-ego": 0.05884910644368922, "sim_compute_robot_state-ego": 0.06316795754939952}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.018564842559479097, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.05543258425953624, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.05993227644281073, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.07418443868448446, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03830533499246115, "sim_compute_performance-ego": 0.06044812254853301, "sim_compute_robot_state-ego": 0.0613376517872234}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.016152212494298032, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.05446322340714304, "in-drivable-lane": 0, "agent_compute-ego": 0.06443031838065699, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.07355687492772152, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.03734220956501208, "sim_compute_performance-ego": 0.06231139208141126, "sim_compute_robot_state-ego": 0.061698091657538166}}
set_robot_commands_max0.07548999786376953
set_robot_commands_mean0.07409236386740309
set_robot_commands_median0.0736330417876548
set_robot_commands_min0.07355687492772152
sim_compute_performance-ego_max0.06231139208141126
sim_compute_performance-ego_mean0.06060187500577324
sim_compute_performance-ego_median0.06044812254853301
sim_compute_performance-ego_min0.05884910644368922
sim_compute_robot_state-ego_max0.06316795754939952
sim_compute_robot_state-ego_mean0.06207851478510719
sim_compute_robot_state-ego_median0.061698091657538166
sim_compute_robot_state-ego_min0.0613376517872234
sim_compute_sim_state_max0.03907519433556533
sim_compute_sim_state_mean0.03742001330184832
sim_compute_sim_state_median0.03734220956501208
sim_compute_sim_state_min0.035924663910498984
sim_physics_max0.018564842559479097
sim_physics_mean0.01688981788673368
sim_physics_median0.01650640812325985
sim_physics_min0.015322144214923564
sim_render-ego_max0.05841532276897896
sim_render-ego_mean0.05585875102247784
sim_render-ego_median0.05543258425953624
sim_render-ego_min0.05446322340714304
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean2.839999999999997
survival_time_min1.3000000000000005
No reset possible
195142565Alexander Karavaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-validationstep1-simulationsuccessnoidsc-rudolf-332460:06:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5487132829419987
survival_time_median2.3499999999999996
deviation-center-line_median0.11041400208354252
in-drivable-lane_median0


other stats
agent_compute-ego_max0.06666081830074913
agent_compute-ego_mean0.06184137250552703
agent_compute-ego_median0.06115685625279203
agent_compute-ego_min0.05771149121798002
deviation-center-line_max0.1279102488429998
deviation-center-line_mean0.10518151035257096
deviation-center-line_min0.06917270915638028
deviation-heading_max0.4712184191829178
deviation-heading_mean0.3828337640550057
deviation-heading_median0.36368201628851926
deviation-heading_min0.3257229985354382
driven_any_max1.259664216011687
driven_any_mean0.7702827269903464
driven_any_median0.6642785413159032
driven_any_min0.3059207793076613
driven_lanedir_consec_max0.9402632878459154
driven_lanedir_consec_mean0.588039443394122
driven_lanedir_consec_min0.28022225990343186
driven_lanedir_max0.9402632878459154
driven_lanedir_mean0.588039443394122
driven_lanedir_median0.5487132829419987
driven_lanedir_min0.28022225990343186
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.559999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.02729172532151385, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.05424720485035966, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.060995369422726514, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.07491610980615383, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.034685120349977075, "sim_compute_performance-ego": 0.05911740442601646, "sim_compute_robot_state-ego": 0.061041698223207055, "sim_compute_robot_state-npc0": 0.0637873789159263, "sim_compute_robot_state-npc1": 0.060722947120666504, "sim_compute_robot_state-npc2": 0.05925416655656768, "sim_compute_robot_state-npc3": 0.06133530779582698}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076613, "sim_physics": 0.02468272355886606, "survival_time": 1.3000000000000005, "driven_lanedir": 0.28022225990343186, "sim_render-ego": 0.05201885333428016, "in-drivable-lane": 0, "agent_compute-ego": 0.05771149121798002, "deviation-heading": 0.36368201628851926, "set_robot_commands": 0.06857059552119328, "deviation-center-line": 0.06917270915638028, "driven_lanedir_consec": 0.28022225990343186, "sim_compute_sim_state": 0.035081716684194714, "sim_compute_performance-ego": 0.06080863109001747, "sim_compute_robot_state-ego": 0.06652569770812988, "sim_compute_robot_state-npc0": 0.06898376574883094, "sim_compute_robot_state-npc1": 0.06442259825192966, "sim_compute_robot_state-npc2": 0.0610578518647414, "sim_compute_robot_state-npc3": 0.06366718732393704}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413159032, "sim_physics": 0.0268709456666987, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504171082047745, "sim_render-ego": 0.05671046135273385, "in-drivable-lane": 0, "agent_compute-ego": 0.06115685625279203, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.07355370927364269, "deviation-center-line": 0.1279102488429998, "driven_lanedir_consec": 0.6504171082047745, "sim_compute_sim_state": 0.03560137748718262, "sim_compute_performance-ego": 0.0593151792566827, "sim_compute_robot_state-ego": 0.06139766916315606, "sim_compute_robot_state-npc0": 0.06457353652791774, "sim_compute_robot_state-npc1": 0.06025339694733315, "sim_compute_robot_state-npc2": 0.06056536004898396, "sim_compute_robot_state-npc3": 0.060844999678591465}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.02792210893316583, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.05694664441622221, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06268232733338744, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.07339600940327068, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03514576220250392, "sim_compute_performance-ego": 0.06154744703691084, "sim_compute_robot_state-ego": 0.061170758781852304, "sim_compute_robot_state-npc0": 0.06701771505586393, "sim_compute_robot_state-npc1": 0.06264305114746094, "sim_compute_robot_state-npc2": 0.061759621232420535, "sim_compute_robot_state-npc3": 0.061217116785573435}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355635, "sim_physics": 0.024392711488824145, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487132829419987, "sim_render-ego": 0.055651583169635976, "in-drivable-lane": 0, "agent_compute-ego": 0.06666081830074913, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.07345608661049291, "deviation-center-line": 0.11041400208354252, "driven_lanedir_consec": 0.5487132829419987, "sim_compute_sim_state": 0.03579726344660709, "sim_compute_performance-ego": 0.061348601391440945, "sim_compute_robot_state-ego": 0.06658480669322767, "sim_compute_robot_state-npc0": 0.06971230004963122, "sim_compute_robot_state-npc1": 0.06507023384696559, "sim_compute_robot_state-npc2": 0.06485022369183992, "sim_compute_robot_state-npc3": 0.06231684433786493}}
set_robot_commands_max0.07491610980615383
set_robot_commands_mean0.07277850212295069
set_robot_commands_median0.07345608661049291
set_robot_commands_min0.06857059552119328
sim_compute_performance-ego_max0.06154744703691084
sim_compute_performance-ego_mean0.06042745264021369
sim_compute_performance-ego_median0.06080863109001747
sim_compute_performance-ego_min0.05911740442601646
sim_compute_robot_state-ego_max0.06658480669322767
sim_compute_robot_state-ego_mean0.0633441261139146
sim_compute_robot_state-ego_median0.06139766916315606
sim_compute_robot_state-ego_min0.061041698223207055
sim_compute_robot_state-npc0_max0.06971230004963122
sim_compute_robot_state-npc0_mean0.06681493925963404
sim_compute_robot_state-npc0_median0.06701771505586393
sim_compute_robot_state-npc0_min0.0637873789159263
sim_compute_robot_state-npc1_max0.06507023384696559
sim_compute_robot_state-npc1_mean0.06262244546287117
sim_compute_robot_state-npc1_median0.06264305114746094
sim_compute_robot_state-npc1_min0.06025339694733315
sim_compute_robot_state-npc2_max0.06485022369183992
sim_compute_robot_state-npc2_mean0.0614974446789107
sim_compute_robot_state-npc2_median0.0610578518647414
sim_compute_robot_state-npc2_min0.05925416655656768
sim_compute_robot_state-npc3_max0.06366718732393704
sim_compute_robot_state-npc3_mean0.06187629118435877
sim_compute_robot_state-npc3_median0.06133530779582698
sim_compute_robot_state-npc3_min0.060844999678591465
sim_compute_sim_state_max0.03579726344660709
sim_compute_sim_state_mean0.03526224803409308
sim_compute_sim_state_median0.03514576220250392
sim_compute_sim_state_min0.034685120349977075
sim_physics_max0.02792210893316583
sim_physics_mean0.02623204299381372
sim_physics_median0.0268709456666987
sim_physics_min0.024392711488824145
sim_render-ego_max0.05694664441622221
sim_render-ego_mean0.05511494942464638
sim_render-ego_median0.055651583169635976
sim_render-ego_min0.05201885333428016
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean2.839999999999997
survival_time_min1.3000000000000005
No reset possible
195042583Liam Paull 🇨🇦challenge-aido_LF-template-rosaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-332460:05:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5487126868955534
survival_time_median2.3499999999999996
deviation-center-line_median0.11041377901227004
in-drivable-lane_median0


other stats
agent_compute-ego_max0.06787268658901782
agent_compute-ego_mean0.06185515186679065
agent_compute-ego_median0.06089817298637642
agent_compute-ego_min0.05794070317195012
deviation-center-line_max0.12791029264553877
deviation-center-line_mean0.10518143804729678
deviation-center-line_min0.06917252689874298
deviation-heading_max0.4712184191829178
deviation-heading_mean0.3828337640550056
deviation-heading_median0.3636820162885191
deviation-heading_min0.3257229985354382
driven_any_max1.259664216011687
driven_any_mean0.7702827269903463
driven_any_median0.6642785413158997
driven_any_min0.3059207793076624
driven_lanedir_consec_max0.9402632878459154
driven_lanedir_consec_mean0.5880385612453785
driven_lanedir_consec_min0.2802213062291129
driven_lanedir_max0.9402632878459154
driven_lanedir_mean0.5880385612453785
driven_lanedir_median0.5487126868955534
driven_lanedir_min0.2802213062291129
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.559999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.024527177578065457, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.057783766490657154, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.06302535533905029, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.0765321341956534, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.037707302628493894, "sim_compute_performance-ego": 0.0624209991315516, "sim_compute_robot_state-ego": 0.06622519725706519}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.01790291529435378, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.052439286158635065, "in-drivable-lane": 0, "agent_compute-ego": 0.05794070317195012, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.07589452083294208, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.03593211907606859, "sim_compute_performance-ego": 0.05767620526827299, "sim_compute_robot_state-ego": 0.061557650566101074}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.020024284403374858, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.05740643054880994, "in-drivable-lane": 0, "agent_compute-ego": 0.06787268658901782, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.07664596273543987, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.03692350996301529, "sim_compute_performance-ego": 0.06553314087238718, "sim_compute_robot_state-ego": 0.06165768237824135}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.019861506891774607, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.05163554568867107, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06089817298637642, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.07221666273179946, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.03544267717298571, "sim_compute_performance-ego": 0.057704419880122926, "sim_compute_robot_state-ego": 0.06086002339373578}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.017881123643172413, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.05460455543116519, "in-drivable-lane": 0, "agent_compute-ego": 0.059538841247558594, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.07226304631484182, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.03557899123743961, "sim_compute_performance-ego": 0.05795547209287945, "sim_compute_robot_state-ego": 0.05929119335977655}}
set_robot_commands_max0.07664596273543987
set_robot_commands_mean0.07471046536213533
set_robot_commands_median0.07589452083294208
set_robot_commands_min0.07221666273179946
sim_compute_performance-ego_max0.06553314087238718
sim_compute_performance-ego_mean0.060258047449042826
sim_compute_performance-ego_median0.05795547209287945
sim_compute_performance-ego_min0.05767620526827299
sim_compute_robot_state-ego_max0.06622519725706519
sim_compute_robot_state-ego_mean0.061918349390983986
sim_compute_robot_state-ego_median0.061557650566101074
sim_compute_robot_state-ego_min0.05929119335977655
sim_compute_sim_state_max0.037707302628493894
sim_compute_sim_state_mean0.03631692001560062
sim_compute_sim_state_median0.03593211907606859
sim_compute_sim_state_min0.03544267717298571
sim_physics_max0.024527177578065457
sim_physics_mean0.020039401562148226
sim_physics_median0.019861506891774607
sim_physics_min0.017881123643172413
sim_render-ego_max0.057783766490657154
sim_render-ego_mean0.05477391686358769
sim_render-ego_median0.05460455543116519
sim_render-ego_min0.05163554568867107
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean2.839999999999997
survival_time_min1.3000000000000005
No reset possible
194942600Liam Paull 🇨🇦challenge-aido_LF-template-tensorflowaido2-LF-sim-testingstep1-simulationerrornoidsc-rudolf-332460:01:07
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 261, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 136, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 301, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 261, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
194682695Konstantin Chaikachallenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationsuccessnoidsc-rudolf-332460:12:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0902906752923445
survival_time_median7.549999999999981
deviation-center-line_median0.5038981374791518
in-drivable-lane_median0.25000000000000355


other stats
agent_compute-ego_max0.07402340939502842
agent_compute-ego_mean0.06438610387167787
agent_compute-ego_median0.06428110849607241
agent_compute-ego_min0.05839527084166745
deviation-center-line_max0.7006701873489274
deviation-center-line_mean0.4961148480730294
deviation-center-line_min0.2243436299629744
deviation-heading_max2.3157922042890013
deviation-heading_mean1.5293159510902186
deviation-heading_median1.2713465777568302
deviation-heading_min0.8788861315962592
driven_any_max1.2868942370418115
driven_any_mean1.057563801532224
driven_any_median1.1663836967317822
driven_any_min0.5580612631343995
driven_lanedir_consec_max1.1653755173884268
driven_lanedir_consec_mean0.9856039196353092
driven_lanedir_consec_min0.4797278944676169
driven_lanedir_max1.1653755173884268
driven_lanedir_mean0.9856039196353092
driven_lanedir_median1.0902906752923445
driven_lanedir_min0.4797278944676169
in-drivable-lane_max0.29999999999999893
in-drivable-lane_mean0.1700000000000003
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5580612631343995, "sim_physics": 0.03173928077404316, "survival_time": 3.899999999999994, "driven_lanedir": 0.4797278944676169, "sim_render-ego": 0.05387579783415183, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.06671853860219319, "deviation-heading": 0.8788861315962592, "set_robot_commands": 0.07522982817429763, "deviation-center-line": 0.2243436299629744, "driven_lanedir_consec": 0.4797278944676169, "sim_compute_sim_state": 0.03331598868736854, "sim_compute_performance-ego": 0.06071720673487736, "sim_compute_robot_state-ego": 0.06208155094048916, "sim_compute_robot_state-npc0": 0.06359291993654691, "sim_compute_robot_state-npc1": 0.059743352425404087, "sim_compute_robot_state-npc2": 0.05971102836804512, "sim_compute_robot_state-npc3": 0.0591134719359569}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.1020930293800495, "sim_physics": 0.030231407472303694, "survival_time": 7.149999999999983, "driven_lanedir": 1.0783126130678964, "sim_render-ego": 0.05257288726059707, "in-drivable-lane": 0, "agent_compute-ego": 0.06428110849607241, "deviation-heading": 1.2425978216898903, "set_robot_commands": 0.0736013125706386, "deviation-center-line": 0.6380926039536599, "driven_lanedir_consec": 1.0783126130678964, "sim_compute_sim_state": 0.03283316438848322, "sim_compute_performance-ego": 0.05942267471260125, "sim_compute_robot_state-ego": 0.062301072207364167, "sim_compute_robot_state-npc0": 0.061550845633019935, "sim_compute_robot_state-npc1": 0.05871927154647721, "sim_compute_robot_state-npc2": 0.0595629131877339, "sim_compute_robot_state-npc3": 0.05741161233061677}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.1743867813730764, "sim_physics": 0.025795674637744303, "survival_time": 7.599999999999981, "driven_lanedir": 1.114312897960262, "sim_render-ego": 0.0526478510153921, "in-drivable-lane": 0, "agent_compute-ego": 0.05851219202342786, "deviation-heading": 1.937957020119112, "set_robot_commands": 0.07263293078071192, "deviation-center-line": 0.5038981374791518, "driven_lanedir_consec": 1.114312897960262, "sim_compute_sim_state": 0.032471110946253726, "sim_compute_performance-ego": 0.05791785371930976, "sim_compute_robot_state-ego": 0.05686832258575841, "sim_compute_robot_state-npc0": 0.06017295780934786, "sim_compute_robot_state-npc1": 0.05691434521424143, "sim_compute_robot_state-npc2": 0.05766533707317553, "sim_compute_robot_state-npc3": 0.05712526879812542}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2868942370418115, "sim_physics": 0.025025945111929657, "survival_time": 8.299999999999983, "driven_lanedir": 1.1653755173884268, "sim_render-ego": 0.05176417224378471, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.05839527084166745, "deviation-heading": 2.3157922042890013, "set_robot_commands": 0.0726036896188575, "deviation-center-line": 0.4135696816204334, "driven_lanedir_consec": 1.1653755173884268, "sim_compute_sim_state": 0.03116258224809026, "sim_compute_performance-ego": 0.05582171319478966, "sim_compute_robot_state-ego": 0.05723330199000347, "sim_compute_robot_state-npc0": 0.059896726206124545, "sim_compute_robot_state-npc1": 0.05718921035169119, "sim_compute_robot_state-npc2": 0.056610396109431624, "sim_compute_robot_state-npc3": 0.05696874497884728}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.1663836967317822, "sim_physics": 0.034352648337155775, "survival_time": 7.549999999999981, "driven_lanedir": 1.0902906752923445, "sim_render-ego": 0.06004374390406325, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.07402340939502842, "deviation-heading": 1.2713465777568302, "set_robot_commands": 0.08693198336670731, "deviation-center-line": 0.7006701873489274, "driven_lanedir_consec": 1.0902906752923445, "sim_compute_sim_state": 0.037294019926462744, "sim_compute_performance-ego": 0.06639390118074733, "sim_compute_robot_state-ego": 0.0687962162573606, "sim_compute_robot_state-npc0": 0.06798461730906505, "sim_compute_robot_state-npc1": 0.06654180596206362, "sim_compute_robot_state-npc2": 0.06732756254688793, "sim_compute_robot_state-npc3": 0.0664508721686357}}
set_robot_commands_max0.08693198336670731
set_robot_commands_mean0.0761999489022426
set_robot_commands_median0.0736013125706386
set_robot_commands_min0.0726036896188575
sim_compute_performance-ego_max0.06639390118074733
sim_compute_performance-ego_mean0.060054669908465065
sim_compute_performance-ego_median0.05942267471260125
sim_compute_performance-ego_min0.05582171319478966
sim_compute_robot_state-ego_max0.0687962162573606
sim_compute_robot_state-ego_mean0.06145609279619516
sim_compute_robot_state-ego_median0.06208155094048916
sim_compute_robot_state-ego_min0.05686832258575841
sim_compute_robot_state-npc0_max0.06798461730906505
sim_compute_robot_state-npc0_mean0.06263961337882087
sim_compute_robot_state-npc0_median0.061550845633019935
sim_compute_robot_state-npc0_min0.059896726206124545
sim_compute_robot_state-npc1_max0.06654180596206362
sim_compute_robot_state-npc1_mean0.05982159709997551
sim_compute_robot_state-npc1_median0.05871927154647721
sim_compute_robot_state-npc1_min0.05691434521424143
sim_compute_robot_state-npc2_max0.06732756254688793
sim_compute_robot_state-npc2_mean0.06017544745705482
sim_compute_robot_state-npc2_median0.0595629131877339
sim_compute_robot_state-npc2_min0.056610396109431624
sim_compute_robot_state-npc3_max0.0664508721686357
sim_compute_robot_state-npc3_mean0.05941399404243641
sim_compute_robot_state-npc3_median0.05741161233061677
sim_compute_robot_state-npc3_min0.05696874497884728
sim_compute_sim_state_max0.037294019926462744
sim_compute_sim_state_mean0.0334153732393317
sim_compute_sim_state_median0.03283316438848322
sim_compute_sim_state_min0.03116258224809026
sim_physics_max0.034352648337155775
sim_physics_mean0.02942899126663532
sim_physics_median0.030231407472303694
sim_physics_min0.025025945111929657
sim_render-ego_max0.06004374390406325
sim_render-ego_mean0.05418089045159778
sim_render-ego_median0.0526478510153921
sim_render-ego_min0.05176417224378471
simulation-passed1
survival_time_max8.299999999999983
survival_time_mean6.899999999999984
survival_time_min3.899999999999994
No reset possible
194282676Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationsuccessnoidsc-rudolf-332460:12:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9994781073225484
survival_time_median14.950000000000076
deviation-center-line_median0.7751189545584516
in-drivable-lane_median1.8999999999999997


other stats
agent_compute-ego_max0.059676668643951415
agent_compute-ego_mean0.05876830988714601
agent_compute-ego_median0.058711098035176594
agent_compute-ego_min0.0582917765747729
deviation-center-line_max1.1440136182734426
deviation-center-line_mean0.7899152876265398
deviation-center-line_min0.2873551545425918
deviation-heading_max7.402872163868325
deviation-heading_mean4.007475579450214
deviation-heading_median4.415612855492007
deviation-heading_min0.95602915398391
driven_any_max2.355521049648728
driven_any_mean1.8342301038114772
driven_any_median2.3448496043941405
driven_any_min1.0458632419977505
driven_lanedir_consec_max1.8053736080306249
driven_lanedir_consec_mean1.0066792295375429
driven_lanedir_consec_min0.4399908063405742
driven_lanedir_max1.9694588956633847
driven_lanedir_mean1.3786872652349338
driven_lanedir_median1.4690133891231678
driven_lanedir_min0.5755669667029788
in-drivable-lane_max2.6000000000000076
in-drivable-lane_mean1.5800000000000018
in-drivable-lane_min0.04999999999999982
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.3448496043941405, "sim_physics": 0.01560866117477417, "survival_time": 14.950000000000076, "driven_lanedir": 1.8597313461046392, "sim_render-ego": 0.052200448513031, "in-drivable-lane": 1.8999999999999997, "agent_compute-ego": 0.05875083923339844, "deviation-heading": 4.415612855492007, "set_robot_commands": 0.07349766969680786, "deviation-center-line": 0.7751189545584516, "driven_lanedir_consec": 0.9994781073225484, "sim_compute_sim_state": 0.034396424293518066, "sim_compute_performance-ego": 0.05675969123840332, "sim_compute_robot_state-ego": 0.05836325168609619}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.355521049648728, "sim_physics": 0.015208993752797445, "survival_time": 14.950000000000076, "driven_lanedir": 1.9694588956633847, "sim_render-ego": 0.05165454149246216, "in-drivable-lane": 0.900000000000011, "agent_compute-ego": 0.059676668643951415, "deviation-heading": 5.3943477394366415, "set_robot_commands": 0.07334296147028606, "deviation-center-line": 1.0764709371747672, "driven_lanedir_consec": 1.8053736080306249, "sim_compute_sim_state": 0.03366890509923299, "sim_compute_performance-ego": 0.05712556521097819, "sim_compute_robot_state-ego": 0.05839696566263835}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3551061662904984, "sim_physics": 0.014914633433024089, "survival_time": 14.950000000000076, "driven_lanedir": 1.4690133891231678, "sim_render-ego": 0.05118929783503214, "in-drivable-lane": 2.6000000000000076, "agent_compute-ego": 0.058711098035176594, "deviation-heading": 7.402872163868325, "set_robot_commands": 0.07211438020070395, "deviation-center-line": 1.1440136182734426, "driven_lanedir_consec": 0.7688878974134679, "sim_compute_sim_state": 0.03443891286849975, "sim_compute_performance-ego": 0.05610562721888224, "sim_compute_robot_state-ego": 0.058518580595652264}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0698104567262705, "sim_physics": 0.015850849288830654, "survival_time": 6.949999999999983, "driven_lanedir": 0.5755669667029788, "sim_render-ego": 0.05085839470513433, "in-drivable-lane": 2.4499999999999913, "agent_compute-ego": 0.0582917765747729, "deviation-heading": 1.8685159844701884, "set_robot_commands": 0.07179060428262614, "deviation-center-line": 0.2873551545425918, "driven_lanedir_consec": 0.4399908063405742, "sim_compute_sim_state": 0.034600232144911515, "sim_compute_performance-ego": 0.05688104526602107, "sim_compute_robot_state-ego": 0.05832511057956613}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0458632419977505, "sim_physics": 0.01581849596079658, "survival_time": 6.799999999999984, "driven_lanedir": 1.0196657285804989, "sim_render-ego": 0.05098822186974918, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.05841116694843068, "deviation-heading": 0.95602915398391, "set_robot_commands": 0.07339002454982084, "deviation-center-line": 0.6666177735834458, "driven_lanedir_consec": 1.0196657285804989, "sim_compute_sim_state": 0.033129164401222676, "sim_compute_performance-ego": 0.055544292225557214, "sim_compute_robot_state-ego": 0.05744073846760918}}
set_robot_commands_max0.07349766969680786
set_robot_commands_mean0.07282712804004897
set_robot_commands_median0.07334296147028606
set_robot_commands_min0.07179060428262614
sim_compute_performance-ego_max0.05712556521097819
sim_compute_performance-ego_mean0.05648324423196841
sim_compute_performance-ego_median0.05675969123840332
sim_compute_performance-ego_min0.055544292225557214
sim_compute_robot_state-ego_max0.058518580595652264
sim_compute_robot_state-ego_mean0.058208929398312424
sim_compute_robot_state-ego_median0.05836325168609619
sim_compute_robot_state-ego_min0.05744073846760918
sim_compute_sim_state_max0.034600232144911515
sim_compute_sim_state_mean0.034046727761477005
sim_compute_sim_state_median0.034396424293518066
sim_compute_sim_state_min0.033129164401222676
sim_physics_max0.015850849288830654
sim_physics_mean0.015480326722044588
sim_physics_median0.01560866117477417
sim_physics_min0.014914633433024089
sim_render-ego_max0.052200448513031
sim_render-ego_mean0.05137818088308176
sim_render-ego_median0.05118929783503214
sim_render-ego_min0.05085839470513433
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.72000000000004
survival_time_min6.799999999999984
No reset possible
194182771Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationsuccessnoidsc-rudolf-332460:16:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7795989953827971
survival_time_median5.1999999999999895
deviation-center-line_median0.42131021260548374
in-drivable-lane_median0


other stats
agent_compute-ego_max0.14297825732129685
agent_compute-ego_mean0.0958365040280685
agent_compute-ego_median0.08082923968633016
agent_compute-ego_min0.07758505527789776
deviation-center-line_max1.3142758997551192
deviation-center-line_mean0.7302540729333422
deviation-center-line_min0.4080284614641879
deviation-heading_max3.858966660974996
deviation-heading_mean1.7594559336329738
deviation-heading_median0.6665609404145512
deviation-heading_min0.5640094921759111
driven_any_max2.3555911091745645
driven_any_mean1.3780368624938155
driven_any_median0.7887125370940031
driven_any_min0.6842416511385191
driven_lanedir_consec_max1.7089588418441486
driven_lanedir_consec_mean0.9416439162266006
driven_lanedir_consec_min0.6730551409975218
driven_lanedir_max2.127710162331914
driven_lanedir_mean1.2533475529974445
driven_lanedir_median0.7795989953827971
driven_lanedir_min0.6730551409975218
in-drivable-lane_max1.5499999999999945
in-drivable-lane_mean0.3799999999999986
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.3532851292471437, "sim_physics": 0.02496399482091268, "survival_time": 14.950000000000076, "driven_lanedir": 2.127710162331914, "sim_render-ego": 0.05135522762934367, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.08082923968633016, "deviation-heading": 3.858966660974996, "set_robot_commands": 0.07319522460301717, "deviation-center-line": 1.0991287247299004, "driven_lanedir_consec": 0.8469314294463097, "sim_compute_sim_state": 0.031860400835673014, "sim_compute_performance-ego": 0.05631694316864014, "sim_compute_robot_state-ego": 0.05764085690180461, "sim_compute_robot_state-npc0": 0.05863536834716797, "sim_compute_robot_state-npc1": 0.05755882660547893, "sim_compute_robot_state-npc2": 0.0575874654452006, "sim_compute_robot_state-npc3": 0.05705827554066976}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7887125370940031, "sim_physics": 0.02599425957753108, "survival_time": 5.1999999999999895, "driven_lanedir": 0.7795989953827971, "sim_render-ego": 0.05369221017910884, "in-drivable-lane": 0, "agent_compute-ego": 0.08013129234313965, "deviation-heading": 0.5640094921759111, "set_robot_commands": 0.0731668220116542, "deviation-center-line": 0.40852706611201967, "driven_lanedir_consec": 0.7795989953827971, "sim_compute_sim_state": 0.03289197958432711, "sim_compute_performance-ego": 0.0572591653236976, "sim_compute_robot_state-ego": 0.05774928056276762, "sim_compute_robot_state-npc0": 0.05936879836595976, "sim_compute_robot_state-npc1": 0.057599397806020886, "sim_compute_robot_state-npc2": 0.056533870788720936, "sim_compute_robot_state-npc3": 0.05726468104582567}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6842416511385191, "sim_physics": 0.026043197610876066, "survival_time": 4.549999999999992, "driven_lanedir": 0.6730551409975218, "sim_render-ego": 0.04973892851190253, "in-drivable-lane": 0, "agent_compute-ego": 0.07758505527789776, "deviation-heading": 0.6665609404145512, "set_robot_commands": 0.07478439414894188, "deviation-center-line": 0.42131021260548374, "driven_lanedir_consec": 0.6730551409975218, "sim_compute_sim_state": 0.03192985712826907, "sim_compute_performance-ego": 0.05468670614473113, "sim_compute_robot_state-ego": 0.05710311250372247, "sim_compute_robot_state-npc0": 0.057859994552947665, "sim_compute_robot_state-npc1": 0.05702174364865481, "sim_compute_robot_state-npc2": 0.05743282967871362, "sim_compute_robot_state-npc3": 0.05662481339423211}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3555911091745645, "sim_physics": 0.03183006445566813, "survival_time": 14.950000000000076, "driven_lanedir": 1.9866982928127643, "sim_render-ego": 0.05917498429616292, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.09765867551167806, "deviation-heading": 3.1256459700003068, "set_robot_commands": 0.08198978344599406, "deviation-center-line": 1.3142758997551192, "driven_lanedir_consec": 1.7089588418441486, "sim_compute_sim_state": 0.036662233670552574, "sim_compute_performance-ego": 0.06443040053049723, "sim_compute_robot_state-ego": 0.06683240016301473, "sim_compute_robot_state-npc0": 0.06718575239181518, "sim_compute_robot_state-npc1": 0.06455448309580485, "sim_compute_robot_state-npc2": 0.06525972366333008, "sim_compute_robot_state-npc3": 0.06487644672393798}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.7083538858148478, "sim_physics": 0.0547353206796849, "survival_time": 4.699999999999991, "driven_lanedir": 0.6996751734622252, "sim_render-ego": 0.07643718161481491, "in-drivable-lane": 0, "agent_compute-ego": 0.14297825732129685, "deviation-heading": 0.5820966045991024, "set_robot_commands": 0.10359628149803649, "deviation-center-line": 0.4080284614641879, "driven_lanedir_consec": 0.6996751734622252, "sim_compute_sim_state": 0.04683891509441619, "sim_compute_performance-ego": 0.08174533793266783, "sim_compute_robot_state-ego": 0.08812169825777094, "sim_compute_robot_state-npc0": 0.08190522295363406, "sim_compute_robot_state-npc1": 0.08224225044250488, "sim_compute_robot_state-npc2": 0.08011727130159418, "sim_compute_robot_state-npc3": 0.08017422036921724}}
set_robot_commands_max0.10359628149803649
set_robot_commands_mean0.08134650114152875
set_robot_commands_median0.07478439414894188
set_robot_commands_min0.0731668220116542
sim_compute_performance-ego_max0.08174533793266783
sim_compute_performance-ego_mean0.06288771062004679
sim_compute_performance-ego_median0.0572591653236976
sim_compute_performance-ego_min0.05468670614473113
sim_compute_robot_state-ego_max0.08812169825777094
sim_compute_robot_state-ego_mean0.06548946967781608
sim_compute_robot_state-ego_median0.05774928056276762
sim_compute_robot_state-ego_min0.05710311250372247
sim_compute_robot_state-npc0_max0.08190522295363406
sim_compute_robot_state-npc0_mean0.06499102732230493
sim_compute_robot_state-npc0_median0.05936879836595976
sim_compute_robot_state-npc0_min0.057859994552947665
sim_compute_robot_state-npc1_max0.08224225044250488
sim_compute_robot_state-npc1_mean0.06379534031969288
sim_compute_robot_state-npc1_median0.057599397806020886
sim_compute_robot_state-npc1_min0.05702174364865481
sim_compute_robot_state-npc2_max0.08011727130159418
sim_compute_robot_state-npc2_mean0.0633862321755119
sim_compute_robot_state-npc2_median0.0575874654452006
sim_compute_robot_state-npc2_min0.056533870788720936
sim_compute_robot_state-npc3_max0.08017422036921724
sim_compute_robot_state-npc3_mean0.06319968741477655
sim_compute_robot_state-npc3_median0.05726468104582567
sim_compute_robot_state-npc3_min0.05662481339423211
sim_compute_sim_state_max0.04683891509441619
sim_compute_sim_state_mean0.03603667726264759
sim_compute_sim_state_median0.03289197958432711
sim_compute_sim_state_min0.031860400835673014
sim_physics_max0.0547353206796849
sim_physics_mean0.03271336742893457
sim_physics_median0.026043197610876066
sim_physics_min0.02496399482091268
sim_render-ego_max0.07643718161481491
sim_render-ego_mean0.058079706446266574
sim_render-ego_median0.05369221017910884
sim_render-ego_min0.04973892851190253
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.870000000000024
survival_time_min4.549999999999992
No reset possible
193532978Julian ZillyBaseline-IL-logs-tensorflowaido2-LFV-sim-validationstep1-simulationsuccessnoidsc-rudolf-332460:25:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0717476354139412
survival_time_median11.100000000000025
deviation-center-line_median0.580010492868701
in-drivable-lane_median0


other stats
agent_compute-ego_max0.27910928898029497
agent_compute-ego_mean0.2106324659311974
agent_compute-ego_median0.18487128642720912
agent_compute-ego_min0.18244574785232545
deviation-center-line_max0.6060980958489511
deviation-center-line_mean0.5588756233647109
deviation-center-line_min0.5005215630035661
deviation-heading_max5.476129315482511
deviation-heading_mean1.9087685923995887
deviation-heading_median1.1563133776469214
deviation-heading_min0.5225416074882447
driven_any_max1.3781360444908608
driven_any_mean1.1641605334884615
driven_any_median1.0956645227252622
driven_any_min1.0482424886043191
driven_lanedir_consec_max1.3769714371897086
driven_lanedir_consec_mean1.036959900117212
driven_lanedir_consec_min0.6209668078321595
driven_lanedir_max1.3769714371897086
driven_lanedir_mean1.0532938384628256
driven_lanedir_median1.0717476354139412
driven_lanedir_min0.702636499560227
in-drivable-lane_max4.750000000000055
in-drivable-lane_mean0.9500000000000112
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.2109363204079542, "sim_physics": 0.02536486864089966, "survival_time": 14.950000000000076, "driven_lanedir": 0.702636499560227, "sim_render-ego": 0.05285708189010621, "in-drivable-lane": 4.750000000000055, "agent_compute-ego": 0.1835041117668152, "deviation-heading": 5.476129315482511, "set_robot_commands": 0.07425968726476033, "deviation-center-line": 0.5952175899891469, "driven_lanedir_consec": 0.6209668078321595, "sim_compute_sim_state": 0.03407600561777751, "sim_compute_performance-ego": 0.05902221997578939, "sim_compute_robot_state-ego": 0.059540127913157145, "sim_compute_robot_state-npc0": 0.06238160371780395, "sim_compute_robot_state-npc1": 0.060305333137512206, "sim_compute_robot_state-npc2": 0.05944054047266642, "sim_compute_robot_state-npc3": 0.06021856864293416}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.3781360444908608, "sim_physics": 0.026196122964223224, "survival_time": 14.950000000000076, "driven_lanedir": 1.3769714371897086, "sim_render-ego": 0.05411780993143717, "in-drivable-lane": 0, "agent_compute-ego": 0.18244574785232545, "deviation-heading": 0.5225416074882447, "set_robot_commands": 0.07314955790837606, "deviation-center-line": 0.6060980958489511, "driven_lanedir_consec": 1.3769714371897086, "sim_compute_sim_state": 0.033884390989939374, "sim_compute_performance-ego": 0.05990375359853109, "sim_compute_robot_state-ego": 0.05840970516204834, "sim_compute_robot_state-npc0": 0.062264103094736734, "sim_compute_robot_state-npc1": 0.05866837898890177, "sim_compute_robot_state-npc2": 0.057459708054860434, "sim_compute_robot_state-npc3": 0.0573835031191508}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0482424886043191, "sim_physics": 0.03846966835760301, "survival_time": 10.85000000000002, "driven_lanedir": 1.0330416782720504, "sim_render-ego": 0.061721772092828, "in-drivable-lane": 0, "agent_compute-ego": 0.2232318946293422, "deviation-heading": 1.1417249244823022, "set_robot_commands": 0.08812996648973034, "deviation-center-line": 0.580010492868701, "driven_lanedir_consec": 1.0330416782720504, "sim_compute_sim_state": 0.038205217106551066, "sim_compute_performance-ego": 0.0677922035691925, "sim_compute_robot_state-ego": 0.06968179276461975, "sim_compute_robot_state-npc0": 0.06853257785744381, "sim_compute_robot_state-npc1": 0.0668210488859959, "sim_compute_robot_state-npc2": 0.06657133893483246, "sim_compute_robot_state-npc3": 0.06797348848685691}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0956645227252622, "sim_physics": 0.026966249177215296, "survival_time": 10.90000000000002, "driven_lanedir": 1.0820719418782008, "sim_render-ego": 0.0558080596661349, "in-drivable-lane": 0, "agent_compute-ego": 0.18487128642720912, "deviation-heading": 1.1563133776469214, "set_robot_commands": 0.07718440808287454, "deviation-center-line": 0.5005215630035661, "driven_lanedir_consec": 1.0820719418782008, "sim_compute_sim_state": 0.03409105922104022, "sim_compute_performance-ego": 0.05970731678359006, "sim_compute_robot_state-ego": 0.059886334139272704, "sim_compute_robot_state-npc0": 0.06381084940849094, "sim_compute_robot_state-npc1": 0.06121662013027646, "sim_compute_robot_state-npc2": 0.060967638951922774, "sim_compute_robot_state-npc3": 0.060211881585077405}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.087823291213912, "sim_physics": 0.05168088706764015, "survival_time": 11.100000000000025, "driven_lanedir": 1.0717476354139412, "sim_render-ego": 0.07183632442543099, "in-drivable-lane": 0, "agent_compute-ego": 0.27910928898029497, "deviation-heading": 1.247133736897964, "set_robot_commands": 0.10059130084407222, "deviation-center-line": 0.5125303751131896, "driven_lanedir_consec": 1.0717476354139412, "sim_compute_sim_state": 0.04287056879954295, "sim_compute_performance-ego": 0.0754640886375496, "sim_compute_robot_state-ego": 0.08347082460248792, "sim_compute_robot_state-npc0": 0.07549313381985501, "sim_compute_robot_state-npc1": 0.07602342399390968, "sim_compute_robot_state-npc2": 0.07421439188020723, "sim_compute_robot_state-npc3": 0.07451397771233911}}
set_robot_commands_max0.10059130084407222
set_robot_commands_mean0.08266298411796269
set_robot_commands_median0.07718440808287454
set_robot_commands_min0.07314955790837606
sim_compute_performance-ego_max0.0754640886375496
sim_compute_performance-ego_mean0.06437791651293052
sim_compute_performance-ego_median0.05990375359853109
sim_compute_performance-ego_min0.05902221997578939
sim_compute_robot_state-ego_max0.08347082460248792
sim_compute_robot_state-ego_mean0.06619775691631717
sim_compute_robot_state-ego_median0.059886334139272704
sim_compute_robot_state-ego_min0.05840970516204834
sim_compute_robot_state-npc0_max0.07549313381985501
sim_compute_robot_state-npc0_mean0.06649645357966609
sim_compute_robot_state-npc0_median0.06381084940849094
sim_compute_robot_state-npc0_min0.062264103094736734
sim_compute_robot_state-npc1_max0.07602342399390968
sim_compute_robot_state-npc1_mean0.06460696102731919
sim_compute_robot_state-npc1_median0.06121662013027646
sim_compute_robot_state-npc1_min0.05866837898890177
sim_compute_robot_state-npc2_max0.07421439188020723
sim_compute_robot_state-npc2_mean0.06373072365889787
sim_compute_robot_state-npc2_median0.060967638951922774
sim_compute_robot_state-npc2_min0.057459708054860434
sim_compute_robot_state-npc3_max0.07451397771233911
sim_compute_robot_state-npc3_mean0.06406028390927168
sim_compute_robot_state-npc3_median0.06021856864293416
sim_compute_robot_state-npc3_min0.0573835031191508
sim_compute_sim_state_max0.04287056879954295
sim_compute_sim_state_mean0.03662544834697022
sim_compute_sim_state_median0.03409105922104022
sim_compute_sim_state_min0.033884390989939374
sim_physics_max0.05168088706764015
sim_physics_mean0.033735559241516264
sim_physics_median0.026966249177215296
sim_physics_min0.02536486864089966
sim_render-ego_max0.07183632442543099
sim_render-ego_mean0.05926820960118745
sim_render-ego_median0.0558080596661349
sim_render-ego_min0.05285708189010621
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.550000000000043
survival_time_min10.85000000000002
No reset possible
192922881Andrea Daniele 🇮🇹minimal_agent (Python 3)aido2-LFV-sim-validationstep1-simulationsuccessnoidsc-rudolf-332460:18:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2271628965464352
survival_time_median10.800000000000018
deviation-center-line_median0.4302836987803837
in-drivable-lane_median2.0499999999999927


other stats
agent_compute-ego_max0.13400043169657389
agent_compute-ego_mean0.1323812699408612
agent_compute-ego_median0.13213538682019269
agent_compute-ego_min0.13004491273746935
deviation-center-line_max0.5576039074284667
deviation-center-line_mean0.3744391706010032
deviation-center-line_min0.1475671628461062
deviation-heading_max1.826624936691222
deviation-heading_mean1.1745965471911113
deviation-heading_median0.9779276407610488
deviation-heading_min0.7451786321286323
driven_any_max2.1956524856063173
driven_any_mean1.585349600382327
driven_any_median1.5771367475578253
driven_any_min0.993745776226499
driven_lanedir_consec_max1.659262210665728
driven_lanedir_consec_mean1.1960969538526285
driven_lanedir_consec_min0.6474115509746436
driven_lanedir_max1.659262210665728
driven_lanedir_mean1.1960969538526285
driven_lanedir_median1.2271628965464352
driven_lanedir_min0.6474115509746436
in-drivable-lane_max3.5000000000000497
in-drivable-lane_mean2.280000000000025
in-drivable-lane_min1.7000000000000242
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.993745776226499, "sim_physics": 0.028624886231456727, "survival_time": 6.949999999999983, "driven_lanedir": 0.6474115509746436, "sim_render-ego": 0.05473993665022816, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.1336152073290708, "deviation-heading": 0.8273534093107037, "set_robot_commands": 0.07429680549841133, "deviation-center-line": 0.1475671628461062, "driven_lanedir_consec": 0.6474115509746436, "sim_compute_sim_state": 0.0346380223473199, "sim_compute_performance-ego": 0.06047141809257672, "sim_compute_robot_state-ego": 0.06159413975777386, "sim_compute_robot_state-npc0": 0.06341895096593624, "sim_compute_robot_state-npc1": 0.06044049228695657, "sim_compute_robot_state-npc2": 0.05907016863925851, "sim_compute_robot_state-npc3": 0.06078876522805193}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.1956524856063173, "sim_physics": 0.029075360298156737, "survival_time": 14.950000000000076, "driven_lanedir": 1.659262210665728, "sim_render-ego": 0.05517025550206502, "in-drivable-lane": 3.5000000000000497, "agent_compute-ego": 0.13400043169657389, "deviation-heading": 0.9779276407610488, "set_robot_commands": 0.07655863682428996, "deviation-center-line": 0.5576039074284667, "driven_lanedir_consec": 1.659262210665728, "sim_compute_sim_state": 0.03447438637415568, "sim_compute_performance-ego": 0.06072057882944743, "sim_compute_robot_state-ego": 0.062370158831278485, "sim_compute_robot_state-npc0": 0.0629149564107259, "sim_compute_robot_state-npc1": 0.06058289607365926, "sim_compute_robot_state-npc2": 0.06027248700459798, "sim_compute_robot_state-npc3": 0.06124244292577108}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.583473805081668, "sim_physics": 0.02601175374149727, "survival_time": 10.85000000000002, "driven_lanedir": 1.243796514016382, "sim_render-ego": 0.054459772901051605, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.13211041112099925, "deviation-heading": 1.4958981170639498, "set_robot_commands": 0.07393179401274651, "deviation-center-line": 0.28274302907821136, "driven_lanedir_consec": 1.243796514016382, "sim_compute_sim_state": 0.03337216377258301, "sim_compute_performance-ego": 0.05846926583672449, "sim_compute_robot_state-ego": 0.06058898060003184, "sim_compute_robot_state-npc0": 0.06175232043464063, "sim_compute_robot_state-npc1": 0.058927414054694816, "sim_compute_robot_state-npc2": 0.05780257827125936, "sim_compute_robot_state-npc3": 0.05810299886536488}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5767391874393253, "sim_physics": 0.02554428467044124, "survival_time": 10.800000000000018, "driven_lanedir": 1.2271628965464352, "sim_render-ego": 0.05279780869130735, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.13213538682019269, "deviation-heading": 1.826624936691222, "set_robot_commands": 0.07263791229989794, "deviation-center-line": 0.4302836987803837, "driven_lanedir_consec": 1.2271628965464352, "sim_compute_sim_state": 0.03303384891262761, "sim_compute_performance-ego": 0.05747462864275331, "sim_compute_robot_state-ego": 0.05865965949164496, "sim_compute_robot_state-npc0": 0.061683448376478975, "sim_compute_robot_state-npc1": 0.05773658001864398, "sim_compute_robot_state-npc2": 0.05685018499692281, "sim_compute_robot_state-npc3": 0.05765427704210634}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5771367475578253, "sim_physics": 0.025413812592972155, "survival_time": 10.750000000000018, "driven_lanedir": 1.2028515970599525, "sim_render-ego": 0.053791903340539265, "in-drivable-lane": 2.3500000000000334, "agent_compute-ego": 0.13004491273746935, "deviation-heading": 0.7451786321286323, "set_robot_commands": 0.07506605968918911, "deviation-center-line": 0.4539980548718481, "driven_lanedir_consec": 1.2028515970599525, "sim_compute_sim_state": 0.03307942678762037, "sim_compute_performance-ego": 0.057813108799069424, "sim_compute_robot_state-ego": 0.06017124597416368, "sim_compute_robot_state-npc0": 0.06128129182859909, "sim_compute_robot_state-npc1": 0.0588572058566781, "sim_compute_robot_state-npc2": 0.05805357777795126, "sim_compute_robot_state-npc3": 0.05800394457440044}}
set_robot_commands_max0.07655863682428996
set_robot_commands_mean0.07449824166490697
set_robot_commands_median0.07429680549841133
set_robot_commands_min0.07263791229989794
sim_compute_performance-ego_max0.06072057882944743
sim_compute_performance-ego_mean0.05898980004011427
sim_compute_performance-ego_median0.05846926583672449
sim_compute_performance-ego_min0.05747462864275331
sim_compute_robot_state-ego_max0.062370158831278485
sim_compute_robot_state-ego_mean0.06067683693097856
sim_compute_robot_state-ego_median0.06058898060003184
sim_compute_robot_state-ego_min0.05865965949164496
sim_compute_robot_state-npc0_max0.06341895096593624
sim_compute_robot_state-npc0_mean0.06221019360327616
sim_compute_robot_state-npc0_median0.06175232043464063
sim_compute_robot_state-npc0_min0.06128129182859909
sim_compute_robot_state-npc1_max0.06058289607365926
sim_compute_robot_state-npc1_mean0.05930891765812655
sim_compute_robot_state-npc1_median0.058927414054694816
sim_compute_robot_state-npc1_min0.05773658001864398
sim_compute_robot_state-npc2_max0.06027248700459798
sim_compute_robot_state-npc2_mean0.05840979933799799
sim_compute_robot_state-npc2_median0.05805357777795126
sim_compute_robot_state-npc2_min0.05685018499692281
sim_compute_robot_state-npc3_max0.06124244292577108
sim_compute_robot_state-npc3_mean0.05915848572713893
sim_compute_robot_state-npc3_median0.05810299886536488
sim_compute_robot_state-npc3_min0.05765427704210634
sim_compute_sim_state_max0.0346380223473199
sim_compute_sim_state_mean0.033719569638861316
sim_compute_sim_state_median0.03337216377258301
sim_compute_sim_state_min0.03303384891262761
sim_physics_max0.029075360298156737
sim_physics_mean0.02693401950690482
sim_physics_median0.02601175374149727
sim_physics_min0.025413812592972155
sim_render-ego_max0.05517025550206502
sim_render-ego_mean0.05419193541703828
sim_render-ego_median0.054459772901051605
sim_render-ego_min0.05279780869130735
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.860000000000024
survival_time_min6.949999999999983
No reset possible
192862892Diego Charrez 🇵🇪Python templateaido2-AMOD-service_qualitystep1-simulationsuccessyesidsc-rudolf-332460:03:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
passedtrue
No reset possible
192572945Bhairav MehtaBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-332460:16:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.36153550556007685
survival_time_median14.950000000000076
deviation-center-line_median0.14190047412204077
in-drivable-lane_median7.200000000000042


other stats
agent_compute-ego_max0.4451743167379628
agent_compute-ego_mean0.4001799974191016
agent_compute-ego_median0.3848655517896016
agent_compute-ego_min0.36625677029291787
deviation-center-line_max0.24318420157587345
deviation-center-line_mean0.13960916920601152
deviation-center-line_min0.020340096086409864
deviation-heading_max5.804462929177396
deviation-heading_mean3.945174639222636
deviation-heading_median5.587049482435257
deviation-heading_min0.49734101095661987
driven_any_max1.3052235448494258
driven_any_mean0.8831881756396924
driven_any_median1.2236827402558317
driven_any_min0.14787604558350312
driven_lanedir_consec_max0.4630290456260835
driven_lanedir_consec_mean0.2882830855941214
driven_lanedir_consec_min0.06398891023145525
driven_lanedir_max0.4630290456260835
driven_lanedir_mean0.2882830855941214
driven_lanedir_median0.36153550556007685
driven_lanedir_min0.06398891023145525
in-drivable-lane_max7.550000000000043
in-drivable-lane_mean5.090000000000025
in-drivable-lane_min0.6000000000000005
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.14787604558350312, "sim_physics": 0.02052108943462372, "survival_time": 1.6000000000000008, "driven_lanedir": 0.06398891023145525, "sim_render-ego": 0.053206585347652435, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.43716346472501755, "deviation-heading": 0.49734101095661987, "set_robot_commands": 0.0727684423327446, "deviation-center-line": 0.020340096086409864, "driven_lanedir_consec": 0.06398891023145525, "sim_compute_sim_state": 0.036487877368927, "sim_compute_performance-ego": 0.05831540375947952, "sim_compute_robot_state-ego": 0.0626082569360733}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5111428765567092, "sim_physics": 0.01857919692993164, "survival_time": 5.749999999999988, "driven_lanedir": 0.17707736711535904, "sim_render-ego": 0.05497903823852539, "in-drivable-lane": 2.599999999999995, "agent_compute-ego": 0.4451743167379628, "deviation-heading": 2.2319076537617413, "set_robot_commands": 0.07576490277829377, "deviation-center-line": 0.13813098469963742, "driven_lanedir_consec": 0.17707736711535904, "sim_compute_sim_state": 0.035616914085719896, "sim_compute_performance-ego": 0.05957396756047788, "sim_compute_robot_state-ego": 0.06126255367113196}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.2236827402558317, "sim_physics": 0.017436206340789795, "survival_time": 14.950000000000076, "driven_lanedir": 0.36153550556007685, "sim_render-ego": 0.05354119857152303, "in-drivable-lane": 7.550000000000043, "agent_compute-ego": 0.36625677029291787, "deviation-heading": 5.587049482435257, "set_robot_commands": 0.0741270128885905, "deviation-center-line": 0.15449008954609614, "driven_lanedir_consec": 0.36153550556007685, "sim_compute_sim_state": 0.03693924427032471, "sim_compute_performance-ego": 0.05887439250946045, "sim_compute_robot_state-ego": 0.06269405444463094}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2280156709529928, "sim_physics": 0.017554585138956705, "survival_time": 14.950000000000076, "driven_lanedir": 0.3757845994376323, "sim_render-ego": 0.053737599849700925, "in-drivable-lane": 7.5000000000000435, "agent_compute-ego": 0.3674398835500081, "deviation-heading": 5.605112119782168, "set_robot_commands": 0.07137422800064087, "deviation-center-line": 0.14190047412204077, "driven_lanedir_consec": 0.3757845994376323, "sim_compute_sim_state": 0.03620336055755615, "sim_compute_performance-ego": 0.05941872914632162, "sim_compute_robot_state-ego": 0.0619800074895223}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.3052235448494258, "sim_physics": 0.016960925261179607, "survival_time": 14.950000000000076, "driven_lanedir": 0.4630290456260835, "sim_render-ego": 0.05409106572469075, "in-drivable-lane": 7.200000000000042, "agent_compute-ego": 0.3848655517896016, "deviation-heading": 5.804462929177396, "set_robot_commands": 0.07189797480901082, "deviation-center-line": 0.24318420157587345, "driven_lanedir_consec": 0.4630290456260835, "sim_compute_sim_state": 0.03586265007654826, "sim_compute_performance-ego": 0.05942406256993612, "sim_compute_robot_state-ego": 0.06079906304677327}}
set_robot_commands_max0.07576490277829377
set_robot_commands_mean0.07318651216185612
set_robot_commands_median0.0727684423327446
set_robot_commands_min0.07137422800064087
sim_compute_performance-ego_max0.05957396756047788
sim_compute_performance-ego_mean0.05912131110913512
sim_compute_performance-ego_median0.05941872914632162
sim_compute_performance-ego_min0.05831540375947952
sim_compute_robot_state-ego_max0.06269405444463094
sim_compute_robot_state-ego_mean0.061868787117626355
sim_compute_robot_state-ego_median0.0619800074895223
sim_compute_robot_state-ego_min0.06079906304677327
sim_compute_sim_state_max0.03693924427032471
sim_compute_sim_state_mean0.03622200927181521
sim_compute_sim_state_median0.03620336055755615
sim_compute_sim_state_min0.035616914085719896
sim_physics_max0.02052108943462372
sim_physics_mean0.018210400621096298
sim_physics_median0.017554585138956705
sim_physics_min0.016960925261179607
sim_render-ego_max0.05497903823852539
sim_render-ego_mean0.053911097546418506
sim_render-ego_median0.053737599849700925
sim_render-ego_min0.053206585347652435
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.440000000000044
survival_time_min1.6000000000000008
No reset possible