Evaluator 1174

ID	1174
evaluator	`ip-172-31-25-98-2348`
owner	I don't have one 😀
machine	ip-172-31-25-98
process	ip-172-31-25-98-2348
version	d-c:4.0.30;d-c-r:4.0.44;d-s:4.0.22
first heard	2019-05-16 13:48:39+00:00
last heard	2019-05-17 15:38:43+00:00
status	inactive
# evaluating
# success	20 `22230`
# timeout
# failed	2 `22796`
# error	25 `22237`
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job ID

submission

user

user label

challenge

step

status

up to date

evaluator

date started

date completed

duration

message

23072

3554

Amaury Camus 🇨🇭

Running the real lane following -- without challenge container

aido2-LFV-sim-validation

step1-simulation

error

yes

ip-172-31-25-98-2348

2019-05-17 09:53:12+00:00

2019-05-17 10:00:33+00:00

0:07:21

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23052

3548

Nicky Eichmann

Baseline solution using reinforcement learning

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-25-98-2348

2019-05-17 07:16:00+00:00

2019-05-17 07:31:26+00:00

0:15:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0
survival_time_median	14.950000000000076
deviation-center-line_median	0.4944945349285404
in-drivable-lane_median	7.050000000000072

other stats

agent_compute-ego_max	0.10504728635152182
agent_compute-ego_mean	0.103598064104716
agent_compute-ego_median	0.103477942943573
agent_compute-ego_min	0.10187084674835203
deviation-center-line_max	0.8791250519425075
deviation-center-line_mean	0.44763369492900534
deviation-center-line_min	0.14582877424072369
deviation-heading_max	17.22642654382171
deviation-heading_mean	6.424253550835585
deviation-heading_median	3.47447884068374
deviation-heading_min	2.8124379744908925
driven_any_max	0.940692055491246
driven_any_mean	0.1995662017159223
driven_any_median	5.796408514446574e-14
driven_any_min	4.9480879556867655e-14
driven_lanedir_consec_max	0.4343165155064953
driven_lanedir_consec_mean	0.0979325807778696
driven_lanedir_consec_min	0
driven_lanedir_max	0.4651881591161454
driven_lanedir_mean	0.10410690949979962
driven_lanedir_median	0
driven_lanedir_min	0
in-drivable-lane_max	10.850000000000083
in-drivable-lane_mean	6.780000000000063
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.05713895308820663, "sim_physics": 0.06469975471496582, "survival_time": 14.950000000000076, "driven_lanedir": 0.05534638838285266, "sim_render-ego": 0.039441780249277754, "in-drivable-lane": 6.450000000000092, "agent_compute-ego": 0.10504728635152182, "deviation-heading": 3.4463286844259757, "set_robot_commands": 0.05747942924499512, "deviation-center-line": 0.5669722123144191, "driven_lanedir_consec": 0.05534638838285266, "sim_compute_sim_state": 0.02531776348749797, "sim_compute_performance-ego": 0.04273385445276896, "sim_compute_robot_state-ego": 0.044273540178934735}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.940692055491246, "sim_physics": 0.06229474385579427, "survival_time": 14.950000000000076, "driven_lanedir": 0.4651881591161454, "sim_render-ego": 0.038777933915456135, "in-drivable-lane": 9.550000000000068, "agent_compute-ego": 0.10447086731592814, "deviation-heading": 3.47447884068374, "set_robot_commands": 0.05682178815205892, "deviation-center-line": 0.15174790121883605, "driven_lanedir_consec": 0.4343165155064953, "sim_compute_sim_state": 0.025198742548624673, "sim_compute_performance-ego": 0.042150410016377766, "sim_compute_robot_state-ego": 0.04364627043406168}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.9480879556867655e-14, "sim_physics": 0.05656328837076823, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.03778050502141317, "in-drivable-lane": 0, "agent_compute-ego": 0.10187084674835203, "deviation-heading": 17.22642654382171, "set_robot_commands": 0.05742614189783732, "deviation-center-line": 0.8791250519425075, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.02503937562306722, "sim_compute_performance-ego": 0.0416910441716512, "sim_compute_robot_state-ego": 0.04357919216156006}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 5.1316294581885615e-14, "sim_physics": 0.06163030544916789, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.03877824306488037, "in-drivable-lane": 7.050000000000072, "agent_compute-ego": 0.103477942943573, "deviation-heading": 5.161595710755609, "set_robot_commands": 0.05727466344833374, "deviation-center-line": 0.4944945349285404, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.025107709566752116, "sim_compute_performance-ego": 0.04218491792678833, "sim_compute_robot_state-ego": 0.04373698393503825}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.796408514446574e-14, "sim_physics": 0.06360384464263916, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.0382793402671814, "in-drivable-lane": 10.850000000000083, "agent_compute-ego": 0.10312337716420492, "deviation-heading": 2.8124379744908925, "set_robot_commands": 0.05667584339777629, "deviation-center-line": 0.14582877424072369, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.025067140261332194, "sim_compute_performance-ego": 0.04186038494110107, "sim_compute_robot_state-ego": 0.043358910083770755}}
set_robot_commands_max	0.05747942924499512
set_robot_commands_mean	0.05713557322820027
set_robot_commands_median	0.05727466344833374
set_robot_commands_min	0.05667584339777629
sim_compute_performance-ego_max	0.04273385445276896
sim_compute_performance-ego_mean	0.04212412230173747
sim_compute_performance-ego_median	0.042150410016377766
sim_compute_performance-ego_min	0.0416910441716512
sim_compute_robot_state-ego_max	0.044273540178934735
sim_compute_robot_state-ego_mean	0.043718979358673096
sim_compute_robot_state-ego_median	0.04364627043406168
sim_compute_robot_state-ego_min	0.043358910083770755
sim_compute_sim_state_max	0.02531776348749797
sim_compute_sim_state_mean	0.025146146297454836
sim_compute_sim_state_median	0.025107709566752116
sim_compute_sim_state_min	0.02503937562306722
sim_physics_max	0.06469975471496582
sim_physics_mean	0.06175838740666708
sim_physics_median	0.06229474385579427
sim_physics_min	0.05656328837076823
sim_render-ego_max	0.039441780249277754
sim_render-ego_mean	0.03861156050364176
sim_render-ego_median	0.038777933915456135
sim_render-ego_min	0.03778050502141317
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

23030

2366

Andrea Censi 🇨🇭

random_agent

aido2-LFVI-sim-testing

step1-simulation

success

yes

ip-172-31-25-98-2348

2019-05-17 05:34:59+00:00

2019-05-17 05:59:51+00:00

0:24:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6537162971975778
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14884708769804722
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.16246684959956578
agent_compute-ego_mean	0.1193457550406858
agent_compute-ego_median	0.11584102023731578
agent_compute-ego_min	0.0816840070944566
deviation-center-line_max	0.5141120095458062
deviation-center-line_mean	0.1769000227005324
deviation-center-line_min	0.06216029860587694
deviation-heading_max	1.9929437250081896
deviation-heading_mean	0.692977823395608
deviation-heading_median	0.4928440244444201
deviation-heading_min	0.24234723632033853
driven_any_max	3.5343244022418343
driven_any_mean	1.3470385992234175
driven_any_median	1.001633421251194
driven_any_min	0.3412551960104244
driven_lanedir_consec_max	2.494308053441959
driven_lanedir_consec_mean	0.881391085527715
driven_lanedir_consec_min	0.3199180625488627
driven_lanedir_max	2.494308053441959
driven_lanedir_mean	0.8962528018383226
driven_lanedir_median	0.7206363324756615
driven_lanedir_min	0.3199180625488627
in-drivable-lane_max	3.549999999999991
in-drivable-lane_mean	0.839999999999998
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.24855565119393264, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06925922104074986, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.155336527884761, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.10752986352654952, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.04359757749340202, "sim_compute_performance-ego": 0.07697745214534711, "sim_compute_robot_state-ego": 0.08291390274144426, "sim_compute_robot_state-npc0": 0.07685048670708379, "sim_compute_robot_state-npc1": 0.07677476617354381, "sim_compute_robot_state-npc2": 0.07438194600841667, "sim_compute_robot_state-npc3": 0.07647331455085851}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.2497809018407549, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.07189416885375977, "in-drivable-lane": 0, "agent_compute-ego": 0.16246684959956578, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.10845349516187396, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.04594646181379046, "sim_compute_performance-ego": 0.07773692267281669, "sim_compute_robot_state-ego": 0.0905194708279201, "sim_compute_robot_state-npc0": 0.07805607148579188, "sim_compute_robot_state-npc1": 0.08239365475518363, "sim_compute_robot_state-npc2": 0.07980709416525704, "sim_compute_robot_state-npc3": 0.07643545525414604}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.18134581926956916, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.05972729145901874, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.12698824891766297, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.0858080988948785, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.03874928974410863, "sim_compute_performance-ego": 0.06571476204881391, "sim_compute_robot_state-ego": 0.06663452305840058, "sim_compute_robot_state-npc0": 0.0656357228177265, "sim_compute_robot_state-npc1": 0.06356838605936291, "sim_compute_robot_state-npc2": 0.06600616742106317, "sim_compute_robot_state-npc3": 0.06525416744565501}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.2482065757115682, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06695430974165599, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.14053413271903992, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.10042938093344372, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.04281287888685862, "sim_compute_performance-ego": 0.0750250518321991, "sim_compute_robot_state-ego": 0.08010945717493693, "sim_compute_robot_state-npc0": 0.07606008152167003, "sim_compute_robot_state-npc1": 0.08567437529563904, "sim_compute_robot_state-npc2": 0.08693686624368031, "sim_compute_robot_state-npc3": 0.07538183530171712}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.2506513936179025, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.0698632626306443, "in-drivable-lane": 0, "agent_compute-ego": 0.15233826637268066, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.10605581601460774, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.04399532363528297, "sim_compute_performance-ego": 0.07691823868524461, "sim_compute_robot_state-ego": 0.08187186150323778, "sim_compute_robot_state-npc0": 0.07834412938072569, "sim_compute_robot_state-npc1": 0.0800840173448835, "sim_compute_robot_state-npc2": 0.07827677045549665, "sim_compute_robot_state-npc3": 0.07187821751549131}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.1636652675217497, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.05409811642355548, "in-drivable-lane": 2, "agent_compute-ego": 0.11723034396143016, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.08138465310285191, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.03422128511760049, "sim_compute_performance-ego": 0.0591054776471532, "sim_compute_robot_state-ego": 0.061902017650490034, "sim_compute_robot_state-npc0": 0.06106009169253047, "sim_compute_robot_state-npc1": 0.0603737174393888, "sim_compute_robot_state-npc2": 0.05882169386583888, "sim_compute_robot_state-npc3": 0.05787203126324865}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.17167812643699276, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.05149866076349055, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.11002605864145223, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.07634600389350965, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.03224121019678208, "sim_compute_performance-ego": 0.056757017246727805, "sim_compute_robot_state-ego": 0.05930232770234636, "sim_compute_robot_state-npc0": 0.0569587749184914, "sim_compute_robot_state-npc1": 0.0559333157770842, "sim_compute_robot_state-npc2": 0.055721366289749885, "sim_compute_robot_state-npc3": 0.05531118679972528}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.17299080848693849, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.051539006233215334, "in-drivable-lane": 0, "agent_compute-ego": 0.1100844383239746, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.07611077308654784, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.031402487754821774, "sim_compute_performance-ego": 0.05753192901611328, "sim_compute_robot_state-ego": 0.06577604293823242, "sim_compute_robot_state-npc0": 0.05519410610198974, "sim_compute_robot_state-npc1": 0.05492759227752685, "sim_compute_robot_state-npc2": 0.05492892742156982, "sim_compute_robot_state-npc3": 0.055024819374084474}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.1528076850450956, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.05063549830363347, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1097752176798307, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.07505703889406644, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.03255288876019991, "sim_compute_performance-ego": 0.05739063024520874, "sim_compute_robot_state-ego": 0.0626486402291518, "sim_compute_robot_state-npc0": 0.05478745240431566, "sim_compute_robot_state-npc1": 0.05652853617301354, "sim_compute_robot_state-npc2": 0.055612646616422214, "sim_compute_robot_state-npc3": 0.05676229641987728}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.1954207053551307, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.051992443891671986, "in-drivable-lane": 0, "agent_compute-ego": 0.1213149199118981, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.07735528395726131, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.0335764243052556, "sim_compute_performance-ego": 0.057682459171001725, "sim_compute_robot_state-ego": 0.06005234901721661, "sim_compute_robot_state-npc0": 0.05679120467259334, "sim_compute_robot_state-npc1": 0.059519327603853665, "sim_compute_robot_state-npc2": 0.056780035679156966, "sim_compute_robot_state-npc3": 0.05792041925283579}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.17329116301103073, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.051693081855773926, "in-drivable-lane": 0, "agent_compute-ego": 0.11584102023731578, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.07827983119271019, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.03320745988325639, "sim_compute_performance-ego": 0.06003393910147927, "sim_compute_robot_state-ego": 0.06028139591217041, "sim_compute_robot_state-npc0": 0.05778358199379661, "sim_compute_robot_state-npc1": 0.06072930856184526, "sim_compute_robot_state-npc2": 0.056870070370760833, "sim_compute_robot_state-npc3": 0.056995695287531074}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.14803444862365722, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.05113977909088135, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.10650689601898192, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.07351184844970703, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.03309750556945801, "sim_compute_performance-ego": 0.05565319061279297, "sim_compute_robot_state-ego": 0.059306068420410155, "sim_compute_robot_state-npc0": 0.05434576988220215, "sim_compute_robot_state-npc1": 0.05825599670410156, "sim_compute_robot_state-npc2": 0.05735128402709961, "sim_compute_robot_state-npc3": 0.05626834392547608}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.13596351603244214, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.044710098428929104, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.09815599056000406, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.06760663428205124, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.02883693258813087, "sim_compute_performance-ego": 0.04965711147227186, "sim_compute_robot_state-ego": 0.050647598631838535, "sim_compute_robot_state-npc0": 0.049829566732366035, "sim_compute_robot_state-npc1": 0.04851810982886781, "sim_compute_robot_state-npc2": 0.04774807361846275, "sim_compute_robot_state-npc3": 0.04942530013145285}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.10993269773629996, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.03860729015790499, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.0816840070944566, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.057307926508096546, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.024158060550689697, "sim_compute_performance-ego": 0.04162236818900475, "sim_compute_robot_state-ego": 0.043001807652986966, "sim_compute_robot_state-npc0": 0.0423891544342041, "sim_compute_robot_state-npc1": 0.04213312039008507, "sim_compute_robot_state-npc2": 0.04177883038154015, "sim_compute_robot_state-npc3": 0.04189970860114464}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.1073713189079648, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.03809627578372047, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.0819034076872326, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.05665628569466727, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.02411738123212542, "sim_compute_performance-ego": 0.04171615101042248, "sim_compute_robot_state-ego": 0.04335651851835705, "sim_compute_robot_state-npc0": 0.042714623042515346, "sim_compute_robot_state-npc1": 0.04189298493521554, "sim_compute_robot_state-npc2": 0.04327527227855864, "sim_compute_robot_state-npc3": 0.04199775060017904}}
set_robot_commands_max	0.10845349516187396
set_robot_commands_mean	0.08185952890618818
set_robot_commands_median	0.07735528395726131
set_robot_commands_min	0.05665628569466727
sim_compute_performance-ego_max	0.07773692267281669
sim_compute_performance-ego_mean	0.06063484673977316
sim_compute_performance-ego_median	0.057682459171001725
sim_compute_performance-ego_min	0.04162236818900475
sim_compute_robot_state-ego_max	0.0905194708279201
sim_compute_robot_state-ego_mean	0.06455493213194267
sim_compute_robot_state-ego_median	0.061902017650490034
sim_compute_robot_state-ego_min	0.043001807652986966
sim_compute_robot_state-npc0_max	0.07834412938072569
sim_compute_robot_state-npc0_mean	0.06045338785253353
sim_compute_robot_state-npc0_median	0.0569587749184914
sim_compute_robot_state-npc0_min	0.0423891544342041
sim_compute_robot_state-npc1_max	0.08567437529563904
sim_compute_robot_state-npc1_mean	0.06182048062130636
sim_compute_robot_state-npc1_median	0.059519327603853665
sim_compute_robot_state-npc1_min	0.04189298493521554
sim_compute_robot_state-npc2_max	0.08693686624368031
sim_compute_robot_state-npc2_mean	0.06095313632287159
sim_compute_robot_state-npc2_median	0.056870070370760833
sim_compute_robot_state-npc2_min	0.04177883038154015
sim_compute_robot_state-npc3_max	0.07647331455085851
sim_compute_robot_state-npc3_mean	0.059660036114894885
sim_compute_robot_state-npc3_median	0.056995695287531074
sim_compute_robot_state-npc3_min	0.04189970860114464
sim_compute_sim_state_max	0.04594646181379046
sim_compute_sim_state_mean	0.03483421116878419
sim_compute_sim_state_median	0.03320745988325639
sim_compute_sim_state_min	0.02411738123212542
sim_physics_max	0.2506513936179025
sim_physics_mean	0.1806464052527353
sim_physics_median	0.17299080848693849
sim_physics_min	0.1073713189079648
sim_render-ego_max	0.07189416885375977
sim_render-ego_mean	0.054780566977240354
sim_render-ego_median	0.051693081855773926
sim_render-ego_min	0.03809627578372047
simulation-passed	1
survival_time_max	8.349999999999984
survival_time_mean	3.3333333333333286
survival_time_min	1.0500000000000005

No reset possible

23006

2399

Liam Paull 🇨🇦

random_agent

aido2-LFVI-sim-testing

step1-simulation

success

yes

ip-172-31-25-98-2348

2019-05-17 05:02:25+00:00

2019-05-17 05:34:00+00:00

0:31:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6537162971975778
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14884708769804722
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.15876758098602295
agent_compute-ego_mean	0.14293282439578114
agent_compute-ego_median	0.1440584109379695
agent_compute-ego_min	0.1151271915435791
deviation-center-line_max	0.5141120095458062
deviation-center-line_mean	0.1769000227005324
deviation-center-line_min	0.06216029860587694
deviation-heading_max	1.9929437250081896
deviation-heading_mean	0.692977823395608
deviation-heading_median	0.4928440244444201
deviation-heading_min	0.24234723632033853
driven_any_max	3.5343244022418343
driven_any_mean	1.3470385992234175
driven_any_median	1.001633421251194
driven_any_min	0.3412551960104244
driven_lanedir_consec_max	2.494308053441959
driven_lanedir_consec_mean	0.881391085527715
driven_lanedir_consec_min	0.3199180625488627
driven_lanedir_max	2.494308053441959
driven_lanedir_mean	0.8962528018383226
driven_lanedir_median	0.7206363324756615
driven_lanedir_min	0.3199180625488627
in-drivable-lane_max	3.549999999999991
in-drivable-lane_mean	0.839999999999998
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.20626541330844544, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06594670573367348, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.14196757123440126, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.0992590294608587, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.041479747506636605, "sim_compute_performance-ego": 0.0735602107229112, "sim_compute_robot_state-ego": 0.077212246158455, "sim_compute_robot_state-npc0": 0.07337225841570504, "sim_compute_robot_state-npc1": 0.07369668272477162, "sim_compute_robot_state-npc2": 0.07147967060909996, "sim_compute_robot_state-npc3": 0.07265432273285298}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.22035236018044607, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06974882738930839, "in-drivable-lane": 0, "agent_compute-ego": 0.145516642502376, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.10073697566986084, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.04100521121706281, "sim_compute_performance-ego": 0.07501309258597237, "sim_compute_robot_state-ego": 0.08231098311288017, "sim_compute_robot_state-npc0": 0.0733947583607265, "sim_compute_robot_state-npc1": 0.07568772350038801, "sim_compute_robot_state-npc2": 0.07574936321803502, "sim_compute_robot_state-npc3": 0.07293503625052315}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.20772280970823415, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.0656303040032248, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.14655368999370094, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.10222257688207534, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.04199059032699437, "sim_compute_performance-ego": 0.07207248974772333, "sim_compute_robot_state-ego": 0.07805474522044357, "sim_compute_robot_state-npc0": 0.07522412874166248, "sim_compute_robot_state-npc1": 0.07403288767175767, "sim_compute_robot_state-npc2": 0.07594718979400339, "sim_compute_robot_state-npc3": 0.07651922772231612}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.22813271482785544, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06932537754376729, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.14405137300491333, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.1019674688577652, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.0439109206199646, "sim_compute_performance-ego": 0.07799484829107921, "sim_compute_robot_state-ego": 0.0845315009355545, "sim_compute_robot_state-npc0": 0.07607050736745198, "sim_compute_robot_state-npc1": 0.0799860308567683, "sim_compute_robot_state-npc2": 0.07520255446434021, "sim_compute_robot_state-npc3": 0.07673073808352153}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.2287416003999256, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06448833147684734, "in-drivable-lane": 0, "agent_compute-ego": 0.14127262433369955, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.09856789452689034, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03860307875133696, "sim_compute_performance-ego": 0.07259783290681385, "sim_compute_robot_state-ego": 0.07726267405918666, "sim_compute_robot_state-npc0": 0.06956986018589564, "sim_compute_robot_state-npc1": 0.06954545066470191, "sim_compute_robot_state-npc2": 0.06976372855050224, "sim_compute_robot_state-npc3": 0.07365500359308153}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.18436753535698988, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.05926522523343206, "in-drivable-lane": 2, "agent_compute-ego": 0.13025375326236566, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.10806677726928346, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.03711533118150905, "sim_compute_performance-ego": 0.06542824271196376, "sim_compute_robot_state-ego": 0.06983515316854694, "sim_compute_robot_state-npc0": 0.07241665246243963, "sim_compute_robot_state-npc1": 0.06629533967572059, "sim_compute_robot_state-npc2": 0.06493125561468616, "sim_compute_robot_state-npc3": 0.06582438017793758}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.23764921855000615, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.06820001648467722, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14662952793454662, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.10414145293745022, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.045311680117857106, "sim_compute_performance-ego": 0.07453934891710004, "sim_compute_robot_state-ego": 0.08282894532657364, "sim_compute_robot_state-npc0": 0.07616148874597642, "sim_compute_robot_state-npc1": 0.07561011916225396, "sim_compute_robot_state-npc2": 0.0754710285408983, "sim_compute_robot_state-npc3": 0.07262817169856099}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.179863600730896, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.05415925979614258, "in-drivable-lane": 0, "agent_compute-ego": 0.1151271915435791, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.07557839870452882, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.03163711547851562, "sim_compute_performance-ego": 0.05862809658050537, "sim_compute_robot_state-ego": 0.06090038776397705, "sim_compute_robot_state-npc0": 0.058478655815124514, "sim_compute_robot_state-npc1": 0.056223664283752445, "sim_compute_robot_state-npc2": 0.05600606918334961, "sim_compute_robot_state-npc3": 0.05435097694396973}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.2190061578383813, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.06777447920579177, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1440584109379695, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.09895107837823722, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.04265966782203087, "sim_compute_performance-ego": 0.06933384675246018, "sim_compute_robot_state-ego": 0.0777853222993704, "sim_compute_robot_state-npc0": 0.07461893558502197, "sim_compute_robot_state-npc1": 0.07395915343211247, "sim_compute_robot_state-npc2": 0.07393068533677322, "sim_compute_robot_state-npc3": 0.07510991279895489}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.2494822465456449, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.06347837814917931, "in-drivable-lane": 0, "agent_compute-ego": 0.13733465854938215, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.09392273426055908, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.0423206457724938, "sim_compute_performance-ego": 0.07274389266967773, "sim_compute_robot_state-ego": 0.07532570912287785, "sim_compute_robot_state-npc0": 0.07314827808967003, "sim_compute_robot_state-npc1": 0.0700080944941594, "sim_compute_robot_state-npc2": 0.07061399863316463, "sim_compute_robot_state-npc3": 0.07735259716327374}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.2679245580326427, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.06800353527069092, "in-drivable-lane": 0, "agent_compute-ego": 0.15876758098602295, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.10603215477683328, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.04313578388907693, "sim_compute_performance-ego": 0.07728669860146263, "sim_compute_robot_state-ego": 0.0904348763552579, "sim_compute_robot_state-npc0": 0.08036056431857022, "sim_compute_robot_state-npc1": 0.07386553287506104, "sim_compute_robot_state-npc2": 0.07739199291576039, "sim_compute_robot_state-npc3": 0.07732458548112349}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.1980842113494873, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.06905413150787354, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.15138526916503903, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.1003742742538452, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.04120028018951416, "sim_compute_performance-ego": 0.07182169437408448, "sim_compute_robot_state-ego": 0.07537510395050048, "sim_compute_robot_state-npc0": 0.0726310920715332, "sim_compute_robot_state-npc1": 0.0705941915512085, "sim_compute_robot_state-npc2": 0.07229021072387695, "sim_compute_robot_state-npc3": 0.07254035949707031}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.2251405436941918, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.06546889213805503, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.1431552197070832, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.1028529684594337, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.04235585699690149, "sim_compute_performance-ego": 0.07649892949043437, "sim_compute_robot_state-ego": 0.08129870891571045, "sim_compute_robot_state-npc0": 0.07577622444071669, "sim_compute_robot_state-npc1": 0.07417083547470417, "sim_compute_robot_state-npc2": 0.07365939718611697, "sim_compute_robot_state-npc3": 0.07655607385838285}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.23385420670876136, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.06769793308698215, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1496557639195369, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.10504039434286264, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.04383929417683528, "sim_compute_performance-ego": 0.07194500244580783, "sim_compute_robot_state-ego": 0.08143355296208309, "sim_compute_robot_state-npc0": 0.07207691210966843, "sim_compute_robot_state-npc1": 0.07369835560138409, "sim_compute_robot_state-npc2": 0.0762828909433805, "sim_compute_robot_state-npc3": 0.07908960030629085}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.2164903618040539, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.06617939585731143, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.14826308886210124, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.099482942762829, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.04352556637355259, "sim_compute_performance-ego": 0.07354088964916411, "sim_compute_robot_state-ego": 0.0787614073072161, "sim_compute_robot_state-npc0": 0.07414175215221587, "sim_compute_robot_state-npc1": 0.07405749502636137, "sim_compute_robot_state-npc2": 0.07363930883861723, "sim_compute_robot_state-npc3": 0.07504286538986933}}
set_robot_commands_max	0.10806677726928346
set_robot_commands_mean	0.09981314143622086
set_robot_commands_median	0.10073697566986084
set_robot_commands_min	0.07557839870452882
sim_compute_performance-ego_max	0.07799484829107921
sim_compute_performance-ego_mean	0.07220034109647736
sim_compute_performance-ego_median	0.07274389266967773
sim_compute_performance-ego_min	0.05862809658050537
sim_compute_robot_state-ego_max	0.0904348763552579
sim_compute_robot_state-ego_mean	0.07822342111057559
sim_compute_robot_state-ego_median	0.07805474522044357
sim_compute_robot_state-ego_min	0.06090038776397705
sim_compute_robot_state-npc0_max	0.08036056431857022
sim_compute_robot_state-npc0_mean	0.07316280459082525
sim_compute_robot_state-npc0_median	0.0733947583607265
sim_compute_robot_state-npc0_min	0.058478655815124514
sim_compute_robot_state-npc1_max	0.0799860308567683
sim_compute_robot_state-npc1_mean	0.07209543713300702
sim_compute_robot_state-npc1_median	0.07386553287506104
sim_compute_robot_state-npc1_min	0.056223664283752445
sim_compute_robot_state-npc2_max	0.07739199291576039
sim_compute_robot_state-npc2_mean	0.07215728963684032
sim_compute_robot_state-npc2_median	0.07365939718611697
sim_compute_robot_state-npc2_min	0.05600606918334961
sim_compute_robot_state-npc3_max	0.07908960030629085
sim_compute_robot_state-npc3_mean	0.07322092344651526
sim_compute_robot_state-npc3_median	0.07504286538986933
sim_compute_robot_state-npc3_min	0.05435097694396973
sim_compute_sim_state_max	0.045311680117857106
sim_compute_sim_state_mean	0.04133938469468548
sim_compute_sim_state_median	0.0423206457724938
sim_compute_sim_state_min	0.03163711547851562
sim_physics_max	0.2679245580326427
sim_physics_mean	0.2202051692690641
sim_physics_median	0.22035236018044607
sim_physics_min	0.179863600730896
sim_render-ego_max	0.06974882738930839
sim_render-ego_mean	0.06562805285846383
sim_render-ego_median	0.06617939585731143
sim_render-ego_min	0.05415925979614258
simulation-passed	1
survival_time_max	8.349999999999984
survival_time_mean	3.3333333333333286
survival_time_min	1.0500000000000005

No reset possible

22992

2411

jiang peng

Baseline solution using reinforcement learning

aido2-LFV-sim-validation

step1-simulation

error

yes

ip-172-31-25-98-2348

2019-05-17 04:47:52+00:00

2019-05-17 05:02:08+00:00

0:14:16

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22976

2439

Jacopo Tani

random_agent

aido2-LF-sim-testing

step1-simulation

success

yes

ip-172-31-25-98-2348

2019-05-17 04:29:48+00:00

2019-05-17 04:47:45+00:00

0:17:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.10099507669212504
in-drivable-lane_median	0.4499999999999984

other stats

agent_compute-ego_max	0.17153480093357926
agent_compute-ego_mean	0.15994833883477627
agent_compute-ego_median	0.16326524939718126
agent_compute-ego_min	0.1384088611602783
deviation-center-line_max	0.2838635700333795
deviation-center-line_mean	0.12786165368054708
deviation-center-line_min	0.07112529346797256
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3391682685652287
deviation-heading_median	0.32928385103533875
deviation-heading_min	0.19401296908406307
driven_any_max	2.1706243860917107
driven_any_mean	0.9759490378276146
driven_any_median	1.0117660515775693
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	1.919400421063832
driven_lanedir_consec_mean	0.6896171461819246
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	1.919400421063832
driven_lanedir_mean	0.6896171461819246
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.5899999999999982
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.12631387180752224, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06712950159002233, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1644989252090454, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10631742300810636, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04115618158269812, "sim_compute_performance-ego": 0.07472935870841697, "sim_compute_robot_state-ego": 0.08111846888506855}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.1221773671168907, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06768632402607039, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15916667265050552, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.10033033875858084, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.04103759690827014, "sim_compute_performance-ego": 0.07585726999769024, "sim_compute_robot_state-ego": 0.0785357063891841}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.15712631449979894, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.06914068670833812, "in-drivable-lane": 0, "agent_compute-ego": 0.1585093806771671, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.10687453606549432, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.04874777793884277, "sim_compute_performance-ego": 0.07619661443373736, "sim_compute_robot_state-ego": 0.08029092059415929}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.1259077262878418, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.057783927917480465, "in-drivable-lane": 0, "agent_compute-ego": 0.1384088611602783, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.0968119239807129, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03720549583435059, "sim_compute_performance-ego": 0.0656602954864502, "sim_compute_robot_state-ego": 0.07159162521362304}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.12362095977686628, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06730681733240056, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.16326524939718126, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.1031850983824911, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.04188268094123164, "sim_compute_performance-ego": 0.07119408136681665, "sim_compute_robot_state-ego": 0.07969095435323595}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.1052925829984704, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.06068625255506866, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.15405850507775132, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.0952893471231266, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.038762082858961454, "sim_compute_performance-ego": 0.06567595929515604, "sim_compute_robot_state-ego": 0.07297552848348812}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.12076024498258318, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.07459964496748787, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.16202457462038314, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.10225885254996164, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.040928044489451816, "sim_compute_performance-ego": 0.07334030951772418, "sim_compute_robot_state-ego": 0.07944199017116002}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.134246065503075, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.06981333096822102, "in-drivable-lane": 0, "agent_compute-ego": 0.1636412370772589, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.10733615784418016, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.044615132468087335, "sim_compute_performance-ego": 0.07604442323957171, "sim_compute_robot_state-ego": 0.07824739955720447}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.14561896000878286, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.06788589590686862, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.17153480093357926, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.11034656783281746, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.043216875043966, "sim_compute_performance-ego": 0.07680227796910173, "sim_compute_robot_state-ego": 0.09027546139086708}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.13125715255737305, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.06738303357904607, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.16493724909695712, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.10854839411648835, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.04230480194091797, "sim_compute_performance-ego": 0.07604419968344948, "sim_compute_robot_state-ego": 0.08202991485595704}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.14149155245198833, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.06970769708806818, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.17058033757395558, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.10915143768508712, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.04150768069477825, "sim_compute_performance-ego": 0.07655189254067161, "sim_compute_robot_state-ego": 0.08524645458568227}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.14199515751429967, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.06973529713494438, "in-drivable-lane": 0, "agent_compute-ego": 0.16832719530378068, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.10476061276027136, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.04012336901256016, "sim_compute_performance-ego": 0.07118044580732073, "sim_compute_robot_state-ego": 0.08004567452839442}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.11394466138353536, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.05977701205833286, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.1530752462499282, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.09862252777697993, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.03950814639820772, "sim_compute_performance-ego": 0.06937506619621725, "sim_compute_robot_state-ego": 0.07226009929881376}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.12980470833954988, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.060903858255456994, "in-drivable-lane": 0, "agent_compute-ego": 0.1653025326905427, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.10874885982937282, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.04760429594251844, "sim_compute_performance-ego": 0.06784022295916523, "sim_compute_robot_state-ego": 0.07418070016083894}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.0990832483067232, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.05873493353525797, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.14189431480332915, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.08892759154824649, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.0367423506344066, "sim_compute_performance-ego": 0.06275517099043902, "sim_compute_robot_state-ego": 0.06561688815846163}}
set_robot_commands_max	0.11034656783281746
set_robot_commands_mean	0.10316731128412784
set_robot_commands_median	0.10476061276027136
set_robot_commands_min	0.08892759154824649
sim_compute_performance-ego_max	0.07680227796910173
sim_compute_performance-ego_mean	0.07194983921279523
sim_compute_performance-ego_median	0.07334030951772418
sim_compute_performance-ego_min	0.06275517099043902
sim_compute_robot_state-ego_max	0.09027546139086708
sim_compute_robot_state-ego_mean	0.0781031857750759
sim_compute_robot_state-ego_median	0.07944199017116002
sim_compute_robot_state-ego_min	0.06561688815846163
sim_compute_sim_state_max	0.04874777793884277
sim_compute_sim_state_mean	0.04168950084594993
sim_compute_sim_state_median	0.04115618158269812
sim_compute_sim_state_min	0.0367423506344066
sim_physics_max	0.15712631449979894
sim_physics_mean	0.12790937156902007
sim_physics_median	0.12631387180752224
sim_physics_min	0.0990832483067232
sim_render-ego_max	0.07459964496748787
sim_render-ego_mean	0.06588494757487098
sim_render-ego_median	0.06738303357904607
sim_render-ego_min	0.057783927917480465
simulation-passed	1
survival_time_max	5.09999999999999
survival_time_mean	2.503333333333331
survival_time_min	0.8500000000000002

No reset possible

22943

2500

Liam Paull 🇨🇦

challenge-aido_LF-template-pytorch

aido2-LFVI-sim-validation

step1-simulation

success

yes

ip-172-31-25-98-2348

2019-05-17 04:06:41+00:00

2019-05-17 04:29:40+00:00

0:22:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.16989098333932984
survival_time_median	5.999999999999987
deviation-center-line_median	0.09700516215369968
in-drivable-lane_median	2.8499999999999948

other stats

agent_compute-ego_max	0.19063714265823364
agent_compute-ego_mean	0.17954617341359458
agent_compute-ego_median	0.17926146189371744
agent_compute-ego_min	0.1693095397949219
deviation-center-line_max	0.5149326144164952
deviation-center-line_mean	0.18875630734570936
deviation-center-line_min	0.055176021990154915
deviation-heading_max	6.03706759109609
deviation-heading_mean	3.0367562823392857
deviation-heading_median	2.337778188521578
deviation-heading_min	0.4769187806207878
driven_any_max	1.2763860438329668
driven_any_mean	0.6447561517358648
driven_any_median	0.5046802893128901
driven_any_min	0.09611140033290728
driven_lanedir_consec_max	0.46870127726085253
driven_lanedir_consec_mean	0.2301678207304392
driven_lanedir_consec_min	0.02938220295962002
driven_lanedir_max	0.46870127726085253
driven_lanedir_mean	0.2301678207304392
driven_lanedir_median	0.16989098333932984
driven_lanedir_min	0.02938220295962002
in-drivable-lane_max	7.450000000000042
in-drivable-lane_mean	3.5900000000000154
in-drivable-lane_min	0.10000000000000007
per-episodes	details {"udem1-0-0": {"driven_any": 1.2763860438329668, "sim_physics": 0.20811249812444052, "survival_time": 14.950000000000076, "driven_lanedir": 0.46870127726085253, "sim_render-ego": 0.06639371554056804, "in-drivable-lane": 7.000000000000038, "agent_compute-ego": 0.178730898698171, "deviation-heading": 6.03706759109609, "set_robot_commands": 0.10293264150619506, "deviation-center-line": 0.2145522802595322, "driven_lanedir_consec": 0.46870127726085253, "sim_compute_sim_state": 0.043234986464182536, "sim_compute_performance-ego": 0.0734652026494344, "sim_compute_robot_state-ego": 0.07744264284769695, "sim_compute_robot_state-npc0": 0.07371064186096192, "sim_compute_robot_state-npc1": 0.0750965921084086, "sim_compute_robot_state-npc2": 0.07530850013097128, "sim_compute_robot_state-npc3": 0.07585594177246094}, "udem1-1-0": {"driven_any": 1.228587038018929, "sim_physics": 0.22931541681289672, "survival_time": 14.950000000000076, "driven_lanedir": 0.4085933010513707, "sim_render-ego": 0.06922561009724935, "in-drivable-lane": 7.450000000000042, "agent_compute-ego": 0.19063714265823364, "deviation-heading": 5.727632976660504, "set_robot_commands": 0.10236602306365966, "deviation-center-line": 0.5149326144164952, "driven_lanedir_consec": 0.4085933010513707, "sim_compute_sim_state": 0.04328161080678304, "sim_compute_performance-ego": 0.07494593540827434, "sim_compute_robot_state-ego": 0.0809173019727071, "sim_compute_robot_state-npc0": 0.0748743748664856, "sim_compute_robot_state-npc1": 0.0762978196144104, "sim_compute_robot_state-npc2": 0.07554871241251628, "sim_compute_robot_state-npc3": 0.07635698795318603}, "udem1-2-0": {"driven_any": 0.11801598718163096, "sim_physics": 0.25325515747070315, "survival_time": 1.2500000000000004, "driven_lanedir": 0.07427133904102279, "sim_render-ego": 0.06702505111694336, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.1693095397949219, "deviation-heading": 0.604383874797468, "set_robot_commands": 0.09785906791687012, "deviation-center-line": 0.09700516215369968, "driven_lanedir_consec": 0.07427133904102279, "sim_compute_sim_state": 0.04112253189086914, "sim_compute_performance-ego": 0.07145792007446289, "sim_compute_robot_state-ego": 0.0746457576751709, "sim_compute_robot_state-npc0": 0.07174093246459962, "sim_compute_robot_state-npc1": 0.07079922676086425, "sim_compute_robot_state-npc2": 0.07264791488647461, "sim_compute_robot_state-npc3": 0.0706085205078125}, "udem1-3-0": {"driven_any": 0.09611140033290728, "sim_physics": 0.23172694842020672, "survival_time": 1.5000000000000009, "driven_lanedir": 0.02938220295962002, "sim_render-ego": 0.06726459662119548, "in-drivable-lane": 0.5500000000000004, "agent_compute-ego": 0.17979182402292887, "deviation-heading": 0.4769187806207878, "set_robot_commands": 0.09374038378397624, "deviation-center-line": 0.062115457908664795, "driven_lanedir_consec": 0.02938220295962002, "sim_compute_sim_state": 0.04054005146026611, "sim_compute_performance-ego": 0.07307710647583007, "sim_compute_robot_state-ego": 0.0797143538792928, "sim_compute_robot_state-npc0": 0.06493157545725504, "sim_compute_robot_state-npc1": 0.06878815491994222, "sim_compute_robot_state-npc2": 0.06922786235809326, "sim_compute_robot_state-npc3": 0.06872215270996093}, "udem1-4-0": {"driven_any": 0.5046802893128901, "sim_physics": 0.21552934845288593, "survival_time": 5.999999999999987, "driven_lanedir": 0.16989098333932984, "sim_render-ego": 0.06574769814809163, "in-drivable-lane": 2.8499999999999948, "agent_compute-ego": 0.17926146189371744, "deviation-heading": 2.337778188521578, "set_robot_commands": 0.10036178032557168, "deviation-center-line": 0.055176021990154915, "driven_lanedir_consec": 0.16989098333932984, "sim_compute_sim_state": 0.0414349635442098, "sim_compute_performance-ego": 0.07255013386408488, "sim_compute_robot_state-ego": 0.0783116598924001, "sim_compute_robot_state-npc0": 0.07724600632985433, "sim_compute_robot_state-npc1": 0.07342073917388917, "sim_compute_robot_state-npc2": 0.07277507781982422, "sim_compute_robot_state-npc3": 0.07234709461530049}}
set_robot_commands_max	0.10293264150619506
set_robot_commands_mean	0.09945197931925456
set_robot_commands_median	0.10036178032557168
set_robot_commands_min	0.09374038378397624
sim_compute_performance-ego_max	0.07494593540827434
sim_compute_performance-ego_mean	0.07309925969441732
sim_compute_performance-ego_median	0.07307710647583007
sim_compute_performance-ego_min	0.07145792007446289
sim_compute_robot_state-ego_max	0.0809173019727071
sim_compute_robot_state-ego_mean	0.07820634325345358
sim_compute_robot_state-ego_median	0.0783116598924001
sim_compute_robot_state-ego_min	0.0746457576751709
sim_compute_robot_state-npc0_max	0.07724600632985433
sim_compute_robot_state-npc0_mean	0.0725007061958313
sim_compute_robot_state-npc0_median	0.07371064186096192
sim_compute_robot_state-npc0_min	0.06493157545725504
sim_compute_robot_state-npc1_max	0.0762978196144104
sim_compute_robot_state-npc1_mean	0.07288050651550293
sim_compute_robot_state-npc1_median	0.07342073917388917
sim_compute_robot_state-npc1_min	0.06878815491994222
sim_compute_robot_state-npc2_max	0.07554871241251628
sim_compute_robot_state-npc2_mean	0.07310161352157593
sim_compute_robot_state-npc2_median	0.07277507781982422
sim_compute_robot_state-npc2_min	0.06922786235809326
sim_compute_robot_state-npc3_max	0.07635698795318603
sim_compute_robot_state-npc3_mean	0.07277813951174418
sim_compute_robot_state-npc3_median	0.07234709461530049
sim_compute_robot_state-npc3_min	0.06872215270996093
sim_compute_sim_state_max	0.04328161080678304
sim_compute_sim_state_mean	0.041922828833262135
sim_compute_sim_state_median	0.0414349635442098
sim_compute_sim_state_min	0.04054005146026611
sim_physics_max	0.25325515747070315
sim_physics_mean	0.2275878738562266
sim_physics_median	0.22931541681289672
sim_physics_min	0.20811249812444052
sim_render-ego_max	0.06922561009724935
sim_render-ego_mean	0.06713133430480958
sim_render-ego_median	0.06702505111694336
sim_render-ego_min	0.06574769814809163
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.730000000000028
survival_time_min	1.2500000000000004

No reset possible

22917

2524

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

aido2-LFVI-sim-testing

step1-simulation

error

yes

ip-172-31-25-98-2348

2019-05-17 04:03:42+00:00

2019-05-17 04:06:33+00:00

0:02:51

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22872

2598

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

aido2-LF-sim-testing

step1-simulation

error

yes

ip-172-31-25-98-2348

2019-05-17 03:27:25+00:00

2019-05-17 04:02:27+00:00

0:35:02

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22867

2605

Konstantin Chaika

challenge-aido_LF-template-ros - Template solution using ROS

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-25-98-2348

2019-05-17 03:21:10+00:00

2019-05-17 03:27:17+00:00

0:06:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.36592094708219225
survival_time_median	2.3999999999999995
deviation-center-line_median	0.1166759393545397
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.07922933101654053
agent_compute-ego_mean	0.07322033485702589
agent_compute-ego_median	0.07351755760085414
agent_compute-ego_min	0.06663360378958962
deviation-center-line_max	0.16987818035809085
deviation-center-line_mean	0.13199870851217008
deviation-center-line_min	0.1011892720306074
deviation-heading_max	0.5809378480871981
deviation-heading_mean	0.4194004386292103
deviation-heading_median	0.34882560565471876
deviation-heading_min	0.2596285487829774
driven_any_max	0.922682252912863
driven_any_mean	0.6324710235085378
driven_any_median	0.609146202404747
driven_any_min	0.2364518949491652
driven_lanedir_consec_max	0.6632135184572027
driven_lanedir_consec_mean	0.4245071231796042
driven_lanedir_consec_min	0.2221238695940002
driven_lanedir_max	0.6632135184572027
driven_lanedir_mean	0.4245071231796042
driven_lanedir_median	0.36592094708219225
driven_lanedir_min	0.2221238695940002
in-drivable-lane_max	1.8999999999999944
in-drivable-lane_mean	0.6299999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.12479513128038865, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.06361840140651649, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.07351755760085414, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.1005266182859179, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.0392926511630206, "sim_compute_performance-ego": 0.0742083468907316, "sim_compute_robot_state-ego": 0.0779924191219706}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811189, "sim_physics": 0.1250001867612203, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572027, "sim_render-ego": 0.06719919840494791, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.07922933101654053, "deviation-heading": 0.5809378480871981, "set_robot_commands": 0.11114412546157836, "deviation-center-line": 0.1166759393545397, "driven_lanedir_consec": 0.6632135184572027, "sim_compute_sim_state": 0.043691182136535646, "sim_compute_performance-ego": 0.07635226249694824, "sim_compute_robot_state-ego": 0.08967557350794474}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.13287622278386896, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.06317079067230225, "in-drivable-lane": 0, "agent_compute-ego": 0.06663360378958962, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.1001909537748857, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.04051881486719305, "sim_compute_performance-ego": 0.07297420501708984, "sim_compute_robot_state-ego": 0.07871494509957054}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.13793106377124786, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.06511370340983073, "in-drivable-lane": 0, "agent_compute-ego": 0.06937586764494579, "deviation-heading": 0.5685240160177978, "set_robot_commands": 0.09524545570214588, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.04040399193763733, "sim_compute_performance-ego": 0.06803790231545766, "sim_compute_robot_state-ego": 0.07799123724301656}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.609146202404747, "sim_physics": 0.12471167937568996, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.06803216623223346, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.07734531423319942, "deviation-heading": 0.3390861746033595, "set_robot_commands": 0.10622351584227188, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.04242764348569124, "sim_compute_performance-ego": 0.07734831001447595, "sim_compute_robot_state-ego": 0.08291626494863759}}
set_robot_commands_max	0.11114412546157836
set_robot_commands_mean	0.10266613381335994
set_robot_commands_median	0.1005266182859179
set_robot_commands_min	0.09524545570214588
sim_compute_performance-ego_max	0.07734831001447595
sim_compute_performance-ego_mean	0.07378420534694066
sim_compute_performance-ego_median	0.0742083468907316
sim_compute_performance-ego_min	0.06803790231545766
sim_compute_robot_state-ego_max	0.08967557350794474
sim_compute_robot_state-ego_mean	0.081458087984228
sim_compute_robot_state-ego_median	0.07871494509957054
sim_compute_robot_state-ego_min	0.07799123724301656
sim_compute_sim_state_max	0.043691182136535646
sim_compute_sim_state_mean	0.041266856718015575
sim_compute_sim_state_median	0.04051881486719305
sim_compute_sim_state_min	0.0392926511630206
sim_physics_max	0.13793106377124786
sim_physics_mean	0.12906285679448315
sim_physics_median	0.1250001867612203
sim_physics_min	0.12471167937568996
sim_render-ego_max	0.06803216623223346
sim_render-ego_mean	0.06542685202516617
sim_render-ego_median	0.06511370340983073
sim_render-ego_min	0.06317079067230225
simulation-passed	1
survival_time_max	3.5499999999999954
survival_time_mean	2.469999999999999
survival_time_min	1.1000000000000003

No reset possible

22854

2628

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

aido2-LF-sim-testing

step1-simulation

success

yes

ip-172-31-25-98-2348

2019-05-17 03:02:32+00:00

2019-05-17 03:20:26+00:00

0:17:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.10099507669212504
in-drivable-lane_median	0.4499999999999984

other stats

agent_compute-ego_max	0.17225377647965043
agent_compute-ego_mean	0.16102313739093518
agent_compute-ego_median	0.16301769368788777
agent_compute-ego_min	0.13763864161604542
deviation-center-line_max	0.2838635700333795
deviation-center-line_mean	0.12786165368054708
deviation-center-line_min	0.07112529346797256
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3391682685652287
deviation-heading_median	0.32928385103533875
deviation-heading_min	0.19401296908406307
driven_any_max	2.1706243860917107
driven_any_mean	0.9759490378276146
driven_any_median	1.0117660515775693
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	1.919400421063832
driven_lanedir_consec_mean	0.6896171461819246
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	1.919400421063832
driven_lanedir_mean	0.6896171461819246
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.5899999999999982
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1498718129263984, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06974489600570113, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.17225377647965043, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.1115954319636027, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04417810175153944, "sim_compute_performance-ego": 0.08308891896848325, "sim_compute_robot_state-ego": 0.0953698643931636}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.12379118507983636, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06529650501176423, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.16672329809151443, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.10239255662057914, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.041261574801276714, "sim_compute_performance-ego": 0.07416825668484557, "sim_compute_robot_state-ego": 0.08294192949930827}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.13659073324764476, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.06399203749263987, "in-drivable-lane": 0, "agent_compute-ego": 0.16301769368788777, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.13353894738590016, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.038338548996869254, "sim_compute_performance-ego": 0.0739599396200741, "sim_compute_robot_state-ego": 0.08196129518396714}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.13057538032531738, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.062299041748046874, "in-drivable-lane": 0, "agent_compute-ego": 0.15021183967590332, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.09588328361511232, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.0409451961517334, "sim_compute_performance-ego": 0.06807896614074707, "sim_compute_robot_state-ego": 0.06950505256652832}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.12776169897634773, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06806687765483614, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.17186774785005593, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.10863616194906114, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.0435569889937775, "sim_compute_performance-ego": 0.07833936244626588, "sim_compute_robot_state-ego": 0.08386188820947575}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.12098511871026486, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.0648019654410226, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.15882987878760513, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.09976115032118194, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.039918962790041555, "sim_compute_performance-ego": 0.07399408184752172, "sim_compute_robot_state-ego": 0.08155087062290736}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.12869137525558472, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.06347479564802987, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.16273278423718043, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.10340808544840133, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.041867545672825406, "sim_compute_performance-ego": 0.07292242986815316, "sim_compute_robot_state-ego": 0.08045358317238945}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.134451048714774, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.05894431613740467, "in-drivable-lane": 0, "agent_compute-ego": 0.15699310529799687, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.10819331804911296, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.040594634555635, "sim_compute_performance-ego": 0.0703417460123698, "sim_compute_robot_state-ego": 0.07577334131513323}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.101647049693738, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.05613200543290478, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.13763864161604542, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.0954720489049362, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.03573831865342997, "sim_compute_performance-ego": 0.06335610858464645, "sim_compute_robot_state-ego": 0.07046964208958513}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.11997684998945755, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.0644646861336448, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.15785719698125666, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.10002633008089933, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.03997471549294212, "sim_compute_performance-ego": 0.07411769953641024, "sim_compute_robot_state-ego": 0.07423527457497336}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.13877824064973113, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.06751295188804726, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.16796347382780794, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.1078834564654858, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.04310830227740399, "sim_compute_performance-ego": 0.07489075598778663, "sim_compute_robot_state-ego": 0.08594622859707127}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.13372445106506348, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.06547355651855469, "in-drivable-lane": 0, "agent_compute-ego": 0.1642141342163086, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.10845414229801724, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.04093139512198312, "sim_compute_performance-ego": 0.07280327592577253, "sim_compute_robot_state-ego": 0.07727540390832084}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.1300793956307804, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.0641325081095976, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.1641879595962225, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.10690711993797151, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.041558419956880456, "sim_compute_performance-ego": 0.07339564491720761, "sim_compute_robot_state-ego": 0.08054917933894139}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.13842570340191876, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.06478438553986726, "in-drivable-lane": 0, "agent_compute-ego": 0.15706675140946, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.1009773854856138, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.04147273522836191, "sim_compute_performance-ego": 0.07139028443230523, "sim_compute_robot_state-ego": 0.07558347560741284}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.12719276372124166, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.06595975277470607, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.16378877910913206, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.10384636533026602, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.040915274152568744, "sim_compute_performance-ego": 0.07444617093778123, "sim_compute_robot_state-ego": 0.07971664970996332}}
set_robot_commands_max	0.13353894738590016
set_robot_commands_mean	0.10579838559040942
set_robot_commands_median	0.10384636533026602
set_robot_commands_min	0.0954720489049362
sim_compute_performance-ego_max	0.08308891896848325
sim_compute_performance-ego_mean	0.0732862427940247
sim_compute_performance-ego_median	0.0739599396200741
sim_compute_performance-ego_min	0.06335610858464645
sim_compute_robot_state-ego_max	0.0953698643931636
sim_compute_robot_state-ego_mean	0.07967957858594274
sim_compute_robot_state-ego_median	0.08045358317238945
sim_compute_robot_state-ego_min	0.06950505256652832
sim_compute_sim_state_max	0.04417810175153944
sim_compute_sim_state_mean	0.04095738097315124
sim_compute_sim_state_median	0.0409451961517334
sim_compute_sim_state_min	0.03573831865342997
sim_physics_max	0.1498718129263984
sim_physics_mean	0.1295028538258733
sim_physics_median	0.1300793956307804
sim_physics_min	0.101647049693738
sim_render-ego_max	0.06974489600570113
sim_render-ego_mean	0.06433868543578453
sim_render-ego_median	0.06478438553986726
sim_render-ego_min	0.05613200543290478
simulation-passed	1
survival_time_max	5.09999999999999
survival_time_mean	2.503333333333331
survival_time_min	0.8500000000000002

No reset possible

22827

2684

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

aido2-LFVI-sim-testing

step1-simulation

error

yes

ip-172-31-25-98-2348

2019-05-17 02:28:27+00:00

2019-05-17 03:02:25+00:00

0:33:58

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22817

2704

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-25-98-2348

2019-05-17 02:07:50+00:00

2019-05-17 02:28:07+00:00

0:20:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4690786702157119
survival_time_median	6.699999999999984
deviation-center-line_median	0.43723008973912375
in-drivable-lane_median	0.30000000000000027

other stats

agent_compute-ego_max	0.1124172169821603
agent_compute-ego_mean	0.10786089040848408
agent_compute-ego_median	0.10713587999343872
agent_compute-ego_min	0.10383313162284984
deviation-center-line_max	1.1001113356478638
deviation-center-line_mean	0.5500121744977544
deviation-center-line_min	0.22790491168772548
deviation-heading_max	4.765786249064606
deviation-heading_mean	2.47491997496173
deviation-heading_median	2.30847155631943
deviation-heading_min	0.4615150699879939
driven_any_max	2.348942849935891
driven_any_mean	1.1643384083031203
driven_any_median	1.0230267571294585
driven_any_min	0.40439861257061344
driven_lanedir_consec_max	1.3229345330603266
driven_lanedir_consec_mean	0.7484811054738307
driven_lanedir_consec_min	0.3149562081743923
driven_lanedir_max	2.063205888072332
driven_lanedir_mean	0.9371390524751284
driven_lanedir_median	0.5179745881688755
driven_lanedir_min	0.3978460021441807
in-drivable-lane_max	2.6499999999999906
in-drivable-lane_mean	0.6999999999999997
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.3356737866289494, "sim_physics": 0.17366333961486816, "survival_time": 8.74999999999999, "driven_lanedir": 1.237590113774542, "sim_render-ego": 0.08208147321428572, "in-drivable-lane": 0, "agent_compute-ego": 0.1124172169821603, "deviation-heading": 2.6693194626371435, "set_robot_commands": 0.14752900532313756, "deviation-center-line": 0.7028691875713812, "driven_lanedir_consec": 1.237590113774542, "sim_compute_sim_state": 0.05027055604117257, "sim_compute_performance-ego": 0.0932267393384661, "sim_compute_robot_state-ego": 0.10942725317818776}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7096500352506895, "sim_physics": 0.1762840371382864, "survival_time": 4.749999999999991, "driven_lanedir": 0.5179745881688755, "sim_render-ego": 0.07936466618588096, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.10678895649157072, "deviation-heading": 2.30847155631943, "set_robot_commands": 0.1438944515429045, "deviation-center-line": 0.43723008973912375, "driven_lanedir_consec": 0.3149562081743923, "sim_compute_sim_state": 0.04925867381848787, "sim_compute_performance-ego": 0.09145562523289733, "sim_compute_robot_state-ego": 0.10659711235447934}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.40439861257061344, "sim_physics": 0.15296790474339536, "survival_time": 2.849999999999998, "driven_lanedir": 0.3978460021441807, "sim_render-ego": 0.07481411883705541, "in-drivable-lane": 0, "agent_compute-ego": 0.10383313162284984, "deviation-heading": 0.4615150699879939, "set_robot_commands": 0.1307845157489442, "deviation-center-line": 0.28194534784267833, "driven_lanedir_consec": 0.3978460021441807, "sim_compute_sim_state": 0.0476942731623064, "sim_compute_performance-ego": 0.08369564173514382, "sim_compute_robot_state-ego": 0.09850845838847912}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0230267571294585, "sim_physics": 0.17613901131188692, "survival_time": 6.699999999999984, "driven_lanedir": 0.4690786702157119, "sim_render-ego": 0.07964091692397844, "in-drivable-lane": 2.6499999999999906, "agent_compute-ego": 0.10912926695240076, "deviation-heading": 2.1695075367994776, "set_robot_commands": 0.1397257811987578, "deviation-center-line": 0.22790491168772548, "driven_lanedir_consec": 0.4690786702157119, "sim_compute_sim_state": 0.04884407235615289, "sim_compute_performance-ego": 0.08942116552324438, "sim_compute_robot_state-ego": 0.1050582768312141}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.348942849935891, "sim_physics": 0.16706646998723348, "survival_time": 14.950000000000076, "driven_lanedir": 2.063205888072332, "sim_render-ego": 0.07924894253412883, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.10713587999343872, "deviation-heading": 4.765786249064606, "set_robot_commands": 0.14324581305185954, "deviation-center-line": 1.1001113356478638, "driven_lanedir_consec": 1.3229345330603266, "sim_compute_sim_state": 0.05035711685816447, "sim_compute_performance-ego": 0.09196914990743, "sim_compute_robot_state-ego": 0.10849599997202557}}
set_robot_commands_max	0.14752900532313756
set_robot_commands_mean	0.14103591337312074
set_robot_commands_median	0.14324581305185954
set_robot_commands_min	0.1307845157489442
sim_compute_performance-ego_max	0.0932267393384661
sim_compute_performance-ego_mean	0.08995366434743632
sim_compute_performance-ego_median	0.09145562523289733
sim_compute_performance-ego_min	0.08369564173514382
sim_compute_robot_state-ego_max	0.10942725317818776
sim_compute_robot_state-ego_mean	0.10561742014487718
sim_compute_robot_state-ego_median	0.10659711235447934
sim_compute_robot_state-ego_min	0.09850845838847912
sim_compute_sim_state_max	0.05035711685816447
sim_compute_sim_state_mean	0.04928493844725684
sim_compute_sim_state_median	0.04925867381848787
sim_compute_sim_state_min	0.0476942731623064
sim_physics_max	0.1762840371382864
sim_physics_mean	0.1692241525591341
sim_physics_median	0.17366333961486816
sim_physics_min	0.15296790474339536
sim_render-ego_max	0.08208147321428572
sim_render-ego_mean	0.07903002353906588
sim_render-ego_median	0.07936466618588096
sim_render-ego_min	0.07481411883705541
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.600000000000008
survival_time_min	2.849999999999998

No reset possible

22809

2720

jiang peng

test for ppo

aido2-LFV-sim-validation

step1-simulation

error

yes

ip-172-31-25-98-2348

2019-05-17 02:06:09+00:00

2019-05-17 02:07:35+00:00

0:01:26

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22803

2738

Bhairav Mehta

challenge-aido_LF-template-ros - Template solution using ROS

aido2-LFVI-sim-testing

step1-simulation

failed

yes

ip-172-31-25-98-2348

2019-05-17 02:03:54+00:00

2019-05-17 02:05:49+00:00

0:01:55

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22796

2750

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

aido2-LFVI-sim-testing

step1-simulation

failed

yes

ip-172-31-25-98-2348

2019-05-17 02:01:11+00:00

2019-05-17 02:03:21+00:00

0:02:10

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22764

2808

Andrea Censi 🇨🇭

challenge-aido_LF-template-random - random_agent

aido2-LFV-sim-testing

step1-simulation

error

yes

ip-172-31-25-98-2348

2019-05-17 01:44:03+00:00

2019-05-17 02:00:58+00:00

0:16:55

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22718

2912

Thies Lennart Alff 🇩🇪

challenge-aido_LF-baseline-duckietown

aido2-LF-sim-testing

step1-simulation

success

yes

ip-172-31-25-98-2348

2019-05-17 01:00:58+00:00

2019-05-17 01:43:40+00:00

0:42:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6837273236612166
survival_time_median	4.94999999999999
deviation-center-line_median	0.43975479509459126
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.12002656748006632
agent_compute-ego_mean	0.10914547419656552
agent_compute-ego_median	0.10892419815063475
agent_compute-ego_min	0.10202478322406744
deviation-center-line_max	1.2721313178412608
deviation-center-line_mean	0.5893348871327595
deviation-center-line_min	0.24410092721481208
deviation-heading_max	6.453263307977294
deviation-heading_mean	2.1546432074673585
deviation-heading_median	1.5129813241786394
deviation-heading_min	0.4373212219820167
driven_any_max	2.348558989556984
driven_any_mean	1.1163339466932387
driven_any_median	0.7418613949850633
driven_any_min	0.4606555285961886
driven_lanedir_consec_max	2.228533937766365
driven_lanedir_consec_mean	0.8987143264747512
driven_lanedir_consec_min	0.1861187831111168
driven_lanedir_max	2.228533937766365
driven_lanedir_mean	0.9622998423487278
driven_lanedir_median	0.6837273236612166
driven_lanedir_min	0.40384149041945183
in-drivable-lane_max	3.3500000000000085
in-drivable-lane_mean	0.35666666666666774
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8064532800860137, "sim_physics": 0.15523818024882563, "survival_time": 5.399999999999989, "driven_lanedir": 0.6729079920553045, "sim_render-ego": 0.07412992583380805, "in-drivable-lane": 0, "agent_compute-ego": 0.11500471830368042, "deviation-heading": 2.338287136023455, "set_robot_commands": 0.11571491206133808, "deviation-center-line": 0.43975479509459126, "driven_lanedir_consec": 0.6729079920553045, "sim_compute_sim_state": 0.045239258695531775, "sim_compute_performance-ego": 0.08333598022107724, "sim_compute_robot_state-ego": 0.11717633406321208}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.341040829581571, "sim_physics": 0.12393541944106952, "survival_time": 14.900000000000077, "driven_lanedir": 2.228533937766365, "sim_render-ego": 0.0698603359644845, "in-drivable-lane": 0, "agent_compute-ego": 0.10202478322406744, "deviation-heading": 3.746017089387239, "set_robot_commands": 0.10757881282960008, "deviation-center-line": 1.2721313178412608, "driven_lanedir_consec": 2.228533937766365, "sim_compute_sim_state": 0.043052817351066024, "sim_compute_performance-ego": 0.07823440452550082, "sim_compute_robot_state-ego": 0.08373634607199855}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.4606555285961886, "sim_physics": 0.13677407056093216, "survival_time": 3.1999999999999966, "driven_lanedir": 0.4557157778087744, "sim_render-ego": 0.06989434733986855, "in-drivable-lane": 0, "agent_compute-ego": 0.10652729496359824, "deviation-heading": 0.4373212219820167, "set_robot_commands": 0.10860570892691612, "deviation-center-line": 0.3530114034861149, "driven_lanedir_consec": 0.4557157778087744, "sim_compute_sim_state": 0.04484963417053223, "sim_compute_performance-ego": 0.07762512564659119, "sim_compute_robot_state-ego": 0.08664089441299438}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2963070546222222, "sim_physics": 0.1366801829565139, "survival_time": 8.399999999999984, "driven_lanedir": 1.1956055366213958, "sim_render-ego": 0.07053653257233757, "in-drivable-lane": 0, "agent_compute-ego": 0.10862772521518524, "deviation-heading": 2.4672483812519808, "set_robot_commands": 0.11170452549344018, "deviation-center-line": 0.6289473405344799, "driven_lanedir_consec": 1.1956055366213958, "sim_compute_sim_state": 0.04343199020340329, "sim_compute_performance-ego": 0.07942006417683192, "sim_compute_robot_state-ego": 0.08549261660802931}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9910417952728108, "sim_physics": 0.14006169759310208, "survival_time": 6.499999999999985, "driven_lanedir": 0.9707966108369646, "sim_render-ego": 0.07042123721196102, "in-drivable-lane": 0, "agent_compute-ego": 0.10745641268216646, "deviation-heading": 1.1334477131845269, "set_robot_commands": 0.10925493423755352, "deviation-center-line": 0.5089338340831535, "driven_lanedir_consec": 0.9707966108369646, "sim_compute_sim_state": 0.04365975489983192, "sim_compute_performance-ego": 0.07897150699908917, "sim_compute_robot_state-ego": 0.08964756635519175}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.115898799782459, "sim_physics": 0.1383212442751284, "survival_time": 13.500000000000057, "driven_lanedir": 1.6291695171631568, "sim_render-ego": 0.07210627131991916, "in-drivable-lane": 1.20000000000001, "agent_compute-ego": 0.10892419815063475, "deviation-heading": 5.369026592114659, "set_robot_commands": 0.11040590339236787, "deviation-center-line": 1.0229304977502416, "driven_lanedir_consec": 1.3534265780820034, "sim_compute_sim_state": 0.04480123696503816, "sim_compute_performance-ego": 0.08088708718617757, "sim_compute_robot_state-ego": 0.09078511220437507}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.7418613949850633, "sim_physics": 0.1449461802087649, "survival_time": 4.94999999999999, "driven_lanedir": 0.6837273236612166, "sim_render-ego": 0.07139319121235549, "in-drivable-lane": 0, "agent_compute-ego": 0.10985164690499354, "deviation-heading": 1.5129813241786394, "set_robot_commands": 0.11173984498688667, "deviation-center-line": 0.24410092721481208, "driven_lanedir_consec": 0.6837273236612166, "sim_compute_sim_state": 0.04472651626124526, "sim_compute_performance-ego": 0.08129466663707387, "sim_compute_robot_state-ego": 0.09159465269608932}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.6454834591129418, "sim_physics": 0.1336477405723484, "survival_time": 4.3499999999999925, "driven_lanedir": 0.6112352152081411, "sim_render-ego": 0.07143242879845631, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.10975946777168362, "deviation-heading": 0.6202910046485036, "set_robot_commands": 0.1085962454477946, "deviation-center-line": 0.4608594616969349, "driven_lanedir_consec": 0.6112352152081411, "sim_compute_sim_state": 0.04501669708339647, "sim_compute_performance-ego": 0.08070861334088204, "sim_compute_robot_state-ego": 0.0874576376772475}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.027646664152992, "sim_physics": 0.131923753782589, "survival_time": 12.950000000000047, "driven_lanedir": 1.9595513614967557, "sim_render-ego": 0.07270508935552766, "in-drivable-lane": 0, "agent_compute-ego": 0.1057048681620005, "deviation-heading": 2.9149126077859, "set_robot_commands": 0.109708799818768, "deviation-center-line": 1.038992644540054, "driven_lanedir_consec": 1.9595513614967557, "sim_compute_sim_state": 0.04395919140701589, "sim_compute_performance-ego": 0.07951601960023857, "sim_compute_robot_state-ego": 0.088360375879354}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.5811742718269185, "sim_physics": 0.1388565347164492, "survival_time": 3.949999999999994, "driven_lanedir": 0.5637689913271047, "sim_render-ego": 0.07222413714927962, "in-drivable-lane": 0, "agent_compute-ego": 0.11086966719808458, "deviation-heading": 0.7612967014824786, "set_robot_commands": 0.10894898523258258, "deviation-center-line": 0.3910991881820957, "driven_lanedir_consec": 0.5637689913271047, "sim_compute_sim_state": 0.04309451429149772, "sim_compute_performance-ego": 0.07998615276964405, "sim_compute_robot_state-ego": 0.0890907698039767}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.348558989556984, "sim_physics": 0.1363701860109965, "survival_time": 14.950000000000076, "driven_lanedir": 1.4095235539750124, "sim_render-ego": 0.07097516059875489, "in-drivable-lane": 3.3500000000000085, "agent_compute-ego": 0.114320334593455, "deviation-heading": 6.453263307977294, "set_robot_commands": 0.1166515080134074, "deviation-center-line": 1.0002895414500463, "driven_lanedir_consec": 0.9492064622548524, "sim_compute_sim_state": 0.045437937577565514, "sim_compute_performance-ego": 0.07995086352030437, "sim_compute_robot_state-ego": 0.08945116837819417}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4847565051971733, "sim_physics": 0.1487763675291147, "survival_time": 3.349999999999996, "driven_lanedir": 0.44459564370011984, "sim_render-ego": 0.07107957797263985, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.10895649710697916, "deviation-heading": 0.6586166088826472, "set_robot_commands": 0.11068138079856758, "deviation-center-line": 0.27386050672666606, "driven_lanedir_consec": 0.44459564370011984, "sim_compute_sim_state": 0.04941520406239068, "sim_compute_performance-ego": 0.10736167252953371, "sim_compute_robot_state-ego": 0.09011587811939752}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.6774666548068774, "sim_physics": 0.14349046120276818, "survival_time": 4.549999999999992, "driven_lanedir": 0.40384149041945183, "sim_render-ego": 0.07384252548217773, "in-drivable-lane": 0.49999999999999933, "agent_compute-ego": 0.12002656748006632, "deviation-heading": 2.565445460771033, "set_robot_commands": 0.11146619031717488, "deviation-center-line": 0.3832243427749023, "driven_lanedir_consec": 0.1861187831111168, "sim_compute_sim_state": 0.04383364876548013, "sim_compute_performance-ego": 0.08148563301170265, "sim_compute_robot_state-ego": 0.08755168547997108}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.7097753079948844, "sim_physics": 0.14662983292027523, "survival_time": 4.749999999999991, "driven_lanedir": 0.6989490370993754, "sim_render-ego": 0.06919146086040297, "in-drivable-lane": 0, "agent_compute-ego": 0.10290822982788086, "deviation-heading": 0.7571929715418617, "set_robot_commands": 0.10792202196623148, "deviation-center-line": 0.4335018814922893, "driven_lanedir_consec": 0.6989490370993754, "sim_compute_sim_state": 0.04276863650271767, "sim_compute_performance-ego": 0.08115842216893246, "sim_compute_robot_state-ego": 0.0855759997116892}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.5168886648234753, "sim_physics": 0.12977880491337307, "survival_time": 3.5499999999999954, "driven_lanedir": 0.5065756460917794, "sim_render-ego": 0.0687989718477491, "in-drivable-lane": 0, "agent_compute-ego": 0.1062197013640068, "deviation-heading": 0.5842999907981381, "set_robot_commands": 0.10735787472254792, "deviation-center-line": 0.38838562412375144, "driven_lanedir_consec": 0.5065756460917794, "sim_compute_sim_state": 0.04344510024702045, "sim_compute_performance-ego": 0.07821351373699349, "sim_compute_robot_state-ego": 0.08741294833975778}}
set_robot_commands_max	0.1166515080134074
set_robot_commands_mean	0.11042250988301182
set_robot_commands_median	0.109708799818768
set_robot_commands_min	0.10735787472254792
sim_compute_performance-ego_max	0.10736167252953371
sim_compute_performance-ego_mean	0.08187664840470489
sim_compute_performance-ego_median	0.07998615276964405
sim_compute_performance-ego_min	0.07762512564659119
sim_compute_robot_state-ego_max	0.11717633406321208
sim_compute_robot_state-ego_mean	0.0900059990534319
sim_compute_robot_state-ego_median	0.088360375879354
sim_compute_robot_state-ego_min	0.08373634607199855
sim_compute_sim_state_max	0.04941520406239068
sim_compute_sim_state_mean	0.04444880923224888
sim_compute_sim_state_median	0.04395919140701589
sim_compute_sim_state_min	0.04276863650271767
sim_physics_max	0.15523818024882563
sim_physics_mean	0.13902871046215007
sim_physics_median	0.1383212442751284
sim_physics_min	0.12393541944106952
sim_render-ego_max	0.07412992583380805
sim_render-ego_mean	0.07123941290131483
sim_render-ego_median	0.07107957797263985
sim_render-ego_min	0.0687989718477491
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.283333333333344
survival_time_min	3.1999999999999966

No reset possible

22638

3064

Angel Woo 🇭🇰

Baseline-IL-logs-tensorflow

aido2-LF-sim-testing

step1-simulation

error

yes

ip-172-31-25-98-2348

2019-05-17 00:00:47+00:00

2019-05-17 01:00:31+00:00

0:59:44

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22607

3112

Angel Woo 🇭🇰

HKU Duckietown Project

aido2-LF-sim-validation

step1-simulation

error

yes

ip-172-31-25-98-2348

2019-05-16 23:28:55+00:00

2019-05-17 00:00:25+00:00

0:31:30

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22584

3131

FANG MEIYI 🇸🇬

test

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-25-98-2348

2019-05-16 23:00:38+00:00

2019-05-16 23:28:34+00:00

0:27:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.617101099302686
survival_time_median	14.950000000000076
deviation-center-line_median	0.711561120073908
in-drivable-lane_median	0.10000000000000142

other stats

agent_compute-ego_max	0.19362216552098593
agent_compute-ego_mean	0.1817063414365396
agent_compute-ego_median	0.18054336865743
agent_compute-ego_min	0.16634554386138917
deviation-center-line_max	0.877374497707077
deviation-center-line_mean	0.6431859473680189
deviation-center-line_min	0.30949867095295225
deviation-heading_max	3.373141059224481
deviation-heading_mean	2.3371645655672615
deviation-heading_median	2.534615641386155
deviation-heading_min	1.2744894179398418
driven_any_max	4.002414967673113
driven_any_mean	3.389373687226191
driven_any_median	3.749060757253467
driven_any_min	1.7251577151264474
driven_lanedir_consec_max	3.957438556809131
driven_lanedir_consec_mean	3.10510675350678
driven_lanedir_consec_min	1.279642849542992
driven_lanedir_max	3.957438556809131
driven_lanedir_mean	3.10510675350678
driven_lanedir_median	3.617101099302686
driven_lanedir_min	1.279642849542992
in-drivable-lane_max	2.15000000000001
in-drivable-lane_mean	0.7800000000000014
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.7191142290033494, "sim_physics": 0.13416233777999878, "survival_time": 14.950000000000076, "driven_lanedir": 3.013606641518879, "sim_render-ego": 0.07150211572647094, "in-drivable-lane": 2.15000000000001, "agent_compute-ego": 0.18054336865743, "deviation-heading": 3.373141059224481, "set_robot_commands": 0.10753186623255412, "deviation-center-line": 0.7990775327760852, "driven_lanedir_consec": 3.013606641518879, "sim_compute_sim_state": 0.04459389607111613, "sim_compute_performance-ego": 0.07703720649083455, "sim_compute_robot_state-ego": 0.08650968790054321}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.002414967673113, "sim_physics": 0.13864112695058187, "survival_time": 14.950000000000076, "driven_lanedir": 3.957438556809131, "sim_render-ego": 0.07327325820922852, "in-drivable-lane": 0.10000000000000142, "agent_compute-ego": 0.1801846957206726, "deviation-heading": 1.2744894179398418, "set_robot_commands": 0.11062690496444702, "deviation-center-line": 0.5184179153300725, "driven_lanedir_consec": 3.957438556809131, "sim_compute_sim_state": 0.04555925210316976, "sim_compute_performance-ego": 0.08118326743443807, "sim_compute_robot_state-ego": 0.08778353929519653}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.7511207670745783, "sim_physics": 0.11643500566482544, "survival_time": 14.950000000000076, "driven_lanedir": 3.657744620360214, "sim_render-ego": 0.06469310522079467, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.16634554386138917, "deviation-heading": 2.534615641386155, "set_robot_commands": 0.10245052337646483, "deviation-center-line": 0.711561120073908, "driven_lanedir_consec": 3.657744620360214, "sim_compute_sim_state": 0.04133769989013672, "sim_compute_performance-ego": 0.07612211386362712, "sim_compute_robot_state-ego": 0.07914251645406087}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.7251577151264474, "sim_physics": 0.14646209190631734, "survival_time": 7.249999999999982, "driven_lanedir": 1.279642849542992, "sim_render-ego": 0.0745644684495597, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.18783593342222016, "deviation-heading": 1.441969918161954, "set_robot_commands": 0.11646610457321692, "deviation-center-line": 0.30949867095295225, "driven_lanedir_consec": 1.279642849542992, "sim_compute_sim_state": 0.05088451155300798, "sim_compute_performance-ego": 0.08829161874179182, "sim_compute_robot_state-ego": 0.09239204340967638}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.749060757253467, "sim_physics": 0.14329859733581543, "survival_time": 14.950000000000076, "driven_lanedir": 3.617101099302686, "sim_render-ego": 0.07414053360621134, "in-drivable-lane": 0, "agent_compute-ego": 0.19362216552098593, "deviation-heading": 3.061606791123876, "set_robot_commands": 0.11704360326131184, "deviation-center-line": 0.877374497707077, "driven_lanedir_consec": 3.617101099302686, "sim_compute_sim_state": 0.04523700952529907, "sim_compute_performance-ego": 0.08213668902715048, "sim_compute_robot_state-ego": 0.09346072514851889}}
set_robot_commands_max	0.11704360326131184
set_robot_commands_mean	0.11082380048159894
set_robot_commands_median	0.11062690496444702
set_robot_commands_min	0.10245052337646483
sim_compute_performance-ego_max	0.08829161874179182
sim_compute_performance-ego_mean	0.08095417911156841
sim_compute_performance-ego_median	0.08118326743443807
sim_compute_performance-ego_min	0.07612211386362712
sim_compute_robot_state-ego_max	0.09346072514851889
sim_compute_robot_state-ego_mean	0.08785770244159917
sim_compute_robot_state-ego_median	0.08778353929519653
sim_compute_robot_state-ego_min	0.07914251645406087
sim_compute_sim_state_max	0.05088451155300798
sim_compute_sim_state_mean	0.04552247382854593
sim_compute_sim_state_median	0.04523700952529907
sim_compute_sim_state_min	0.04133769989013672
sim_physics_max	0.14646209190631734
sim_physics_mean	0.13579983192750775
sim_physics_median	0.13864112695058187
sim_physics_min	0.11643500566482544
sim_render-ego_max	0.0745644684495597
sim_render-ego_mean	0.07163469624245304
sim_render-ego_median	0.07327325820922852
sim_render-ego_min	0.06469310522079467
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	13.41000000000006
survival_time_min	7.249999999999982

No reset possible

22578

3145

Amaury Camus 🇨🇭

challenge-aido_LF-template-random

aido2-LFVI-sim-testing

step1-simulation

error

yes

ip-172-31-25-98-2348

2019-05-16 22:57:45+00:00

2019-05-16 23:00:23+00:00

0:02:38

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22543

3194

Anastasiya Nikolskaya 🇷🇺

NN Solution

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-25-98-2348

2019-05-16 22:24:56+00:00

2019-05-16 22:57:06+00:00

0:32:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.629311701750337
survival_time_median	14.950000000000076
deviation-center-line_median	1.166749464384669
in-drivable-lane_median	1.500000000000021

other stats

agent_compute-ego_max	0.13429651625694766
agent_compute-ego_mean	0.12206669491080828
agent_compute-ego_median	0.1253884251912435
agent_compute-ego_min	0.10367717146873474
deviation-center-line_max	1.2708341676647292
deviation-center-line_mean	1.1392588507889063
deviation-center-line_min	0.9699150188727628
deviation-heading_max	4.4159108724531695
deviation-heading_mean	2.7139488184154765
deviation-heading_median	2.552084092057888
deviation-heading_min	1.663945038461588
driven_any_max	3.166262129942749
driven_any_mean	3.0125188841217483
driven_any_median	3.166190784559404
driven_any_min	2.6138117416841937
driven_lanedir_consec_max	2.8343839617100715
driven_lanedir_consec_mean	2.577536766844722
driven_lanedir_consec_min	2.170684989044296
driven_lanedir_max	2.8343839617100715
driven_lanedir_mean	2.577536766844722
driven_lanedir_median	2.629311701750337
driven_lanedir_min	2.170684989044296
in-drivable-lane_max	2.1999999999999993
in-drivable-lane_mean	1.4800000000000069
in-drivable-lane_min	0.5500000000000016
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.9500988022453023, "sim_physics": 0.13704003691673278, "survival_time": 14.000000000000064, "driven_lanedir": 2.6171896015678646, "sim_render-ego": 0.06674133709498814, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.10367717146873474, "deviation-heading": 1.663945038461588, "set_robot_commands": 0.10603516612734114, "deviation-center-line": 1.2042202867491156, "driven_lanedir_consec": 2.6171896015678646, "sim_compute_sim_state": 0.041812052897044594, "sim_compute_performance-ego": 0.07505309666906085, "sim_compute_robot_state-ego": 0.08213000297546387}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.1662309621770923, "sim_physics": 0.14776613791783652, "survival_time": 14.950000000000076, "driven_lanedir": 2.636113580151043, "sim_render-ego": 0.07414509455362955, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.12013557434082033, "deviation-heading": 3.009453511496972, "set_robot_commands": 0.1232406767209371, "deviation-center-line": 1.0845753162732552, "driven_lanedir_consec": 2.636113580151043, "sim_compute_sim_state": 0.04647897958755493, "sim_compute_performance-ego": 0.08452533880869548, "sim_compute_robot_state-ego": 0.09694170236587524}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.166262129942749, "sim_physics": 0.15832056760787963, "survival_time": 14.950000000000076, "driven_lanedir": 2.629311701750337, "sim_render-ego": 0.07695900678634643, "in-drivable-lane": 2.1999999999999993, "agent_compute-ego": 0.12683578729629516, "deviation-heading": 1.9283505776077656, "set_robot_commands": 0.12569911321004232, "deviation-center-line": 1.166749464384669, "driven_lanedir_consec": 2.629311701750337, "sim_compute_sim_state": 0.04807735602060954, "sim_compute_performance-ego": 0.0904836098353068, "sim_compute_robot_state-ego": 0.0994762635231018}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.166190784559404, "sim_physics": 0.14827953497568766, "survival_time": 14.950000000000076, "driven_lanedir": 2.8343839617100715, "sim_render-ego": 0.07495972474416097, "in-drivable-lane": 0.5500000000000016, "agent_compute-ego": 0.1253884251912435, "deviation-heading": 4.4159108724531695, "set_robot_commands": 0.1270972768465678, "deviation-center-line": 1.2708341676647292, "driven_lanedir_consec": 2.8343839617100715, "sim_compute_sim_state": 0.04742502450942993, "sim_compute_performance-ego": 0.08522181908289592, "sim_compute_robot_state-ego": 0.10302061716715497}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.6138117416841937, "sim_physics": 0.12135505195586913, "survival_time": 12.40000000000004, "driven_lanedir": 2.170684989044296, "sim_render-ego": 0.06664725272886214, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.13429651625694766, "deviation-heading": 2.552084092057888, "set_robot_commands": 0.10628740056868524, "deviation-center-line": 0.9699150188727628, "driven_lanedir_consec": 2.170684989044296, "sim_compute_sim_state": 0.04237213634675549, "sim_compute_performance-ego": 0.07479949535862092, "sim_compute_robot_state-ego": 0.08159278669664936}}
set_robot_commands_max	0.1270972768465678
set_robot_commands_mean	0.11767192669471473
set_robot_commands_median	0.1232406767209371
set_robot_commands_min	0.10603516612734114
sim_compute_performance-ego_max	0.0904836098353068
sim_compute_performance-ego_mean	0.08201667195091598
sim_compute_performance-ego_median	0.08452533880869548
sim_compute_performance-ego_min	0.07479949535862092
sim_compute_robot_state-ego_max	0.10302061716715497
sim_compute_robot_state-ego_mean	0.09263227454564904
sim_compute_robot_state-ego_median	0.09694170236587524
sim_compute_robot_state-ego_min	0.08159278669664936
sim_compute_sim_state_max	0.04807735602060954
sim_compute_sim_state_mean	0.045233109872278895
sim_compute_sim_state_median	0.04647897958755493
sim_compute_sim_state_min	0.041812052897044594
sim_physics_max	0.15832056760787963
sim_physics_mean	0.14255226587480113
sim_physics_median	0.14776613791783652
sim_physics_min	0.12135505195586913
sim_render-ego_max	0.07695900678634643
sim_render-ego_mean	0.07189048318159744
sim_render-ego_median	0.07414509455362955
sim_render-ego_min	0.06664725272886214
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.250000000000068
survival_time_min	12.40000000000004

No reset possible

22528

3216

Amaury Camus 🇨🇭

challenge-aido_LF-template-random

aido2-LFV-sim-testing

step1-simulation

success

yes

ip-172-31-25-98-2348

2019-05-16 22:00:58+00:00

2019-05-16 22:24:18+00:00

0:23:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.47061816984274774
survival_time_median	2.4499999999999993
deviation-center-line_median	0.09047885846140293
in-drivable-lane_median	0.7999999999999974

other stats

agent_compute-ego_max	0.18558798053047873
agent_compute-ego_mean	0.16771302538803143
agent_compute-ego_median	0.16839048597547743
agent_compute-ego_min	0.14556263111255788
deviation-center-line_max	0.1743913456502906
deviation-center-line_mean	0.11122054568266285
deviation-center-line_min	0.05649185041622204
deviation-heading_max	0.8583234710357402
deviation-heading_mean	0.371509805944231
deviation-heading_median	0.3477435217829391
deviation-heading_min	0.1892537419842091
driven_any_max	1.6169932854589035
driven_any_mean	0.8549136794030617
driven_any_median	0.9441796518284096
driven_any_min	0.28668385087664994
driven_lanedir_consec_max	1.2433038249708377
driven_lanedir_consec_mean	0.5622432991481365
driven_lanedir_consec_min	0.24216121529728207
driven_lanedir_max	1.2433038249708377
driven_lanedir_mean	0.5622432991481365
driven_lanedir_median	0.47061816984274774
driven_lanedir_min	0.24216121529728207
in-drivable-lane_max	1.3499999999999996
in-drivable-lane_mean	0.5899999999999992
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1841918539117884, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06669935915205213, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.16640047232309976, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10531156151383012, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.041582712420710814, "sim_compute_performance-ego": 0.07146479906859221, "sim_compute_robot_state-ego": 0.07916772365570068, "sim_compute_robot_state-npc0": 0.07364228478184452, "sim_compute_robot_state-npc1": 0.07344466668588144, "sim_compute_robot_state-npc2": 0.07316720927203144, "sim_compute_robot_state-npc3": 0.07280545322983353}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.21964591026306152, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.07006390571594238, "in-drivable-lane": 0, "agent_compute-ego": 0.17868724822998047, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.10256429672241212, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.042442426681518555, "sim_compute_performance-ego": 0.07575247764587402, "sim_compute_robot_state-ego": 0.08479806900024414, "sim_compute_robot_state-npc0": 0.07886828422546387, "sim_compute_robot_state-npc1": 0.0771558952331543, "sim_compute_robot_state-npc2": 0.07662708282470704, "sim_compute_robot_state-npc3": 0.0742447566986084}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.2059096662621749, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.0669531037932948, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.173457638213509, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.10395438420145137, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.04330487627732126, "sim_compute_performance-ego": 0.07568341179897911, "sim_compute_robot_state-ego": 0.08218082628752056, "sim_compute_robot_state-npc0": 0.07374032233890734, "sim_compute_robot_state-npc1": 0.07363101369456242, "sim_compute_robot_state-npc2": 0.07787485812839709, "sim_compute_robot_state-npc3": 0.0791799551562259}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.20940720884105823, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.06664753563796418, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.16548979735072655, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.10545239871061302, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.04409139669394192, "sim_compute_performance-ego": 0.0730357592618918, "sim_compute_robot_state-ego": 0.0792756442782245, "sim_compute_robot_state-npc0": 0.07651343526719492, "sim_compute_robot_state-npc1": 0.07490334933317161, "sim_compute_robot_state-npc2": 0.07388515713848645, "sim_compute_robot_state-npc3": 0.07342706752728813}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.19379250492368424, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06942329236439296, "in-drivable-lane": 0, "agent_compute-ego": 0.15940514632633754, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.10563452754701888, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.04263894047055926, "sim_compute_performance-ego": 0.07317190510886055, "sim_compute_robot_state-ego": 0.08617837088448661, "sim_compute_robot_state-npc0": 0.07463194642748151, "sim_compute_robot_state-npc1": 0.07769771984645299, "sim_compute_robot_state-npc2": 0.07616837535585676, "sim_compute_robot_state-npc3": 0.07736774001802717}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.16098683410220677, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.0560035264050519, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.14556263111255788, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.08803979555765788, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.03694372265427201, "sim_compute_performance-ego": 0.06427836859667743, "sim_compute_robot_state-ego": 0.06916160053677028, "sim_compute_robot_state-npc0": 0.06520439518822564, "sim_compute_robot_state-npc1": 0.06269454073022913, "sim_compute_robot_state-npc2": 0.06127713786231147, "sim_compute_robot_state-npc3": 0.06319104742120814}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.16885932286580405, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.0614050582603172, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.16021750149903474, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.0971367800677264, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.041023435416045015, "sim_compute_performance-ego": 0.06656101897910789, "sim_compute_robot_state-ego": 0.06920925776163737, "sim_compute_robot_state-npc0": 0.06679706220273618, "sim_compute_robot_state-npc1": 0.06641137599945068, "sim_compute_robot_state-npc2": 0.06835721157215259, "sim_compute_robot_state-npc3": 0.06923619464591697}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.2293098025851779, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.06963152355617946, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.16839048597547743, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.10285886128743488, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.04301788542005751, "sim_compute_performance-ego": 0.07284389601813422, "sim_compute_robot_state-ego": 0.09412121772766112, "sim_compute_robot_state-npc0": 0.07714955541822645, "sim_compute_robot_state-npc1": 0.07568264537387424, "sim_compute_robot_state-npc2": 0.07439694404602051, "sim_compute_robot_state-npc3": 0.07163724369472928}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.18127056308414624, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.06602502905804178, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.1767899990081787, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.10118246078491212, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.04395038666932479, "sim_compute_performance-ego": 0.07453404820483664, "sim_compute_robot_state-ego": 0.07869316702303679, "sim_compute_robot_state-npc0": 0.07440162741619608, "sim_compute_robot_state-npc1": 0.07183959691420845, "sim_compute_robot_state-npc2": 0.07199816081834876, "sim_compute_robot_state-npc3": 0.07250842322473941}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.22980791568756104, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.06464943885803223, "in-drivable-lane": 0, "agent_compute-ego": 0.16442211151123046, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.10584687232971192, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.04356727600097656, "sim_compute_performance-ego": 0.07479335308074951, "sim_compute_robot_state-ego": 0.08168753623962402, "sim_compute_robot_state-npc0": 0.07355381965637207, "sim_compute_robot_state-npc1": 0.07346429347991944, "sim_compute_robot_state-npc2": 0.0725813341140747, "sim_compute_robot_state-npc3": 0.07424563884735108}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.22942489385604856, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.059107851982116696, "in-drivable-lane": 0, "agent_compute-ego": 0.15398484468460083, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.0966774582862854, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.04213227033615112, "sim_compute_performance-ego": 0.06652286052703857, "sim_compute_robot_state-ego": 0.07736668586730958, "sim_compute_robot_state-npc0": 0.06710387468338012, "sim_compute_robot_state-npc1": 0.068203604221344, "sim_compute_robot_state-npc2": 0.06819850206375122, "sim_compute_robot_state-npc3": 0.07170964479446411}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.22171833640650696, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.0748570718263325, "in-drivable-lane": 0, "agent_compute-ego": 0.17415590035287956, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.10918997463427092, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.04681139243276496, "sim_compute_performance-ego": 0.07869623836718108, "sim_compute_robot_state-ego": 0.0873847760652241, "sim_compute_robot_state-npc0": 0.08446591778805382, "sim_compute_robot_state-npc1": 0.08519035891482704, "sim_compute_robot_state-npc2": 0.07840618334318462, "sim_compute_robot_state-npc3": 0.07815299536052503}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.18161917209625245, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.06906653881072998, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.17349743843078613, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.10214418888092042, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.04325260162353515, "sim_compute_performance-ego": 0.07658947467803955, "sim_compute_robot_state-ego": 0.07686699390411376, "sim_compute_robot_state-npc0": 0.0738038969039917, "sim_compute_robot_state-npc1": 0.07555490493774414, "sim_compute_robot_state-npc2": 0.07496204853057861, "sim_compute_robot_state-npc3": 0.07585082530975341}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.2331175370649858, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.07461444898085161, "in-drivable-lane": 0, "agent_compute-ego": 0.18558798053047873, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.11516994779760188, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.043981042775240814, "sim_compute_performance-ego": 0.0835910818793557, "sim_compute_robot_state-ego": 0.0879405520179055, "sim_compute_robot_state-npc0": 0.07471727241169322, "sim_compute_robot_state-npc1": 0.07754746350375089, "sim_compute_robot_state-npc2": 0.07853617451407692, "sim_compute_robot_state-npc3": 0.07768203995444557}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.2333805415095115, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.0749469873856525, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.169646185271594, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.10251868014432948, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.04430532455444336, "sim_compute_performance-ego": 0.07606752064763284, "sim_compute_robot_state-ego": 0.08100746115859674, "sim_compute_robot_state-npc0": 0.07646169467848174, "sim_compute_robot_state-npc1": 0.07699213222581514, "sim_compute_robot_state-npc2": 0.07642358176562251, "sim_compute_robot_state-npc3": 0.07561824759658502}}
set_robot_commands_max	0.11516994779760188
set_robot_commands_mean	0.10291214589774512
set_robot_commands_median	0.10285886128743488
set_robot_commands_min	0.08803979555765788
sim_compute_performance-ego_max	0.0835910818793557
sim_compute_performance-ego_mean	0.07357241425753007
sim_compute_performance-ego_median	0.07453404820483664
sim_compute_performance-ego_min	0.06427836859667743
sim_compute_robot_state-ego_max	0.09412121772766112
sim_compute_robot_state-ego_mean	0.08100265882720371
sim_compute_robot_state-ego_median	0.08100746115859674
sim_compute_robot_state-ego_min	0.06916160053677028
sim_compute_robot_state-npc0_max	0.08446591778805382
sim_compute_robot_state-npc0_mean	0.07407035929254994
sim_compute_robot_state-npc0_median	0.07440162741619608
sim_compute_robot_state-npc0_min	0.06520439518822564
sim_compute_robot_state-npc1_max	0.08519035891482704
sim_compute_robot_state-npc1_mean	0.07402757073962575
sim_compute_robot_state-npc1_median	0.07490334933317161
sim_compute_robot_state-npc1_min	0.06269454073022913
sim_compute_robot_state-npc2_max	0.07853617451407692
sim_compute_robot_state-npc2_mean	0.0735239974233067
sim_compute_robot_state-npc2_median	0.07439694404602051
sim_compute_robot_state-npc2_min	0.06127713786231147
sim_compute_robot_state-npc3_max	0.0791799551562259
sim_compute_robot_state-npc3_mean	0.07379048489864674
sim_compute_robot_state-npc3_median	0.0742447566986084
sim_compute_robot_state-npc3_min	0.06319104742120814
sim_compute_sim_state_max	0.04681139243276496
sim_compute_sim_state_mean	0.042869712695124206
sim_compute_sim_state_median	0.04325260162353515
sim_compute_sim_state_min	0.03694372265427201
sim_physics_max	0.2333805415095115
sim_physics_mean	0.20549613756399793
sim_physics_median	0.20940720884105823
sim_physics_min	0.16098683410220677
sim_render-ego_max	0.0749469873856525
sim_render-ego_mean	0.0673396447857968
sim_render-ego_median	0.0669531037932948
sim_render-ego_min	0.0560035264050519
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2366666666666655
survival_time_min	0.9500000000000004

No reset possible

22511

3229

Anastasiya Nikolskaya 🇷🇺

JetBrains Research

aido2-LF-sim-validation

step1-simulation

error

yes

ip-172-31-25-98-2348

2019-05-16 21:42:53+00:00

2019-05-16 22:00:24+00:00

0:17:31

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22494

3247

jiang peng

Second test - TH-jp

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-25-98-2348

2019-05-16 21:21:50+00:00

2019-05-16 21:41:39+00:00

0:19:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5596565733719423
survival_time_median	10.800000000000018
deviation-center-line_median	0.5671600550797875
in-drivable-lane_median	0.04999999999999982

other stats

agent_compute-ego_max	0.2261832314868306
agent_compute-ego_mean	0.1962467015214669
agent_compute-ego_median	0.1969100856781006
agent_compute-ego_min	0.1756893131468031
deviation-center-line_max	1.124938355788923
deviation-center-line_mean	0.5812679504545528
deviation-center-line_min	0.1261533445581102
deviation-heading_max	4.3726995102305874
deviation-heading_mean	2.3174008349246344
deviation-heading_median	2.084871420130781
deviation-heading_min	0.41315362683425194
driven_any_max	1.6745437771728102
driven_any_mean	0.8757069433090461
driven_any_median	0.9660902294304492
driven_any_min	0.19354399246117937
driven_lanedir_consec_max	1.550772048477315
driven_lanedir_consec_mean	0.6715841674259363
driven_lanedir_consec_min	0.10417562562544712
driven_lanedir_max	1.550772048477315
driven_lanedir_mean	0.6715841674259363
driven_lanedir_median	0.5596565733719423
driven_lanedir_min	0.10417562562544712
in-drivable-lane_max	4.000000000000057
in-drivable-lane_mean	1.1600000000000164
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5327928850398237, "sim_physics": 0.12774700588650173, "survival_time": 1.800000000000001, "driven_lanedir": 0.511911966791792, "sim_render-ego": 0.06749047173394097, "in-drivable-lane": 0, "agent_compute-ego": 0.18078695403205025, "deviation-heading": 0.41315362683425194, "set_robot_commands": 0.10182412465413412, "deviation-center-line": 0.1261533445581102, "driven_lanedir_consec": 0.511911966791792, "sim_compute_sim_state": 0.042884502145979136, "sim_compute_performance-ego": 0.07693380779690212, "sim_compute_robot_state-ego": 0.08021222220526801}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.6745437771728102, "sim_physics": 0.1064600701685305, "survival_time": 10.800000000000018, "driven_lanedir": 1.550772048477315, "sim_render-ego": 0.0610081034678, "in-drivable-lane": 0, "agent_compute-ego": 0.1756893131468031, "deviation-heading": 2.084871420130781, "set_robot_commands": 0.09681489180635525, "deviation-center-line": 0.5671600550797875, "driven_lanedir_consec": 1.550772048477315, "sim_compute_sim_state": 0.03879894371385927, "sim_compute_performance-ego": 0.06857669905379966, "sim_compute_robot_state-ego": 0.07377767342108267}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.19354399246117937, "sim_physics": 0.1568164437316185, "survival_time": 2.1500000000000004, "driven_lanedir": 0.10417562562544712, "sim_render-ego": 0.07087900472241779, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.2261832314868306, "deviation-heading": 0.9850709572733976, "set_robot_commands": 0.13036001005838083, "deviation-center-line": 0.16507728968636384, "driven_lanedir_consec": 0.10417562562544712, "sim_compute_sim_state": 0.04499787508055221, "sim_compute_performance-ego": 0.07965923464575479, "sim_compute_robot_state-ego": 0.09796881121258404}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.011563832440968, "sim_physics": 0.13263903617858885, "survival_time": 14.950000000000076, "driven_lanedir": 0.5596565733719423, "sim_render-ego": 0.0721737813949585, "in-drivable-lane": 4.000000000000057, "agent_compute-ego": 0.1969100856781006, "deviation-heading": 4.3726995102305874, "set_robot_commands": 0.11288957277933756, "deviation-center-line": 0.9230107071595796, "driven_lanedir_consec": 0.5596565733719423, "sim_compute_sim_state": 0.044376219113667806, "sim_compute_performance-ego": 0.0810410475730896, "sim_compute_robot_state-ego": 0.08734339872996012}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9660902294304492, "sim_physics": 0.14244970480600994, "survival_time": 14.950000000000076, "driven_lanedir": 0.6314046228631849, "sim_render-ego": 0.07209373950958252, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.20166392326354984, "deviation-heading": 3.7312086601541545, "set_robot_commands": 0.11270405371983848, "deviation-center-line": 1.124938355788923, "driven_lanedir_consec": 0.6314046228631849, "sim_compute_sim_state": 0.04430101156234741, "sim_compute_performance-ego": 0.07998756647109985, "sim_compute_robot_state-ego": 0.09116706848144532}}
set_robot_commands_max	0.13036001005838083
set_robot_commands_mean	0.11091853060360923
set_robot_commands_median	0.11270405371983848
set_robot_commands_min	0.09681489180635525
sim_compute_performance-ego_max	0.0810410475730896
sim_compute_performance-ego_mean	0.07723967110812921
sim_compute_performance-ego_median	0.07965923464575479
sim_compute_performance-ego_min	0.06857669905379966
sim_compute_robot_state-ego_max	0.09796881121258404
sim_compute_robot_state-ego_mean	0.08609383481006802
sim_compute_robot_state-ego_median	0.08734339872996012
sim_compute_robot_state-ego_min	0.07377767342108267
sim_compute_sim_state_max	0.04499787508055221
sim_compute_sim_state_mean	0.04307171032328117
sim_compute_sim_state_median	0.04430101156234741
sim_compute_sim_state_min	0.03879894371385927
sim_physics_max	0.1568164437316185
sim_physics_mean	0.1332224521542499
sim_physics_median	0.13263903617858885
sim_physics_min	0.1064600701685305
sim_render-ego_max	0.0721737813949585
sim_render-ego_mean	0.06872902016573997
sim_render-ego_median	0.07087900472241779
sim_render-ego_min	0.0610081034678
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.930000000000035
survival_time_min	1.800000000000001

No reset possible

22473

3272

jiang peng

First test - TH

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-25-98-2348

2019-05-16 21:00:39+00:00

2019-05-16 21:21:03+00:00

0:20:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.8791878388178453
survival_time_median	14.950000000000076
deviation-center-line_median	1.0068115058068483
in-drivable-lane_median	0.70000000000001

other stats

agent_compute-ego_max	0.18681149085362753
agent_compute-ego_mean	0.1811549825754886
agent_compute-ego_median	0.1848308030764262
agent_compute-ego_min	0.1680518193031425
deviation-center-line_max	1.5255806720399998
deviation-center-line_mean	0.8703745408820108
deviation-center-line_min	0.12849809775768825
deviation-heading_max	4.250901041621015
deviation-heading_mean	2.3223253256878893
deviation-heading_median	1.8479351494163512
deviation-heading_min	1.0801363088124232
driven_any_max	4.054488063422768
driven_any_mean	2.637942178688946
driven_any_median	3.4800977061194622
driven_any_min	0.597729151470974
driven_lanedir_consec_max	3.258990110186864
driven_lanedir_consec_mean	2.190193506346677
driven_lanedir_consec_min	0.5459665050925957
driven_lanedir_max	3.258990110186864
driven_lanedir_mean	2.190193506346677
driven_lanedir_median	2.8791878388178453
driven_lanedir_min	0.5459665050925957
in-drivable-lane_max	2.7000000000000384
in-drivable-lane_mean	1.1700000000000157
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.597729151470974, "sim_physics": 0.10814864955731292, "survival_time": 3.349999999999996, "driven_lanedir": 0.5459665050925957, "sim_render-ego": 0.057413766633218795, "in-drivable-lane": 0, "agent_compute-ego": 0.1680518193031425, "deviation-heading": 1.1365180804823618, "set_robot_commands": 0.0871708464266649, "deviation-center-line": 0.12849809775768825, "driven_lanedir_consec": 0.5459665050925957, "sim_compute_sim_state": 0.03431418048801707, "sim_compute_performance-ego": 0.06673348839603253, "sim_compute_robot_state-ego": 0.07223958755607035}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.338343711483321, "sim_physics": 0.11697643667786986, "survival_time": 4.549999999999992, "driven_lanedir": 1.0966422494166566, "sim_render-ego": 0.061543524920285406, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1805249203692426, "deviation-heading": 1.0801363088124232, "set_robot_commands": 0.11026072240137792, "deviation-center-line": 0.46095925594665565, "driven_lanedir_consec": 1.0966422494166566, "sim_compute_sim_state": 0.03784464741801168, "sim_compute_performance-ego": 0.06911724216335423, "sim_compute_robot_state-ego": 0.07369974157312414}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.054488063422768, "sim_physics": 0.1198508318265279, "survival_time": 14.950000000000076, "driven_lanedir": 3.258990110186864, "sim_render-ego": 0.06628111600875855, "in-drivable-lane": 2.7000000000000384, "agent_compute-ego": 0.18555587927500408, "deviation-heading": 1.8479351494163512, "set_robot_commands": 0.09945698579152425, "deviation-center-line": 1.0068115058068483, "driven_lanedir_consec": 3.258990110186864, "sim_compute_sim_state": 0.04144477605819702, "sim_compute_performance-ego": 0.07345944166183471, "sim_compute_robot_state-ego": 0.07734322468439737}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.4800977061194622, "sim_physics": 0.1276892097791036, "survival_time": 14.950000000000076, "driven_lanedir": 2.8791878388178453, "sim_render-ego": 0.0666818110148112, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.18681149085362753, "deviation-heading": 3.296136048107295, "set_robot_commands": 0.10389151255289714, "deviation-center-line": 1.230023172858862, "driven_lanedir_consec": 2.8791878388178453, "sim_compute_sim_state": 0.04632260799407959, "sim_compute_performance-ego": 0.07539227406183878, "sim_compute_robot_state-ego": 0.07836830139160156}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.719052260948207, "sim_physics": 0.120950022538503, "survival_time": 14.950000000000076, "driven_lanedir": 3.1701808282194235, "sim_render-ego": 0.06414840857187908, "in-drivable-lane": 0.70000000000001, "agent_compute-ego": 0.1848308030764262, "deviation-heading": 4.250901041621015, "set_robot_commands": 0.1014625120162964, "deviation-center-line": 1.5255806720399998, "driven_lanedir_consec": 3.1701808282194235, "sim_compute_sim_state": 0.04029717524846395, "sim_compute_performance-ego": 0.07169120868047078, "sim_compute_robot_state-ego": 0.07759965419769287}}
set_robot_commands_max	0.11026072240137792
set_robot_commands_mean	0.10044851583775212
set_robot_commands_median	0.1014625120162964
set_robot_commands_min	0.0871708464266649
sim_compute_performance-ego_max	0.07539227406183878
sim_compute_performance-ego_mean	0.07127873099270621
sim_compute_performance-ego_median	0.07169120868047078
sim_compute_performance-ego_min	0.06673348839603253
sim_compute_robot_state-ego_max	0.07836830139160156
sim_compute_robot_state-ego_mean	0.07585010188057725
sim_compute_robot_state-ego_median	0.07734322468439737
sim_compute_robot_state-ego_min	0.07223958755607035
sim_compute_sim_state_max	0.04632260799407959
sim_compute_sim_state_mean	0.04004467744135386
sim_compute_sim_state_median	0.04029717524846395
sim_compute_sim_state_min	0.03431418048801707
sim_physics_max	0.1276892097791036
sim_physics_mean	0.11872303007586343
sim_physics_median	0.1198508318265279
sim_physics_min	0.10814864955731292
sim_render-ego_max	0.0666818110148112
sim_render-ego_mean	0.06321372542979062
sim_render-ego_median	0.06414840857187908
sim_render-ego_min	0.057413766633218795
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.550000000000043
survival_time_min	3.349999999999996

No reset possible

22422

3314

Peter Almasi 🇭🇺

Baseline solution using reinforcement learning

aido2-LFVI-sim-testing

step1-simulation

error

yes

ip-172-31-25-98-2348

2019-05-16 20:04:12+00:00

2019-05-16 21:00:16+00:00

0:56:04

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22418

3317

jiang peng

RL - TH - shi

aido2-LF-sim-validation

step1-simulation

error

yes

ip-172-31-25-98-2348

2019-05-16 20:03:08+00:00

2019-05-16 20:03:50+00:00

0:00:42

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22412

3325

jiang peng

RL - TH -xyz

aido2-LFV-sim-validation

step1-simulation

error

yes

ip-172-31-25-98-2348

2019-05-16 20:00:56+00:00

2019-05-16 20:02:59+00:00

0:02:03

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22392

3341

Anastasiya Nikolskaya 🇷🇺

JetBrains Research

aido2-LF-sim-testing

step1-simulation

error

yes

ip-172-31-25-98-2348

2019-05-16 19:10:56+00:00

2019-05-16 20:00:47+00:00

0:49:51

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22391

3342

Anastasiya Nikolskaya 🇷🇺

JetBrains Research

aido2-LF-sim-validation

step1-simulation

error

yes

ip-172-31-25-98-2348

2019-05-16 19:06:37+00:00

2019-05-16 19:08:09+00:00

0:01:32

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22379

3353

FANG MEIYI 🇸🇬

test

aido2-LFV-sim-testing

step1-simulation

error

yes

ip-172-31-25-98-2348

2019-05-16 18:48:18+00:00

2019-05-16 19:02:44+00:00

0:14:26

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22377

3354

Isabelle Guyon 🇺🇸

challenge-aido_LF-template-tensorflow

aido2-LF-sim-testing

step1-simulation

error

yes

ip-172-31-25-98-2348

2019-05-16 18:45:12+00:00

2019-05-16 18:47:59+00:00

0:02:47

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22365

3380

jiang peng

RL-TH-shi

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-25-98-2348

2019-05-16 18:21:47+00:00

2019-05-16 18:44:01+00:00

0:22:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.1772717143394795
survival_time_median	14.950000000000076
deviation-center-line_median	1.2564295049159275
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.19863288402557372
agent_compute-ego_mean	0.18471929108568347
agent_compute-ego_median	0.18619311629951776
agent_compute-ego_min	0.16333019971847534
deviation-center-line_max	2.0019356226664935
deviation-center-line_mean	1.0952890666399673
deviation-center-line_min	0.2699252143008969
deviation-heading_max	6.71936138569765
deviation-heading_mean	3.9818839211695254
deviation-heading_median	3.7722030112939686
deviation-heading_min	0.2173190230207393
driven_any_max	3.5879048762039325
driven_any_mean	2.064125396045019
driven_any_median	1.6013626928780311
driven_any_min	0.7632258218945824
driven_lanedir_consec_max	3.4834192055946542
driven_lanedir_consec_mean	1.8326804979201436
driven_lanedir_consec_min	0.6575718006884617
driven_lanedir_max	3.4834192055946542
driven_lanedir_mean	1.8433737181711691
driven_lanedir_median	1.1772717143394795
driven_lanedir_min	0.7110379019435897
in-drivable-lane_max	1.399999999999995
in-drivable-lane_mean	0.5199999999999981
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1655340476183824, "sim_physics": 0.1233928155579023, "survival_time": 7.449999999999981, "driven_lanedir": 0.7110379019435897, "sim_render-ego": 0.06600435148149529, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.18213265854240265, "deviation-heading": 5.481102649418371, "set_robot_commands": 0.10262255060592754, "deviation-center-line": 0.4795141049335174, "driven_lanedir_consec": 0.6575718006884617, "sim_compute_sim_state": 0.042591920635044175, "sim_compute_performance-ego": 0.07438869284303397, "sim_compute_robot_state-ego": 0.07957712755907302}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7632258218945824, "sim_physics": 0.12152437369028728, "survival_time": 14.950000000000076, "driven_lanedir": 0.7441062907362871, "sim_render-ego": 0.06889763752619425, "in-drivable-lane": 0, "agent_compute-ego": 0.19863288402557372, "deviation-heading": 6.71936138569765, "set_robot_commands": 0.10695130109786988, "deviation-center-line": 2.0019356226664935, "driven_lanedir_consec": 0.7441062907362871, "sim_compute_sim_state": 0.0426119867960612, "sim_compute_performance-ego": 0.07616418997446696, "sim_compute_robot_state-ego": 0.08516286691029866}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.5879048762039325, "sim_physics": 0.1210021432240804, "survival_time": 14.950000000000076, "driven_lanedir": 3.4834192055946542, "sim_render-ego": 0.06671646912892659, "in-drivable-lane": 0, "agent_compute-ego": 0.19330759684244792, "deviation-heading": 3.7194335364169007, "set_robot_commands": 0.10445328791936238, "deviation-center-line": 1.468640886383001, "driven_lanedir_consec": 3.4834192055946542, "sim_compute_sim_state": 0.04174598693847656, "sim_compute_performance-ego": 0.07566229581832885, "sim_compute_robot_state-ego": 0.08143550316492716}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.202599541630169, "sim_physics": 0.10921306371688842, "survival_time": 14.950000000000076, "driven_lanedir": 3.101033478241836, "sim_render-ego": 0.0589895232518514, "in-drivable-lane": 0, "agent_compute-ego": 0.16333019971847534, "deviation-heading": 3.7722030112939686, "set_robot_commands": 0.09119765202204388, "deviation-center-line": 1.2564295049159275, "driven_lanedir_consec": 3.101033478241836, "sim_compute_sim_state": 0.03809929609298706, "sim_compute_performance-ego": 0.06604786316553751, "sim_compute_robot_state-ego": 0.06953583796819052}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6013626928780311, "sim_physics": 0.12090641492372985, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1772717143394795, "sim_render-ego": 0.06654594470928242, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.18619311629951776, "deviation-heading": 0.2173190230207393, "set_robot_commands": 0.10175684829810996, "deviation-center-line": 0.2699252143008969, "driven_lanedir_consec": 1.1772717143394795, "sim_compute_sim_state": 0.0428149142822662, "sim_compute_performance-ego": 0.07696378076231325, "sim_compute_robot_state-ego": 0.07879082877914627}}
set_robot_commands_max	0.10695130109786988
set_robot_commands_mean	0.10139632798866274
set_robot_commands_median	0.10262255060592754
set_robot_commands_min	0.09119765202204388
sim_compute_performance-ego_max	0.07696378076231325
sim_compute_performance-ego_mean	0.07384536451273611
sim_compute_performance-ego_median	0.07566229581832885
sim_compute_performance-ego_min	0.06604786316553751
sim_compute_robot_state-ego_max	0.08516286691029866
sim_compute_robot_state-ego_mean	0.07890043287632713
sim_compute_robot_state-ego_median	0.07957712755907302
sim_compute_robot_state-ego_min	0.06953583796819052
sim_compute_sim_state_max	0.0428149142822662
sim_compute_sim_state_mean	0.04157282094896704
sim_compute_sim_state_median	0.042591920635044175
sim_compute_sim_state_min	0.03809929609298706
sim_physics_max	0.1233928155579023
sim_physics_mean	0.11920776222257765
sim_physics_median	0.1210021432240804
sim_physics_min	0.10921306371688842
sim_render-ego_max	0.06889763752619425
sim_render-ego_mean	0.06543078521955
sim_render-ego_median	0.06654594470928242
sim_render-ego_min	0.0589895232518514
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.23000000000004
survival_time_min	3.8499999999999943

No reset possible

22354

3390

jiang peng

RL-TH-shi

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-25-98-2348

2019-05-16 18:01:06+00:00

2019-05-16 18:21:20+00:00

0:20:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.2663594888259806
survival_time_median	13.600000000000058
deviation-center-line_median	0.2558550476326924
in-drivable-lane_median	1.7999999999999936

other stats

agent_compute-ego_max	0.20091874020941117
agent_compute-ego_mean	0.18503262758432665
agent_compute-ego_median	0.191954897797626
agent_compute-ego_min	0.14915824540053743
deviation-center-line_max	1.024837191238153
deviation-center-line_mean	0.43232954566270426
deviation-center-line_min	0.07903363477032634
deviation-heading_max	3.5512068851908096
deviation-heading_mean	1.497279003685015
deviation-heading_median	0.32478405898263474
deviation-heading_min	0.2962092362398807
driven_any_max	3.8252935150994105
driven_any_mean	1.8633884027698728
driven_any_median	1.3260904013381674
driven_any_min	0.8256891231340653
driven_lanedir_consec_max	3.4687845804772035
driven_lanedir_consec_mean	1.6317391305632731
driven_lanedir_consec_min	0.653967327249565
driven_lanedir_max	3.4687845804772035
driven_lanedir_mean	1.6375038471830188
driven_lanedir_median	1.2663594888259806
driven_lanedir_min	0.653967327249565
in-drivable-lane_max	11.95000000000008
in-drivable-lane_mean	4.060000000000032
in-drivable-lane_min	0.4500000000000064
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.007053009188332, "sim_physics": 0.136798532112785, "survival_time": 2.3, "driven_lanedir": 0.6797680779697997, "sim_render-ego": 0.06514136169267737, "in-drivable-lane": 0.7499999999999991, "agent_compute-ego": 0.191954897797626, "deviation-heading": 0.3165400741408718, "set_robot_commands": 0.10386075662529988, "deviation-center-line": 0.07903363477032634, "driven_lanedir_consec": 0.6797680779697997, "sim_compute_sim_state": 0.042364861654198685, "sim_compute_performance-ego": 0.07485959322556206, "sim_compute_robot_state-ego": 0.08359664937724239}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8256891231340653, "sim_physics": 0.09390064734446853, "survival_time": 3.949999999999994, "driven_lanedir": 0.653967327249565, "sim_render-ego": 0.05726454831376861, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.14915824540053743, "deviation-heading": 0.32478405898263474, "set_robot_commands": 0.08320965042597131, "deviation-center-line": 0.08906968027377606, "driven_lanedir_consec": 0.653967327249565, "sim_compute_sim_state": 0.03657919545716877, "sim_compute_performance-ego": 0.06109830699389494, "sim_compute_robot_state-ego": 0.06293335443810572}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.8252935150994105, "sim_physics": 0.13152050884330974, "survival_time": 13.600000000000058, "driven_lanedir": 3.4687845804772035, "sim_render-ego": 0.07016973460421842, "in-drivable-lane": 0.4500000000000064, "agent_compute-ego": 0.20091874020941117, "deviation-heading": 2.997654763870878, "set_robot_commands": 0.10487585295649136, "deviation-center-line": 1.024837191238153, "driven_lanedir_consec": 3.4687845804772035, "sim_compute_sim_state": 0.04277363682494444, "sim_compute_performance-ego": 0.0774717760436675, "sim_compute_robot_state-ego": 0.08624983272131752}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.332815965089388, "sim_physics": 0.13374587376912436, "survival_time": 14.950000000000076, "driven_lanedir": 2.1186397613925454, "sim_render-ego": 0.06743734836578369, "in-drivable-lane": 5.350000000000076, "agent_compute-ego": 0.1969960347811381, "deviation-heading": 3.5512068851908096, "set_robot_commands": 0.10675578514734904, "deviation-center-line": 0.7128521743985732, "driven_lanedir_consec": 2.089816178293817, "sim_compute_sim_state": 0.0434832493464152, "sim_compute_performance-ego": 0.07748412768046062, "sim_compute_robot_state-ego": 0.08686600049336751}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.3260904013381674, "sim_physics": 0.11966050465901693, "survival_time": 14.950000000000076, "driven_lanedir": 1.2663594888259806, "sim_render-ego": 0.06703290462493897, "in-drivable-lane": 11.95000000000008, "agent_compute-ego": 0.18613521973292033, "deviation-heading": 0.2962092362398807, "set_robot_commands": 0.10647339979807537, "deviation-center-line": 0.2558550476326924, "driven_lanedir_consec": 1.2663594888259806, "sim_compute_sim_state": 0.04268266757329305, "sim_compute_performance-ego": 0.07425361315409343, "sim_compute_robot_state-ego": 0.07928731282552083}}
set_robot_commands_max	0.10675578514734904
set_robot_commands_mean	0.10103508899063736
set_robot_commands_median	0.10487585295649136
set_robot_commands_min	0.08320965042597131
sim_compute_performance-ego_max	0.07748412768046062
sim_compute_performance-ego_mean	0.07303348341953571
sim_compute_performance-ego_median	0.07485959322556206
sim_compute_performance-ego_min	0.06109830699389494
sim_compute_robot_state-ego_max	0.08686600049336751
sim_compute_robot_state-ego_mean	0.07978662997111079
sim_compute_robot_state-ego_median	0.08359664937724239
sim_compute_robot_state-ego_min	0.06293335443810572
sim_compute_sim_state_max	0.0434832493464152
sim_compute_sim_state_mean	0.041576722171204034
sim_compute_sim_state_median	0.04268266757329305
sim_compute_sim_state_min	0.03657919545716877
sim_physics_max	0.136798532112785
sim_physics_mean	0.12312521334574092
sim_physics_median	0.13152050884330974
sim_physics_min	0.09390064734446853
sim_render-ego_max	0.07016973460421842
sim_render-ego_mean	0.0654091795202774
sim_render-ego_median	0.06703290462493897
sim_render-ego_min	0.05726454831376861
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	9.95000000000004
survival_time_min	2.3

No reset possible

22349

3391

jiang peng

RL-TH-shi

aido2-LFV-sim-validation

step1-simulation

error

yes

ip-172-31-25-98-2348

2019-05-16 17:52:02+00:00

2019-05-16 18:00:36+00:00

0:08:34

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22345

3395

jiang peng

RL-TH-shi

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-25-98-2348

2019-05-16 17:35:51+00:00

2019-05-16 17:51:26+00:00

0:15:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.238302411107852
survival_time_median	5.849999999999987
deviation-center-line_median	0.21149840683507448
in-drivable-lane_median	1.699999999999994

other stats

agent_compute-ego_max	0.20465378761291503
agent_compute-ego_mean	0.17871988862600083
agent_compute-ego_median	0.18538142124811807
agent_compute-ego_min	0.15567503372828165
deviation-center-line_max	0.919770137458658
deviation-center-line_mean	0.3711700371111867
deviation-center-line_min	0.06863286644076615
deviation-heading_max	13.132193694897174
deviation-heading_mean	4.305736427741708
deviation-heading_median	0.6372176004493483
deviation-heading_min	0.20186117886824836
driven_any_max	2.05349843568627
driven_any_mean	1.194331915677766
driven_any_median	1.3933977016697776
driven_any_min	0.24239375290646284
driven_lanedir_consec_max	1.2738878038303634
driven_lanedir_consec_mean	0.915120334104461
driven_lanedir_consec_min	0.23220163175763808
driven_lanedir_max	1.3085355972599426
driven_lanedir_mean	0.9291643878842472
driven_lanedir_median	1.2412946104643634
driven_lanedir_min	0.23220163175763808
in-drivable-lane_max	6.500000000000011
in-drivable-lane_mean	2.119999999999999
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.05349843568627, "sim_physics": 0.12721878290176392, "survival_time": 14.950000000000076, "driven_lanedir": 1.3085355972599426, "sim_render-ego": 0.06775298039118449, "in-drivable-lane": 6.500000000000011, "agent_compute-ego": 0.1900022308031718, "deviation-heading": 7.149133618364634, "set_robot_commands": 0.10350248257319132, "deviation-center-line": 0.5468771866658134, "driven_lanedir_consec": 1.238302411107852, "sim_compute_sim_state": 0.042261435985565185, "sim_compute_performance-ego": 0.07558494091033935, "sim_compute_robot_state-ego": 0.08145787556966146}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6057614772444198, "sim_physics": 0.10834892094135284, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5899022961089285, "sim_render-ego": 0.0564596156279246, "in-drivable-lane": 0, "agent_compute-ego": 0.15567503372828165, "deviation-heading": 0.4082760461291373, "set_robot_commands": 0.08831760783990224, "deviation-center-line": 0.10907158815562126, "driven_lanedir_consec": 0.5899022961089285, "sim_compute_sim_state": 0.036664595206578575, "sim_compute_performance-ego": 0.06245121856530507, "sim_compute_robot_state-ego": 0.0678942898909251}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.24239375290646284, "sim_physics": 0.14771248499552408, "survival_time": 0.7500000000000001, "driven_lanedir": 0.23220163175763808, "sim_render-ego": 0.06729014714558919, "in-drivable-lane": 0, "agent_compute-ego": 0.20465378761291503, "deviation-heading": 0.20186117886824836, "set_robot_commands": 0.11288224856058755, "deviation-center-line": 0.06863286644076615, "driven_lanedir_consec": 0.23220163175763808, "sim_compute_sim_state": 0.0451024850209554, "sim_compute_performance-ego": 0.07675590515136718, "sim_compute_robot_state-ego": 0.08487915992736816}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6766082108818998, "sim_physics": 0.1009691739693666, "survival_time": 5.849999999999987, "driven_lanedir": 1.2738878038303634, "sim_render-ego": 0.05599241582756369, "in-drivable-lane": 2.3999999999999915, "agent_compute-ego": 0.15788696973751754, "deviation-heading": 0.6372176004493483, "set_robot_commands": 0.08592563001518576, "deviation-center-line": 0.21149840683507448, "driven_lanedir_consec": 1.2738878038303634, "sim_compute_sim_state": 0.03592325683332916, "sim_compute_performance-ego": 0.06345468301039475, "sim_compute_robot_state-ego": 0.06479272068056285}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.3933977016697776, "sim_physics": 0.12259340445200602, "survival_time": 14.950000000000076, "driven_lanedir": 1.2412946104643634, "sim_render-ego": 0.06472945769627889, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.18538142124811807, "deviation-heading": 13.132193694897174, "set_robot_commands": 0.10260731935501098, "deviation-center-line": 0.919770137458658, "driven_lanedir_consec": 1.2413075277175225, "sim_compute_sim_state": 0.04148445208867391, "sim_compute_performance-ego": 0.07448733409245809, "sim_compute_robot_state-ego": 0.08014459530512492}}
set_robot_commands_max	0.11288224856058755
set_robot_commands_mean	0.0986470576687756
set_robot_commands_median	0.10260731935501098
set_robot_commands_min	0.08592563001518576
sim_compute_performance-ego_max	0.07675590515136718
sim_compute_performance-ego_mean	0.07054681634597289
sim_compute_performance-ego_median	0.07448733409245809
sim_compute_performance-ego_min	0.06245121856530507
sim_compute_robot_state-ego_max	0.08487915992736816
sim_compute_robot_state-ego_mean	0.07583372827472849
sim_compute_robot_state-ego_median	0.08014459530512492
sim_compute_robot_state-ego_min	0.06479272068056285
sim_compute_sim_state_max	0.0451024850209554
sim_compute_sim_state_mean	0.04028724502702045
sim_compute_sim_state_median	0.04148445208867391
sim_compute_sim_state_min	0.03592325683332916
sim_physics_max	0.14771248499552408
sim_physics_mean	0.1213685534520027
sim_physics_median	0.12259340445200602
sim_physics_min	0.1009691739693666
sim_render-ego_max	0.06775298039118449
sim_render-ego_mean	0.062444923337708166
sim_render-ego_median	0.06472945769627889
sim_render-ego_min	0.05599241582756369
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.780000000000028
survival_time_min	0.7500000000000001

No reset possible

22335

3404

jiang peng

RL-TH-shi

aido2-LFV-sim-validation

step1-simulation

success

yes

ip-172-31-25-98-2348

2019-05-16 17:01:47+00:00

2019-05-16 17:35:03+00:00

0:33:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.9002780320318644
survival_time_median	14.950000000000076
deviation-center-line_median	0.743188259604236
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.20229021072387696
agent_compute-ego_mean	0.1964731882344705
agent_compute-ego_median	0.1999456971605247
agent_compute-ego_min	0.18741837163125316
deviation-center-line_max	1.1249348935824215
deviation-center-line_mean	0.6203931540971046
deviation-center-line_min	0.19718191547758884
deviation-heading_max	8.298668567535927
deviation-heading_mean	3.7806627796964953
deviation-heading_median	3.7389490064723434
deviation-heading_min	1.088630966570972
driven_any_max	2.504622820944334
driven_any_mean	2.048264710330718
driven_any_median	1.9359410953534688
driven_any_min	1.586999038625302
driven_lanedir_consec_max	2.423406705376293
driven_lanedir_consec_mean	1.9148741951610155
driven_lanedir_consec_min	1.5622532782287046
driven_lanedir_max	2.423406705376293
driven_lanedir_mean	1.933629009416214
driven_lanedir_median	1.9002780320318644
driven_lanedir_min	1.5622532782287046
in-drivable-lane_max	3.7500000000000537
in-drivable-lane_mean	0.8100000000000105
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.504622820944334, "sim_physics": 0.19197086016337075, "survival_time": 14.950000000000076, "driven_lanedir": 2.423406705376293, "sim_render-ego": 0.06467749993006389, "in-drivable-lane": 0, "agent_compute-ego": 0.1922320548693339, "deviation-heading": 3.7389490064723434, "set_robot_commands": 0.10410301287968954, "deviation-center-line": 0.7610064452900737, "driven_lanedir_consec": 2.423406705376293, "sim_compute_sim_state": 0.04158165693283081, "sim_compute_performance-ego": 0.07209020932515463, "sim_compute_robot_state-ego": 0.07985193729400634, "sim_compute_robot_state-npc0": 0.07254498322804769, "sim_compute_robot_state-npc1": 0.073370627562205, "sim_compute_robot_state-npc2": 0.07202160994211833, "sim_compute_robot_state-npc3": 0.07336174885431926}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.586999038625302, "sim_physics": 0.23114733606855445, "survival_time": 5.349999999999989, "driven_lanedir": 1.5622532782287046, "sim_render-ego": 0.06841710126288583, "in-drivable-lane": 0, "agent_compute-ego": 0.1999456971605247, "deviation-heading": 1.088630966570972, "set_robot_commands": 0.10544839083591354, "deviation-center-line": 0.2756542565312034, "driven_lanedir_consec": 1.5622532782287046, "sim_compute_sim_state": 0.045055137616451656, "sim_compute_performance-ego": 0.0750174143604029, "sim_compute_robot_state-ego": 0.08683875119574716, "sim_compute_robot_state-npc0": 0.07969745742940457, "sim_compute_robot_state-npc1": 0.07330409834318072, "sim_compute_robot_state-npc2": 0.07569368754591897, "sim_compute_robot_state-npc3": 0.07737388789096725}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.342916809379382, "sim_physics": 0.19272905747095745, "survival_time": 14.950000000000076, "driven_lanedir": 2.1077808384280985, "sim_render-ego": 0.06749974886576335, "in-drivable-lane": 3.7500000000000537, "agent_compute-ego": 0.20047960678736368, "deviation-heading": 4.3897622456235545, "set_robot_commands": 0.10573049704233806, "deviation-center-line": 0.743188259604236, "driven_lanedir_consec": 2.0140067671521087, "sim_compute_sim_state": 0.04313803911209106, "sim_compute_performance-ego": 0.07586146513621013, "sim_compute_robot_state-ego": 0.08431521972020467, "sim_compute_robot_state-npc0": 0.0746781587600708, "sim_compute_robot_state-npc1": 0.07475382884343465, "sim_compute_robot_state-npc2": 0.07563069105148315, "sim_compute_robot_state-npc3": 0.07585959752400716}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.9359410953534688, "sim_physics": 0.1905341498057047, "survival_time": 14.950000000000076, "driven_lanedir": 1.9002780320318644, "sim_render-ego": 0.07069112380345663, "in-drivable-lane": 0, "agent_compute-ego": 0.20229021072387696, "deviation-heading": 8.298668567535927, "set_robot_commands": 0.10615331331888836, "deviation-center-line": 1.1249348935824215, "driven_lanedir_consec": 1.9002780320318644, "sim_compute_sim_state": 0.04493663708368937, "sim_compute_performance-ego": 0.07630658149719238, "sim_compute_robot_state-ego": 0.08451057036717732, "sim_compute_robot_state-npc0": 0.07681315819422405, "sim_compute_robot_state-npc1": 0.07687550147374471, "sim_compute_robot_state-npc2": 0.07525029261906942, "sim_compute_robot_state-npc3": 0.07598870833714803}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.8708437873511017, "sim_physics": 0.16684447873023248, "survival_time": 7.7499999999999805, "driven_lanedir": 1.6744261930161075, "sim_render-ego": 0.0673941227697557, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.18741837163125316, "deviation-heading": 1.387303112279679, "set_robot_commands": 0.1015854835510254, "deviation-center-line": 0.19718191547758884, "driven_lanedir_consec": 1.6744261930161075, "sim_compute_sim_state": 0.041204269470707065, "sim_compute_performance-ego": 0.07398849302722561, "sim_compute_robot_state-ego": 0.07668310134641586, "sim_compute_robot_state-npc0": 0.07363253255044261, "sim_compute_robot_state-npc1": 0.07509246949226625, "sim_compute_robot_state-npc2": 0.07455550163022934, "sim_compute_robot_state-npc3": 0.0771674879135624}}
set_robot_commands_max	0.10615331331888836
set_robot_commands_mean	0.10460413952557096
set_robot_commands_median	0.10544839083591354
set_robot_commands_min	0.1015854835510254
sim_compute_performance-ego_max	0.07630658149719238
sim_compute_performance-ego_mean	0.07465283266923713
sim_compute_performance-ego_median	0.0750174143604029
sim_compute_performance-ego_min	0.07209020932515463
sim_compute_robot_state-ego_max	0.08683875119574716
sim_compute_robot_state-ego_mean	0.08243991598471027
sim_compute_robot_state-ego_median	0.08431521972020467
sim_compute_robot_state-ego_min	0.07668310134641586
sim_compute_robot_state-npc0_max	0.07969745742940457
sim_compute_robot_state-npc0_mean	0.07547325803243794
sim_compute_robot_state-npc0_median	0.0746781587600708
sim_compute_robot_state-npc0_min	0.07254498322804769
sim_compute_robot_state-npc1_max	0.07687550147374471
sim_compute_robot_state-npc1_mean	0.07467930514296625
sim_compute_robot_state-npc1_median	0.07475382884343465
sim_compute_robot_state-npc1_min	0.07330409834318072
sim_compute_robot_state-npc2_max	0.07569368754591897
sim_compute_robot_state-npc2_mean	0.07463035655776384
sim_compute_robot_state-npc2_median	0.07525029261906942
sim_compute_robot_state-npc2_min	0.07202160994211833
sim_compute_robot_state-npc3_max	0.07737388789096725
sim_compute_robot_state-npc3_mean	0.07595028610400083
sim_compute_robot_state-npc3_median	0.07598870833714803
sim_compute_robot_state-npc3_min	0.07336174885431926
sim_compute_sim_state_max	0.045055137616451656
sim_compute_sim_state_mean	0.043183148043154
sim_compute_sim_state_median	0.04313803911209106
sim_compute_sim_state_min	0.041204269470707065
sim_physics_max	0.23114733606855445
sim_physics_mean	0.19464517644776397
sim_physics_median	0.19197086016337075
sim_physics_min	0.16684447873023248
sim_render-ego_max	0.07069112380345663
sim_render-ego_mean	0.06773591932638509
sim_render-ego_median	0.06749974886576335
sim_render-ego_min	0.06467749993006389
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.59000000000004
survival_time_min	5.349999999999989

No reset possible

22307

3489

FANG MEIYI 🇸🇬

test

aido2-LF-sim-testing

step1-simulation

error

yes

ip-172-31-25-98-2348

2019-05-16 16:00:37+00:00

2019-05-16 17:01:06+00:00

1:00:29

Waited 3600 seconds [...]

Waited 3600 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22302

3441

jiang peng

RL-TH-shi

aido2-LF-sim-testing

step1-simulation

error

yes

ip-172-31-25-98-2348

2019-05-16 15:47:14+00:00

2019-05-16 16:00:28+00:00

0:13:14

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22286

3446

Anastasiya Nikolskaya 🇷🇺

JetBrains Research

aido2-LF-sim-validation

step1-simulation

error

yes

ip-172-31-25-98-2348

2019-05-16 15:15:15+00:00

2019-05-16 15:19:12+00:00

0:03:57

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22277

3485

Eric Lu

Testing the RL solution

aido2-LF-sim-testing

step1-simulation

error

yes

ip-172-31-25-98-2348

2019-05-16 15:00:43+00:00

2019-05-17 19:01:34+00:00

1 day, 4:00:51

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.1027402350404727
survival_time_median	1.2500000000000004
deviation-center-line_median	0.06544296847794585
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.3303907513618469
agent_compute-ego_mean	0.23320438574409927
agent_compute-ego_median	0.2372153323629628
agent_compute-ego_min	0.10612981849246556
deviation-center-line_max	0.11471293380088246
deviation-center-line_mean	0.07366551010264304
deviation-center-line_min	0.04330768303221607
deviation-heading_max	0.8861256465852722
deviation-heading_mean	0.6834126603743021
deviation-heading_median	0.6864892933609761
deviation-heading_min	0.4720613862039766
driven_any_max	0.2265401530165733
driven_any_mean	0.16478792760870897
driven_any_median	0.1728980368258645
driven_any_min	0.10010313722642758
driven_lanedir_consec_max	0.13687376786535357
driven_lanedir_consec_mean	0.09539888466179688
driven_lanedir_consec_min	0.04996517884078999
driven_lanedir_max	0.13687376786535357
driven_lanedir_mean	0.09539888466179688
driven_lanedir_median	0.1027402350404727
driven_lanedir_min	0.04996517884078999
in-drivable-lane_max	0.6000000000000005
in-drivable-lane_mean	0.1466666666666668
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2265401530165733, "sim_physics": 0.06642655531565349, "survival_time": 1.800000000000001, "driven_lanedir": 0.09521422466206753, "sim_render-ego": 0.03892297214931912, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.10612981849246556, "deviation-heading": 0.7470428132965999, "set_robot_commands": 0.05895649724536472, "deviation-center-line": 0.06544296847794585, "driven_lanedir_consec": 0.09521422466206753, "sim_compute_sim_state": 0.024946179654863145, "sim_compute_performance-ego": 0.04227668046951294, "sim_compute_robot_state-ego": 0.04366138908598158}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19316793578971944, "sim_physics": 0.10786941051483154, "survival_time": 1.5000000000000009, "driven_lanedir": 0.12131465088002968, "sim_render-ego": 0.06030042966206869, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1593100070953369, "deviation-heading": 0.8224102854377632, "set_robot_commands": 0.08303285439809163, "deviation-center-line": 0.058056730149118635, "driven_lanedir_consec": 0.12131465088002968, "sim_compute_sim_state": 0.03621445496877034, "sim_compute_performance-ego": 0.06491014162699381, "sim_compute_robot_state-ego": 0.06612792015075683}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1015179112504599, "sim_physics": 0.08228073622051038, "survival_time": 0.9500000000000004, "driven_lanedir": 0.06196415421569856, "sim_render-ego": 0.04702903095044588, "in-drivable-lane": 0, "agent_compute-ego": 0.14648733640971937, "deviation-heading": 0.5999894422828354, "set_robot_commands": 0.0718722845378675, "deviation-center-line": 0.08456689293596335, "driven_lanedir_consec": 0.06196415421569856, "sim_compute_sim_state": 0.030151643251117907, "sim_compute_performance-ego": 0.050949774290386, "sim_compute_robot_state-ego": 0.05556708888003701}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.18283329632114723, "sim_physics": 0.08912430703639984, "survival_time": 1.6000000000000008, "driven_lanedir": 0.04996517884078999, "sim_render-ego": 0.03903450816869736, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.22703376412391665, "deviation-heading": 0.7436804773248575, "set_robot_commands": 0.06333378702402115, "deviation-center-line": 0.04330768303221607, "driven_lanedir_consec": 0.04996517884078999, "sim_compute_sim_state": 0.025022469460964203, "sim_compute_performance-ego": 0.04279417544603348, "sim_compute_robot_state-ego": 0.04440531134605408}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1918647106083934, "sim_physics": 0.1081997348416236, "survival_time": 1.5500000000000007, "driven_lanedir": 0.10493690957645718, "sim_render-ego": 0.05696830441874842, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.15363098729041316, "deviation-heading": 0.7516929596928439, "set_robot_commands": 0.08768313930880639, "deviation-center-line": 0.05545280126641955, "driven_lanedir_consec": 0.10493690957645718, "sim_compute_sim_state": 0.035244534092564735, "sim_compute_performance-ego": 0.0617682856898154, "sim_compute_robot_state-ego": 0.06316518783569336}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.1903282355579837, "sim_physics": 0.108311940883768, "survival_time": 1.4500000000000006, "driven_lanedir": 0.0757479515148698, "sim_render-ego": 0.04162390478726091, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.23201981906233163, "deviation-heading": 0.8861256465852722, "set_robot_commands": 0.05833511516965669, "deviation-center-line": 0.06272845686281664, "driven_lanedir_consec": 0.0757479515148698, "sim_compute_sim_state": 0.02535616940465467, "sim_compute_performance-ego": 0.045579786958365606, "sim_compute_robot_state-ego": 0.04575495884336274}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.1728980368258645, "sim_physics": 0.1894012348992484, "survival_time": 1.4000000000000006, "driven_lanedir": 0.1335663905008393, "sim_render-ego": 0.08008298703602382, "in-drivable-lane": 0, "agent_compute-ego": 0.28085423367364065, "deviation-heading": 0.63592727960516, "set_robot_commands": 0.14533470358167375, "deviation-center-line": 0.10213005266155176, "driven_lanedir_consec": 0.1335663905008393, "sim_compute_sim_state": 0.050410338810512, "sim_compute_performance-ego": 0.08703265871320452, "sim_compute_robot_state-ego": 0.0986560923712594}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.10010313722642758, "sim_physics": 0.1760117249055342, "survival_time": 1.1000000000000003, "driven_lanedir": 0.05089607795873663, "sim_render-ego": 0.08263158798217773, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.28046156059611926, "deviation-heading": 0.6864892933609761, "set_robot_commands": 0.14960771257227118, "deviation-center-line": 0.08332989335475907, "driven_lanedir_consec": 0.05089607795873663, "sim_compute_sim_state": 0.05180644989013672, "sim_compute_performance-ego": 0.0961452614177357, "sim_compute_robot_state-ego": 0.1178700490431352}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.14731186490608625, "sim_physics": 0.2130121191342672, "survival_time": 1.2000000000000004, "driven_lanedir": 0.08202374429416315, "sim_render-ego": 0.0850486159324646, "in-drivable-lane": 0, "agent_compute-ego": 0.28470683097839355, "deviation-heading": 0.8193322172113917, "set_robot_commands": 0.1552390257517497, "deviation-center-line": 0.05773114260703888, "driven_lanedir_consec": 0.08202374429416315, "sim_compute_sim_state": 0.05712380011876424, "sim_compute_performance-ego": 0.09874682625134786, "sim_compute_robot_state-ego": 0.12776180108388266}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.15681013082487064, "sim_physics": 0.20726929540219513, "survival_time": 1.1500000000000004, "driven_lanedir": 0.11981060103974794, "sim_render-ego": 0.08722704389820927, "in-drivable-lane": 0, "agent_compute-ego": 0.27838124399599823, "deviation-heading": 0.5288675084697441, "set_robot_commands": 0.16448858509893002, "deviation-center-line": 0.08248149370961552, "driven_lanedir_consec": 0.11981060103974794, "sim_compute_sim_state": 0.056405129639998726, "sim_compute_performance-ego": 0.0983529920163362, "sim_compute_robot_state-ego": 0.1227933116581129}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.1500108148449771, "sim_physics": 0.190940390030543, "survival_time": 1.2000000000000004, "driven_lanedir": 0.11835141989328768, "sim_render-ego": 0.08592845002810161, "in-drivable-lane": 0, "agent_compute-ego": 0.3303907513618469, "deviation-heading": 0.4890783507159989, "set_robot_commands": 0.16216623783111572, "deviation-center-line": 0.10543160956415112, "driven_lanedir_consec": 0.11835141989328768, "sim_compute_sim_state": 0.052918861309687294, "sim_compute_performance-ego": 0.09761301676432292, "sim_compute_robot_state-ego": 0.11569082736968994}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.17622232829816695, "sim_physics": 0.214052209854126, "survival_time": 1.2500000000000004, "driven_lanedir": 0.13687376786535357, "sim_render-ego": 0.08648799896240235, "in-drivable-lane": 0, "agent_compute-ego": 0.2838736057281494, "deviation-heading": 0.6039984947155881, "set_robot_commands": 0.1471957778930664, "deviation-center-line": 0.08197719365174672, "driven_lanedir_consec": 0.13687376786535357, "sim_compute_sim_state": 0.0573793888092041, "sim_compute_performance-ego": 0.09733539581298828, "sim_compute_robot_state-ego": 0.12041623115539551}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.18595057423191488, "sim_physics": 0.18133905626112415, "survival_time": 1.5500000000000007, "driven_lanedir": 0.06950526434219195, "sim_render-ego": 0.07948507801178963, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.2619244283245456, "deviation-heading": 0.6496423902376691, "set_robot_commands": 0.1387332793205015, "deviation-center-line": 0.043484578697307624, "driven_lanedir_consec": 0.06950526434219195, "sim_compute_sim_state": 0.04954409599304199, "sim_compute_performance-ego": 0.0916402647572179, "sim_compute_robot_state-ego": 0.1123963709800474}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.16642722501959417, "sim_physics": 0.16152474403381348, "survival_time": 1.2500000000000004, "driven_lanedir": 0.1080726993022476, "sim_render-ego": 0.07580058097839355, "in-drivable-lane": 0, "agent_compute-ego": 0.2356460666656494, "deviation-heading": 0.8148513604738566, "set_robot_commands": 0.1346339225769043, "deviation-center-line": 0.06414822076811216, "driven_lanedir_consec": 0.1080726993022476, "sim_compute_sim_state": 0.05385343551635742, "sim_compute_performance-ego": 0.08914102554321289, "sim_compute_robot_state-ego": 0.1060425281524658}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.12983255940845506, "sim_physics": 0.17124386455701746, "survival_time": 1.1500000000000004, "driven_lanedir": 0.1027402350404727, "sim_render-ego": 0.07535830787990404, "in-drivable-lane": 0, "agent_compute-ego": 0.2372153323629628, "deviation-heading": 0.4720613862039766, "set_robot_commands": 0.1201479020326034, "deviation-center-line": 0.11471293380088246, "driven_lanedir_consec": 0.1027402350404727, "sim_compute_sim_state": 0.05077134007992952, "sim_compute_performance-ego": 0.08671092987060547, "sim_compute_robot_state-ego": 0.10011877184328824}}
set_robot_commands_max	0.16448858509893002
set_robot_commands_mean	0.1160507216228416
set_robot_commands_median	0.1346339225769043
set_robot_commands_min	0.05833511516965669
sim_compute_performance-ego_max	0.09874682625134786
sim_compute_performance-ego_mean	0.07673314770853859
sim_compute_performance-ego_median	0.08703265871320452
sim_compute_performance-ego_min	0.04227668046951294
sim_compute_robot_state-ego_max	0.12776180108388266
sim_compute_robot_state-ego_mean	0.08936185598661087
sim_compute_robot_state-ego_median	0.10011877184328824
sim_compute_robot_state-ego_min	0.04366138908598158
sim_compute_sim_state_max	0.0573793888092041
sim_compute_sim_state_mean	0.04380988606670447
sim_compute_sim_state_median	0.050410338810512
sim_compute_sim_state_min	0.024946179654863145
sim_physics_max	0.214052209854126
sim_physics_mean	0.1511338215927104
sim_physics_median	0.17124386455701746
sim_physics_min	0.06642655531565349
sim_render-ego_max	0.08722704389820927
sim_render-ego_mean	0.0681286533897338
sim_render-ego_median	0.07580058097839355
sim_render-ego_min	0.03892297214931912
simulation-passed	1
survival_time_max	1.800000000000001
survival_time_mean	1.3400000000000003
survival_time_min	0.9500000000000004

No reset possible

22256

3504

jiang peng

Fourth test - TH

aido2-LF-sim-testing

step1-simulation

error

yes

ip-172-31-25-98-2348

2019-05-16 14:13:22+00:00

2019-05-16 15:00:18+00:00

0:46:56

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22253

3510

Bea Baselines 🐤

challenge-aido_LF-template-pytorch

aido2-LFV-sim-validation

step1-simulation

success

yes

ip-172-31-25-98-2348

2019-05-16 14:03:58+00:00

2019-05-16 14:12:22+00:00

0:08:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.14449336881715436
survival_time_median	1.3000000000000005
deviation-center-line_median	0.09692797217487278
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.24199397223336355
agent_compute-ego_mean	0.22067797751653764
agent_compute-ego_median	0.21551789687230036
agent_compute-ego_min	0.20644450187683103
deviation-center-line_max	0.11104770451998182
deviation-center-line_mean	0.08794426518358177
deviation-center-line_min	0.04815316715156456
deviation-heading_max	0.9024980218381614
deviation-heading_mean	0.6381249578526246
deviation-heading_median	0.6457764228839468
deviation-heading_min	0.41997040481206144
driven_any_max	0.26810030027425963
driven_any_mean	0.2009290456612464
driven_any_median	0.20216789494432427
driven_any_min	0.14748206803011835
driven_lanedir_consec_max	0.2000270771392767
driven_lanedir_consec_mean	0.1514391866653772
driven_lanedir_consec_min	0.09895180144674298
driven_lanedir_max	0.2000270771392767
driven_lanedir_mean	0.1514391866653772
driven_lanedir_median	0.14449336881715436
driven_lanedir_min	0.09895180144674298
in-drivable-lane_max	0
in-drivable-lane_mean	0
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.26810030027425963, "sim_physics": 0.23849571162256705, "survival_time": 1.4500000000000006, "driven_lanedir": 0.2000270771392767, "sim_render-ego": 0.07294155811441355, "in-drivable-lane": 0, "agent_compute-ego": 0.20644450187683103, "deviation-heading": 0.7670068087522814, "set_robot_commands": 0.1100846241260397, "deviation-center-line": 0.0975736392287397, "driven_lanedir_consec": 0.2000270771392767, "sim_compute_sim_state": 0.04592177785676101, "sim_compute_performance-ego": 0.08205426972487877, "sim_compute_robot_state-ego": 0.09105286104925749, "sim_compute_robot_state-npc0": 0.0836728441304174, "sim_compute_robot_state-npc1": 0.08282772425947518, "sim_compute_robot_state-npc2": 0.08155160936815985, "sim_compute_robot_state-npc3": 0.08095921319106529}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.21706885968484976, "sim_physics": 0.22032915628873384, "survival_time": 1.3000000000000005, "driven_lanedir": 0.14449336881715436, "sim_render-ego": 0.07493189664987418, "in-drivable-lane": 0, "agent_compute-ego": 0.2255542094890888, "deviation-heading": 0.9024980218381614, "set_robot_commands": 0.11991558625147893, "deviation-center-line": 0.08601884284275, "driven_lanedir_consec": 0.14449336881715436, "sim_compute_sim_state": 0.04743526532099797, "sim_compute_performance-ego": 0.0857617213175847, "sim_compute_robot_state-ego": 0.08530643353095421, "sim_compute_robot_state-npc0": 0.07982167830834022, "sim_compute_robot_state-npc1": 0.08191629556509164, "sim_compute_robot_state-npc2": 0.07916885155897874, "sim_compute_robot_state-npc3": 0.08520510563483605}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.20216789494432427, "sim_physics": 0.2349537886106051, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1752273778592457, "sim_render-ego": 0.0728517954166119, "in-drivable-lane": 0, "agent_compute-ego": 0.21551789687230036, "deviation-heading": 0.41997040481206144, "set_robot_commands": 0.10570810391352728, "deviation-center-line": 0.11104770451998182, "driven_lanedir_consec": 0.1752273778592457, "sim_compute_sim_state": 0.04701740008134108, "sim_compute_performance-ego": 0.08230995214902438, "sim_compute_robot_state-ego": 0.08810701737037072, "sim_compute_robot_state-npc0": 0.07973776413844182, "sim_compute_robot_state-npc1": 0.08169281482696533, "sim_compute_robot_state-npc2": 0.08579043241647574, "sim_compute_robot_state-npc3": 0.08427881277524508}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.16982610537268006, "sim_physics": 0.23896516362826029, "survival_time": 1.2000000000000004, "driven_lanedir": 0.13849630806446633, "sim_render-ego": 0.07381993532180786, "in-drivable-lane": 0, "agent_compute-ego": 0.2138793071111043, "deviation-heading": 0.4553731309766719, "set_robot_commands": 0.11104507247606914, "deviation-center-line": 0.09692797217487278, "driven_lanedir_consec": 0.13849630806446633, "sim_compute_sim_state": 0.04780049125353495, "sim_compute_performance-ego": 0.08528150121370952, "sim_compute_robot_state-ego": 0.08880794048309326, "sim_compute_robot_state-npc0": 0.07798965771993001, "sim_compute_robot_state-npc1": 0.08028829097747803, "sim_compute_robot_state-npc2": 0.08020408948262532, "sim_compute_robot_state-npc3": 0.08251932263374329}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14748206803011835, "sim_physics": 0.21761671702067056, "survival_time": 1.0500000000000005, "driven_lanedir": 0.09895180144674298, "sim_render-ego": 0.07630040532066709, "in-drivable-lane": 0, "agent_compute-ego": 0.24199397223336355, "deviation-heading": 0.6457764228839468, "set_robot_commands": 0.10169896625337146, "deviation-center-line": 0.04815316715156456, "driven_lanedir_consec": 0.09895180144674298, "sim_compute_sim_state": 0.04268463452657064, "sim_compute_performance-ego": 0.07963779994419642, "sim_compute_robot_state-ego": 0.08148591859000069, "sim_compute_robot_state-npc0": 0.0787941955384754, "sim_compute_robot_state-npc1": 0.0750620478675479, "sim_compute_robot_state-npc2": 0.07223776408604213, "sim_compute_robot_state-npc3": 0.07575121380033947}}
set_robot_commands_max	0.11991558625147893
set_robot_commands_mean	0.10969047060409728
set_robot_commands_median	0.1100846241260397
set_robot_commands_min	0.10169896625337146
sim_compute_performance-ego_max	0.0857617213175847
sim_compute_performance-ego_mean	0.08300904886987877
sim_compute_performance-ego_median	0.08230995214902438
sim_compute_performance-ego_min	0.07963779994419642
sim_compute_robot_state-ego_max	0.09105286104925749
sim_compute_robot_state-ego_mean	0.08695203420473527
sim_compute_robot_state-ego_median	0.08810701737037072
sim_compute_robot_state-ego_min	0.08148591859000069
sim_compute_robot_state-npc0_max	0.0836728441304174
sim_compute_robot_state-npc0_mean	0.08000322796712096
sim_compute_robot_state-npc0_median	0.07973776413844182
sim_compute_robot_state-npc0_min	0.07798965771993001
sim_compute_robot_state-npc1_max	0.08282772425947518
sim_compute_robot_state-npc1_mean	0.08035743469931161
sim_compute_robot_state-npc1_median	0.08169281482696533
sim_compute_robot_state-npc1_min	0.0750620478675479
sim_compute_robot_state-npc2_max	0.08579043241647574
sim_compute_robot_state-npc2_mean	0.07979054938245636
sim_compute_robot_state-npc2_median	0.08020408948262532
sim_compute_robot_state-npc2_min	0.07223776408604213
sim_compute_robot_state-npc3_max	0.08520510563483605
sim_compute_robot_state-npc3_mean	0.08174273360704583
sim_compute_robot_state-npc3_median	0.08251932263374329
sim_compute_robot_state-npc3_min	0.07575121380033947
sim_compute_sim_state_max	0.04780049125353495
sim_compute_sim_state_mean	0.04617191380784113
sim_compute_sim_state_median	0.04701740008134108
sim_compute_sim_state_min	0.04268463452657064
sim_physics_max	0.23896516362826029
sim_physics_mean	0.23007210743416737
sim_physics_median	0.2349537886106051
sim_physics_min	0.21761671702067056
sim_render-ego_max	0.07630040532066709
sim_render-ego_mean	0.0741691181646749
sim_render-ego_median	0.07381993532180786
sim_render-ego_min	0.0728517954166119
simulation-passed	1
survival_time_max	1.4500000000000006
survival_time_mean	1.2600000000000005
survival_time_min	1.0500000000000005

No reset possible

22237

3062

Andrea Censi 🇨🇭

rotation

aido2-LFVI-sim-testing

step1-simulation

error

yes

ip-172-31-25-98-2348

2019-05-16 13:56:56+00:00

2019-05-16 14:03:50+00:00

0:06:54

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

22230

3487

Eric Lu

Testing the RL solution

aido2-LF-sim-validation

step1-simulation

success

yes

ip-172-31-25-98-2348

2019-05-16 13:48:49+00:00

2019-05-16 13:56:32+00:00

0:07:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.07702513005734302
survival_time_median	1.5000000000000009
deviation-center-line_median	0.06322780922240491
in-drivable-lane_median	0.20000000000000015

other stats

agent_compute-ego_max	0.24281456663801865
agent_compute-ego_mean	0.20590024768045376
agent_compute-ego_median	0.20336381594340008
agent_compute-ego_min	0.18731257833283524
deviation-center-line_max	0.09228994787587767
deviation-center-line_mean	0.06739387946171664
deviation-center-line_min	0.05817012970604847
deviation-heading_max	0.9069588715653688
deviation-heading_mean	0.8172719243811251
deviation-heading_median	0.7893877642710926
deviation-heading_min	0.7755511975131113
driven_any_max	0.21622709010408736
driven_any_mean	0.17471026618198365
driven_any_median	0.19511268671405285
driven_any_min	0.08616675328102295
driven_lanedir_consec_max	0.13911461535210312
driven_lanedir_consec_mean	0.08986567256199576
driven_lanedir_consec_min	0.03996051540502421
driven_lanedir_max	0.13911461535210312
driven_lanedir_mean	0.08986567256199576
driven_lanedir_median	0.07702513005734302
driven_lanedir_min	0.03996051540502421
in-drivable-lane_max	0.6500000000000006
in-drivable-lane_mean	0.2200000000000002
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.19511268671405285, "sim_physics": 0.1594842124629665, "survival_time": 1.850000000000001, "driven_lanedir": 0.06252938188255053, "sim_render-ego": 0.06855236517416465, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.24281456663801865, "deviation-heading": 0.7893877642710926, "set_robot_commands": 0.11038223472801414, "deviation-center-line": 0.06322780922240491, "driven_lanedir_consec": 0.06252938188255053, "sim_compute_sim_state": 0.04487558957692739, "sim_compute_performance-ego": 0.0765572689674996, "sim_compute_robot_state-ego": 0.08888108665878708}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1983187050797964, "sim_physics": 0.15384631156921386, "survival_time": 1.5000000000000009, "driven_lanedir": 0.13911461535210312, "sim_render-ego": 0.07084733645121256, "in-drivable-lane": 0, "agent_compute-ego": 0.20805320739746097, "deviation-heading": 0.8269869757353062, "set_robot_commands": 0.11699755191802978, "deviation-center-line": 0.06480953977680456, "driven_lanedir_consec": 0.13911461535210312, "sim_compute_sim_state": 0.046765772501627605, "sim_compute_performance-ego": 0.08351763089497884, "sim_compute_robot_state-ego": 0.08953993320465088}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.08616675328102295, "sim_physics": 0.13779963765825545, "survival_time": 1.0500000000000005, "driven_lanedir": 0.03996051540502421, "sim_render-ego": 0.06658320199875604, "in-drivable-lane": 0, "agent_compute-ego": 0.20336381594340008, "deviation-heading": 0.7755511975131113, "set_robot_commands": 0.1160060451144264, "deviation-center-line": 0.09228994787587767, "driven_lanedir_consec": 0.03996051540502421, "sim_compute_sim_state": 0.042987675893874394, "sim_compute_performance-ego": 0.07805758430844262, "sim_compute_robot_state-ego": 0.0802128655569894}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1777260957309586, "sim_physics": 0.149964085940657, "survival_time": 1.4500000000000006, "driven_lanedir": 0.07702513005734302, "sim_render-ego": 0.06992267740183863, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.18731257833283524, "deviation-heading": 0.9069588715653688, "set_robot_commands": 0.11041571354043894, "deviation-center-line": 0.05817012970604847, "driven_lanedir_consec": 0.07702513005734302, "sim_compute_sim_state": 0.04356162301425276, "sim_compute_performance-ego": 0.07931496357095652, "sim_compute_robot_state-ego": 0.08931944288056472}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.21622709010408736, "sim_physics": 0.1415658069379402, "survival_time": 1.6500000000000008, "driven_lanedir": 0.1306987201129579, "sim_render-ego": 0.06759853074044893, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.187957070090554, "deviation-heading": 0.787474812820747, "set_robot_commands": 0.10506774439956204, "deviation-center-line": 0.058471970727447566, "driven_lanedir_consec": 0.1306987201129579, "sim_compute_sim_state": 0.043017943700154625, "sim_compute_performance-ego": 0.07692229386531946, "sim_compute_robot_state-ego": 0.07888812007326068}}
set_robot_commands_max	0.11699755191802978
set_robot_commands_mean	0.11177385794009428
set_robot_commands_median	0.11041571354043894
set_robot_commands_min	0.10506774439956204
sim_compute_performance-ego_max	0.08351763089497884
sim_compute_performance-ego_mean	0.07887394832143942
sim_compute_performance-ego_median	0.07805758430844262
sim_compute_performance-ego_min	0.0765572689674996
sim_compute_robot_state-ego_max	0.08953993320465088
sim_compute_robot_state-ego_mean	0.08536828967485054
sim_compute_robot_state-ego_median	0.08888108665878708
sim_compute_robot_state-ego_min	0.07888812007326068
sim_compute_sim_state_max	0.046765772501627605
sim_compute_sim_state_mean	0.04424172093736736
sim_compute_sim_state_median	0.04356162301425276
sim_compute_sim_state_min	0.042987675893874394
sim_physics_max	0.1594842124629665
sim_physics_mean	0.1485320109138066
sim_physics_median	0.149964085940657
sim_physics_min	0.13779963765825545
sim_render-ego_max	0.07084733645121256
sim_render-ego_mean	0.06870082235328415
sim_render-ego_median	0.06855236517416465
sim_render-ego_min	0.06658320199875604
simulation-passed	1
survival_time_max	1.850000000000001
survival_time_mean	1.5000000000000009
survival_time_min	1.0500000000000005

No reset possible