Duckietown Challenges Home Challenges Submissions

List of evaluation jobs

Jobs in evaluation

No jobs to display.

Other jobs

page 2
Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
19043327573user8580lx22-modconlx22-modconsimfailedyesdavinci-prod-b-02-6.3.00:03:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 732, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 333, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 360, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 418, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 591, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/dist-packages/duckietown_simulator_gym/code.py", line 731, in on_received_set_robot_commands
                   ||     raise ZException(msg, wheels=wheels)
                   || zuper_commons.types.exceptions.ZException: Received NaNs in commands
                   || wheels:
                   || PWMCommands(motor_left=nan, motor_right=nan)
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19043227573user8580lx22-modconlx22-modconsimfailedyesdavinci-prod-b-02-6.3.00:04:05
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 732, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 333, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 360, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 418, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 591, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/dist-packages/duckietown_simulator_gym/code.py", line 731, in on_received_set_robot_commands
                   ||     raise ZException(msg, wheels=wheels)
                   || zuper_commons.types.exceptions.ZException: Received NaNs in commands
                   || wheels:
                   || PWMCommands(motor_left=nan, motor_right=nan)
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19043127572user8655template-randomlx22-visservoingsimsuccessyesArchimede-prod-b-04-6.3.00:08:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19043027571user8655template-randomaido-hello-sim-validationsanity-checksuccessyesArchimede-prod-b-04-6.3.00:02:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19042927571user8655template-randomaido-hello-sim-validationsanity-checksuccessyesdavinci-prod-b-03-6.3.00:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19042827570user8940lx22-modconlx22-modconsimsuccessyesArchimede-prod-b-05-6.3.00:19:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19042727570user8940lx22-modconlx22-modconsimabortedyesArchimede-prod-b-03-6.3.00:02:28
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19042627569user8957template-randomaido-hello-sim-validationsanity-checksuccessyesdavinci-prod-b-05-6.3.00:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19042527569user8957template-randomaido-hello-sim-validationsanity-checksuccessyesArchimede-prod-b-03-6.3.00:02:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19042427568user8576lx22-modconlx22-modconsimfailedyesArchimede-prod-b-02-6.3.00:05:03
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 722, in run_episode
    msg = await loop.run_in_executor(executor, f)
  File "/usr/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 243, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 333, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 370, in read_until_over
    raise ExternalTimeout(msg) from None
zuper_nodes.structures.ExternalTimeout: Timeout while reading output of node "ego0" after 120 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19042327567user8576lx22-modconlx22-modconsimfailedyesdavinci-prod-b-03-6.3.00:03:17
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 722, in run_episode
    msg = await loop.run_in_executor(executor, f)
  File "/usr/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 243, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 333, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 370, in read_until_over
    raise ExternalTimeout(msg) from None
zuper_nodes.structures.ExternalTimeout: Timeout while reading output of node "ego0" after 120 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19042227566user8971template-randomaido-hello-sim-validationsanity-checksuccessyesdavinci-prod-b-02-6.3.00:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19042127566user8971template-randomaido-hello-sim-validationsanity-checksuccessyesArchimede-prod-b-01-6.3.00:02:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19042027565user8504template-randomaido-hello-sim-validationsanity-checksuccessyesArchimede-prod-b-03-6.3.00:02:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19041927565user8504template-randomaido-hello-sim-validationsanity-checksuccessyesArchimede-prod-b-01-6.3.00:02:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19041827565user8504template-randomaido-hello-sim-validationsanity-checksuccessyesArchimede-prod-b-05-6.3.00:05:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19041727565user8504template-randomaido-hello-sim-validationsanity-checksuccessyesdavinci-prod-b-02-6.3.00:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19041627565user8504template-randomaido-hello-sim-validationsanity-checksuccessyesdavinci-prod-b-02-6.3.00:01:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19041527564user8929exercises_braitenberglx22-BV1sim-1of5successyesdavinci-prod-b-04-6.3.00:01:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19041427564user8929exercises_braitenberglx22-BV1sim-1of5successyesdavinci-prod-b-03-6.3.00:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19041327564user8929exercises_braitenberglx22-BV1sim-0of5successyesdavinci-prod-b-05-6.3.00:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19041227564user8929exercises_braitenberglx22-BV1sim-2of5successyesdavinci-prod-b-02-6.3.00:02:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19041127564user8929exercises_braitenberglx22-BV1sim-1of5successyesdavinci-prod-b-04-6.3.00:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19041027564user8929exercises_braitenberglx22-BV1sim-2of5successyesdavinci-prod-b-05-6.3.00:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19040927564user8929exercises_braitenberglx22-BV1sim-4of5successyesArchimede-prod-b-02-6.3.00:05:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19040827564user8929exercises_braitenberglx22-BV1sim-0of5successyesdavinci-prod-b-03-6.3.00:01:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19040727564user8929exercises_braitenberglx22-BV1sim-3of5successyesArchimede-prod-b-05-6.3.00:04:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19040627562user8553lx22-visservoinglx22-visservoingsimsuccessyesdavinci-prod-b-03-6.3.00:07:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19040527563user8553objdet exerciselx22-objdetsimsuccessyesdavinci-prod-b-05-6.3.00:14:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19040427561user8030exercises_braitenberglx22-BV1sim-0of5successyesdavinci-prod-b-03-6.3.00:02:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19040327561user8030exercises_braitenberglx22-BV1sim-1of5successyesArchimede-prod-b-05-6.3.00:05:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19040227561user8030exercises_braitenberglx22-BV1sim-3of5successyesdavinci-prod-b-04-6.3.00:03:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19040127561user8030exercises_braitenberglx22-BV1sim-4of5successyesArchimede-prod-b-01-6.3.00:02:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19040027561user8030exercises_braitenberglx22-BV1sim-2of5successyesArchimede-prod-b-04-6.3.00:04:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19039927561user8030exercises_braitenberglx22-BV1sim-0of5successyesdavinci-prod-b-01-6.3.00:02:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19039827561user8030exercises_braitenberglx22-BV1sim-4of5successyesArchimede-prod-b-01-6.3.00:01:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19039727561user8030exercises_braitenberglx22-BV1sim-2of5successyesdavinci-prod-b-03-6.3.00:01:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19039627561user8030exercises_braitenberglx22-BV1sim-3of5successyesArchimede-prod-b-05-6.3.00:06:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19039527561user8030exercises_braitenberglx22-BV1sim-0of5successyesdavinci-prod-b-02-6.3.00:02:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19039427561user8030exercises_braitenberglx22-BV1sim-1of5successyesArchimede-prod-b-02-6.3.00:06:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19039327561user8030exercises_braitenberglx22-BV1sim-4of5successyesArchimede-prod-b-03-6.3.00:02:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19039227561user8030exercises_braitenberglx22-BV1sim-2of5successyesdavinci-prod-b-05-6.3.00:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19039127560user8030exercises_braitenberglx22-BV1sim-4of5successyesArchimede-prod-b-03-6.3.00:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19039027560user8030exercises_braitenberglx22-BV1sim-1of5successyesArchimede-prod-b-02-6.3.00:05:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19038927560user8030exercises_braitenberglx22-BV1sim-3of5successyesdavinci-prod-b-02-6.3.00:03:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19038827560user8030exercises_braitenberglx22-BV1sim-4of5successyesArchimede-prod-b-03-6.3.00:02:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19038727560user8030exercises_braitenberglx22-BV1sim-0of5successyesdavinci-prod-b-03-6.3.00:02:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19038627560user8030exercises_braitenberglx22-BV1sim-2of5successyesArchimede-prod-b-04-6.3.00:04:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19038527560user8030exercises_braitenberglx22-BV1sim-2of5successyesdavinci-prod-b-04-6.3.00:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
19038427560user8030exercises_braitenberglx22-BV1sim-0of5successyesdavinci-prod-b-03-6.3.00:02:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible