Code Monkey home page Code Monkey logo

Comments (11)

riot-ci avatar riot-ci commented on June 23, 2024

Test Report

Task Outcome
01. Task 02 - Unittests on native PASSED
01. Task 03 - Unittests on native separated [tests-analog_util] PASSED
01. Task 03 - Unittests on native separated [tests-base64] PASSED
01. Task 03 - Unittests on native separated [tests-bcd] PASSED
01. Task 03 - Unittests on native separated [tests-bitfield] PASSED
01. Task 03 - Unittests on native separated [tests-bloom] PASSED
01. Task 03 - Unittests on native separated [tests-bluetil] PASSED
01. Task 03 - Unittests on native separated [tests-checksum] PASSED
01. Task 03 - Unittests on native separated [tests-chunked_ringbuffer] PASSED
01. Task 03 - Unittests on native separated [tests-clif] PASSED
01. Task 03 - Unittests on native separated [tests-color] PASSED
01. Task 03 - Unittests on native separated [tests-core] PASSED
01. Task 03 - Unittests on native separated [tests-credman] PASSED
01. Task 03 - Unittests on native separated [tests-div] PASSED
01. Task 03 - Unittests on native separated [tests-ecc] PASSED
01. Task 03 - Unittests on native separated [tests-fib] PASSED
01. Task 03 - Unittests on native separated [tests-fib_sr] PASSED
01. Task 03 - Unittests on native separated [tests-fmt] PASSED
01. Task 03 - Unittests on native separated [tests-frac] PASSED
01. Task 03 - Unittests on native separated [tests-gcoap] PASSED
01. Task 03 - Unittests on native separated [tests-gnrc_ipv6] PASSED
01. Task 03 - Unittests on native separated [tests-gnrc_ipv6_hdr] PASSED
01. Task 03 - Unittests on native separated [tests-gnrc_ipv6_nib] PASSED
01. Task 03 - Unittests on native separated [tests-gnrc_mac_internal] PASSED
01. Task 03 - Unittests on native separated [tests-gnrc_netif_pktq] PASSED
01. Task 03 - Unittests on native separated [tests-gnrc_sixlowpan_frag_vrb] PASSED
01. Task 03 - Unittests on native separated [tests-gnrc_udp] PASSED
01. Task 03 - Unittests on native separated [tests-hashes] PASSED
01. Task 03 - Unittests on native separated [tests-ieee802154] PASSED
01. Task 03 - Unittests on native separated [tests-inet_csum] PASSED
01. Task 03 - Unittests on native separated [tests-ipv4_addr] PASSED
01. Task 03 - Unittests on native separated [tests-ipv6_addr] PASSED
01. Task 03 - Unittests on native separated [tests-ipv6_hdr] PASSED
01. Task 03 - Unittests on native separated [tests-kernel_defines] PASSED
01. Task 03 - Unittests on native separated [tests-luid] PASSED
01. Task 03 - Unittests on native separated [tests-matstat] PASSED
01. Task 03 - Unittests on native separated [tests-mtd] PASSED
01. Task 03 - Unittests on native separated [tests-nanocoap] PASSED
01. Task 03 - Unittests on native separated [tests-netopt] PASSED
01. Task 03 - Unittests on native separated [tests-netreg] PASSED
01. Task 03 - Unittests on native separated [tests-phydat] PASSED
01. Task 03 - Unittests on native separated [tests-pkt] PASSED
01. Task 03 - Unittests on native separated [tests-pktbuf] PASSED
01. Task 03 - Unittests on native separated [tests-pktqueue] PASSED
01. Task 03 - Unittests on native separated [tests-printf_float] PASSED
01. Task 03 - Unittests on native separated [tests-priority_pktqueue] PASSED
01. Task 03 - Unittests on native separated [tests-rtc] PASSED
01. Task 03 - Unittests on native separated [tests-rtt_rtc] PASSED
01. Task 03 - Unittests on native separated [tests-saul_reg] PASSED
01. Task 03 - Unittests on native separated [tests-scanf_float] PASSED
01. Task 03 - Unittests on native separated [tests-seq] PASSED
01. Task 03 - Unittests on native separated [tests-sht1x] PASSED
01. Task 03 - Unittests on native separated [tests-sixlowpan] PASSED
01. Task 03 - Unittests on native separated [tests-sixlowpan_ctx] PASSED
01. Task 03 - Unittests on native separated [tests-sixlowpan_sfr] PASSED
01. Task 03 - Unittests on native separated [tests-sock_util] PASSED
01. Task 03 - Unittests on native separated [tests-timex] PASSED
01. Task 03 - Unittests on native separated [tests-tsrb] PASSED
01. Task 03 - Unittests on native separated [tests-turo] PASSED
01. Task 03 - Unittests on native separated [tests-uri_parser] PASSED
01. Task 03 - Unittests on native separated [tests-ut_process] PASSED
01. Task 03 - Unittests on native separated [tests-uuid] PASSED
01. Task 03 - Unittests on native separated [tests-vfs] PASSED
01. Task 03 - Unittests on native separated [tests-zptr] PASSED
01. Task 03 - Unittests on native separated [tests-ztimer64] PASSED
01. Task 03 - Unittests on native separated [tests-ztimer] PASSED
01. Task 04 - Unittests on iotlab-m3 PASSED
03. Task 01 - ICMPv6 multicast echo on native PASSED
03. Task 02 - ICMPv6 link-local echo on native PASSED
03. Task 03 - ICMPv6 link-local echo on native (1 hour) PASSED
03. Task 04 - ICMPv6 stress test on native (1 hour) PASSED
03. Task 05 - ICMPv6 stress test on native (neighbor cache stress) PASSED
03. Task 06 - ICMPv6 link-local echo on native (IPv6 fragmentation) PASSED
04. Task 03 - ICMPv6 echo with large payload PASSED
04. Task 04 - ICMPv6 echo with iotlab-m3/samr21-xpro 15 minutes PASSED
🟡 04. Task 05 (Experimental) - ICMPv6 multicast echo with samr21-xpro/cc2538 [lille] SKIPPED
🟡 04. Task 06 (Experimental)- ICMPv6 link-local echo with samr21-xpro/cc2538 [lille] SKIPPED
🟡 04. Task 07 (Experimental) - ICMPv6 multicast echo with samr21-xpro/zero + xbee SKIPPED
🟡 04. Task 08 (Experimental) - ICMPv6 echo with samr21-xpro/zero + xbee SKIPPED
04. Task 09 - ICMPv6 stress test on iotlab-m3 PASSED
04. Task 10 (Experimental) - ICMPv6 echo with large payload (IPv6 fragmentation) PASSED
🟡 04. Task 11 (Experimental) - ICMPv6 stress test on nrf802154 SKIPPED
🟡 04. Task 12 (Experimental) - ICMPv6 multicast echo with iotlab-m3/nrf802154 SKIPPED
🟡 04. Task 13 (Experimental) - ICMPv6 link-local echo with iotlab-m3/nrf802154 SKIPPED
05. Task 01 - ICMPv6 echo unicast addresess on native (default route) PASSED
05. Task 02 - ICMPv6 echo unicast addresess on iotlab-m3 (default route) PASSED
05. Task 03 - ICMPv6 echo unicast addresess on native (specific route) PASSED
05. Task 04 - ICMPv6 echo unicast addresess on iotlab-m3 (static route) PASSED
06. Task 01 - UDP on iotlab-m3 PASSED
06. Task 02 - UDP on iotlab-m3 (UDP port compression) PASSED
06. Task 03 - UDP on native (non-existent neighbor) PASSED
06. Task 04 - UDP on iotlab-m3 (non-existent neighbor) PASSED
06. Task 05 - Empty UDP on native PASSED
06. Task 06 - Empty UDP on iotlab-m3 PASSED
07. Task 01 - ICMPv6 echo on iotlab-m3 with three hops (static route) PASSED
07. Task 02 - UDP on iotlab-m3 with three hops (static route) PASSED
07. Task 03 - ICMPv6 echo on iotlab-m3 with three hops (RPL route) PASSED
07. Task 04 - UDP on iotlab-m3 with three hops (RPL route) PASSED
🟡 07. Task 05 (Experimental) - UDP with large payload on iotlab-m3 with three hops (RPL route) SKIPPED
08. Task 01 - ICMPv6 echo between native and Linux PASSED
08. Task 08 - UDP between GNRC and lwIP on iotlab-m3 PASSED
09. Task 01 - CORD Endpoint PASSED
09. Task 02 - Confirmable retries [False-0] PASSED
09. Task 02 - Confirmable retries [True-1] PASSED
09. Task 03 - Block1 PASSED
09. Task 04 - Block2 PASSED
09. Task 05 - Observe registration and notification PASSED
10. Task 01 - Destination unreachable - no route to destination PASSED
10. Task 02 - Destination unreachable - Beyond scope of source address PASSED
10. Task 03 - Destination unreachable - address unreachable (target node address) PASSED
10. Task 04 - Destination unreachable - address unreachable (neighbor cache miss) PASSED
10. Task 05 - Destination unreachable - port unreachable PASSED
10. Task 06 - Destination unreachable - port unreachable (large payload) PASSED
10. Task 07 - Packet too big PASSED
10. Task 08 - Time exceeded - hop limit exceeded in transit PASSED
10. Task 09 - Parameter problem - erroneous header field encountered PASSED
10. Task 10 - IPv6-in-IPv6 encapsulation PASSED
11. Task 01 - LoRaWAN example PASSED
11. Task 02 - OTAA join procedure PASSED
11. Task 03 - ABP join procedure PASSED
11. Task 04 - LoRaWAN device parameters persistence PASSED
11. Task 05 - GNRC LoRaWAN (Over The Air Activation) [otaa] PASSED
🟡 11. Task 06 - GNRC LoRaWAN (ABP) [abp] SKIPPED

from release-specs.

OlegHahm avatar OlegHahm commented on June 23, 2024

Hm, if I run the tests for native I get a bunch of issues for various reasons:

Failures during compilation:
- [examples/rust-gcoap](examples/rust-gcoap/compilation.failed)
- [examples/rust-hello-world](examples/rust-hello-world/compilation.failed)
- [examples/suit_update](examples/suit_update/compilation.failed)
- [fuzzing/gcoap](fuzzing/gcoap/compilation.failed)
- [fuzzing/gnrc_tcp](fuzzing/gnrc_tcp/compilation.failed)
- [tests/candev](tests/candev/compilation.failed)
- [tests/conn_can](tests/conn_can/compilation.failed)
- [tests/driver_dfplayer](tests/driver_dfplayer/compilation.failed)
- [tests/pkg_emlearn](tests/pkg_emlearn/compilation.failed)
- [tests/pkg_libhydrogen](tests/pkg_libhydrogen/compilation.failed)
- [tests/pkg_lvgl](tests/pkg_lvgl/compilation.failed)
- [tests/pkg_lvgl_touch](tests/pkg_lvgl_touch/compilation.failed)
- [tests/pkg_nanopb](tests/pkg_nanopb/compilation.failed)
- [tests/rust_minimal](tests/rust_minimal/compilation.failed)
- [tests/suit_manifest](tests/suit_manifest/compilation.failed)

Failures during test:
- [examples/micropython](examples/micropython/test.failed)
- [tests/congure_test](tests/congure_test/test.failed)
- [tests/gnrc_netif_ieee802154](tests/gnrc_netif_ieee802154/test.failed)
- [tests/pkg_cayenne-lpp](tests/pkg_cayenne-lpp/test.failed)
- [tests/pkg_lora-serialization](tests/pkg_lora-serialization/test.failed)
- [tests/thread_float](tests/thread_float/test.failed)
- [tests/turo](tests/turo/test.failed)
- [tests/ztimer_periodic](tests/ztimer_periodic/test.failed)

from release-specs.

MrKevinWeiss avatar MrKevinWeiss commented on June 23, 2024

@OlegHahm

Did you use Docker?
I wonder if it is to due with the setup... I do not get failures on my machine or with docker. Can you maybe post some output.

The tests/ztimer_periodic is failing for native on my computer w/wo docker.

from release-specs.

OlegHahm avatar OlegHahm commented on June 23, 2024

I assume the default is without docker, so probably not.

from release-specs.

OlegHahm avatar OlegHahm commented on June 23, 2024

@MrKevinWeiss, when I run the tests with BUILD_IN_DOCKER=1, the number of failures is reduced but still plenty of them fail:

Failures during compilation:
- [tests/gnrc_sixlowpan_frag_minfwd](tests/gnrc_sixlowpan_frag_minfwd/compilation.failed)
- [tests/gnrc_sixlowpan_frag_sfr](tests/gnrc_sixlowpan_frag_sfr/compilation.failed)
- [tests/kconfig](tests/kconfig/compilation.failed)
- [tests/kconfig_features](tests/kconfig_features/compilation.failed)

Failures during test:
- [examples/micropython](examples/micropython/test.failed)
- [tests/congure_test](tests/congure_test/test.failed)
- [tests/gnrc_netif_ieee802154](tests/gnrc_netif_ieee802154/test.failed)
- [tests/thread_float](tests/thread_float/test.failed)
- [tests/turo](tests/turo/test.failed)
- [tests/ztimer_overhead](tests/ztimer_overhead/test.failed)
- [tests/ztimer_periodic](tests/ztimer_periodic/test.failed)

from release-specs.

MrKevinWeiss avatar MrKevinWeiss commented on June 23, 2024

I also got some failures... different ones though:

Failures during compilation:
- [examples/rust-gcoap](examples/rust-gcoap/compilation.failed)
- [examples/rust-hello-world](examples/rust-hello-world/compilation.failed)
- [examples/suit_update](examples/suit_update/compilation.failed)
- [tests/conn_can](tests/conn_can/compilation.failed)
- [tests/pkg_lvgl](tests/pkg_lvgl/compilation.failed)
- [tests/pkg_lvgl_touch](tests/pkg_lvgl_touch/compilation.failed)
- [tests/rust_minimal](tests/rust_minimal/compilation.failed)
- [tests/suit_manifest](tests/suit_manifest/compilation.failed)

Failures during test:
- [tests/lwip](tests/lwip/test.failed)
- [tests/netstats_l2](tests/netstats_l2/test.failed)
- [tests/pkg_edhoc_c](tests/pkg_edhoc_c/test.failed)
- [tests/ztimer_periodic](tests/ztimer_periodic/test.failed)

I will run them again with docker and then take a closer look.

from release-specs.

MrKevinWeiss avatar MrKevinWeiss commented on June 23, 2024

After docker

Failures during compilation:
- [examples/rust-gcoap](examples/rust-gcoap/compilation.failed)
- [examples/rust-hello-world](examples/rust-hello-world/compilation.failed)
- [tests/rust_minimal](tests/rust_minimal/compilation.failed)

Failures during test:
- [tests/lwip](tests/lwip/test.failed)
- [tests/netstats_l2](tests/netstats_l2/test.failed)
- [tests/pkg_edhoc_c](tests/pkg_edhoc_c/test.failed)
- [tests/ztimer_periodic](tests/ztimer_periodic/test.failed)

from release-specs.

MrKevinWeiss avatar MrKevinWeiss commented on June 23, 2024

Tests seem to pass (after running the tap_setup) and directly calling make test.

The only test that fails is tests/ztimer_periodic which seems to be an intermittent problem ~40% of the time it passes...

The rust stuff has some permissions issues dealing with cargo, maybe some of the rust experts (@chrysn @kaspar030 ) can comment... sudo + docker seems to solve it and I can build.

from release-specs.

kaspar030 avatar kaspar030 commented on June 23, 2024

The only test that fails is tests/ztimer_periodic which seems to be an intermittent problem ~40% of the time it passes...

Guys, that test is blacklisted for native because it depends on microsecond timing accuracy, which native on linux doesn't provide.

from release-specs.

MrKevinWeiss avatar MrKevinWeiss commented on June 23, 2024

ah ha. So it would have skipped if we had RIOT_CI_BUILD=1. Thanks @kaspar030

from release-specs.

OlegHahm avatar OlegHahm commented on June 23, 2024

Closing in favor of #246

from release-specs.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.