Comments (11)
Test Report
from release-specs.
So after some investigation I found the the iotlab based tests with the firefly
are having issues (all seem to be in an ERROR state) as well as no samr21-xpro
available in lillie
. I am trying to switch to strasbourg
but it doesn't acutally book the experiment and I think that I have some parameters wrong.
I tried with both this:
@pytest.mark.parametrize(
'nodes, iotlab_site',
[pytest.param(['iotlab-m3', 'openmoteb'], "strasbourg")],
indirect=['nodes', 'iotlab_site'],
)
and
@pytest.mark.parametrize(
'nodes, iotlab_site',
[pytest.param(['iotlab-m3', 'openmote-b'], "strasbourg")],
indirect=['nodes', 'iotlab_site'],
)
Maybe it is something to do with the openmote-b
naming?
It would be nice to somehow enable the log level of the iotlabs-cli so I can see what the issue is but I haven't dug deep enough into the documentation I guess...
from release-specs.
ping @miri64 or @aabadie maybe?
from release-specs.
oops I actually get some output:
$ tox -e test -- -k "spec04 and (task05 or task06)" --capture=tee-sys |& tee /tmp/log2.txt
test: commands[0]> pytest -k 'spec04 and (task05 or task06)' --capture=tee-sys
============================= test session starts ==============================
platform linux -- Python 3.10.12, pytest-7.3.2, pluggy-1.3.0 -- /home/weiss/repos/Release-Specs/.tox/test/bin/python
cachedir: .tox/test/.pytest_cache
rootdir: /home/weiss/repos/Release-Specs
configfile: setup.cfg
plugins: rerunfailures-12.0, cov-4.1.0
collecting ... collected 135 items / 133 deselected / 2 selected
04-single-hop-6lowpan-icmp/test_spec04.py::test_task05[nodes0-strasbourg] RERUN [ 50%]
04-single-hop-6lowpan-icmp/test_spec04.py::test_task05[nodes0-strasbourg] RERUN [ 50%]
04-single-hop-6lowpan-icmp/test_spec04.py::test_task05[nodes0-strasbourg] RERUN [ 50%]
04-single-hop-6lowpan-icmp/test_spec04.py::test_task05[nodes0-strasbourg] ERROR [ 50%]
04-single-hop-6lowpan-icmp/test_spec04.py::test_task06[nodes0-strasbourg] RERUN [100%]
04-single-hop-6lowpan-icmp/test_spec04.py::test_task06[nodes0-strasbourg] RERUN [100%]
04-single-hop-6lowpan-icmp/test_spec04.py::test_task06[nodes0-strasbourg] RERUN [100%]
04-single-hop-6lowpan-icmp/test_spec04.py::test_task06[nodes0-strasbourg] ERROR [100%]
==================================== ERRORS ====================================
_______________ ERROR at setup of test_task05[nodes0-strasbourg] _______________
local = False
request = <SubRequest 'nodes' for <Function test_task05[nodes0-strasbourg]>>
boards = ['iotlab-m3', 'openmoteb'], iotlab_site = 'strasbourg'
@pytest.fixture
def nodes(local, request, boards, iotlab_site):
"""
Provides the nodes for a test as a list of RIOTCtrl objects
"""
ctrls = []
if boards is None:
boards = request.param
only_native = all(b.startswith("native") for b in boards)
for board in boards:
if local or only_native or IoTLABExperiment.valid_board(board):
env = {'BOARD': f'{board}'}
else:
env = {
> 'BOARD': IoTLABExperiment.board_from_iotlab_node(board),
'IOTLAB_NODE': f'{board}',
}
conftest.py:284:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
iotlab_node = 'openmoteb'
@staticmethod
def board_from_iotlab_node(iotlab_node):
"""Return BOARD matching iotlab_node"""
reg = r'([0-9a-zA-Z\-]+)-\d+\.[a-z]+\.iot-lab\.info'
match = re.search(reg, iotlab_node)
if match is None:
> raise ValueError(
"Unable to parse {iotlab_node} as IoT-LAB node "
"name of format "
"<node-name>.<site-name>.iot-lab.info"
)
E ValueError: Unable to parse {iotlab_node} as IoT-LAB node name of format <node-name>.<site-name>.iot-lab.info
testutils/iotlab.py:59: ValueError
_______________ ERROR at setup of test_task06[nodes0-strasbourg] _______________
local = False
request = <SubRequest 'nodes' for <Function test_task06[nodes0-strasbourg]>>
boards = ['iotlab-m3', 'openmote-b'], iotlab_site = 'strasbourg'
@pytest.fixture
def nodes(local, request, boards, iotlab_site):
"""
Provides the nodes for a test as a list of RIOTCtrl objects
"""
ctrls = []
if boards is None:
boards = request.param
only_native = all(b.startswith("native") for b in boards)
for board in boards:
if local or only_native or IoTLABExperiment.valid_board(board):
env = {'BOARD': f'{board}'}
else:
env = {
> 'BOARD': IoTLABExperiment.board_from_iotlab_node(board),
'IOTLAB_NODE': f'{board}',
}
conftest.py:284:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
iotlab_node = 'openmote-b'
@staticmethod
def board_from_iotlab_node(iotlab_node):
"""Return BOARD matching iotlab_node"""
reg = r'([0-9a-zA-Z\-]+)-\d+\.[a-z]+\.iot-lab\.info'
match = re.search(reg, iotlab_node)
if match is None:
> raise ValueError(
"Unable to parse {iotlab_node} as IoT-LAB node "
"name of format "
"<node-name>.<site-name>.iot-lab.info"
)
E ValueError: Unable to parse {iotlab_node} as IoT-LAB node name of format <node-name>.<site-name>.iot-lab.info
testutils/iotlab.py:59: ValueError
----- generated xml file: /home/weiss/repos/Release-Specs/test-report.xml ------
============ 133 deselected, 2 errors, 6 rerun in 182.36s (0:03:02) ============
test: exit 1 (183.20 seconds) /home/weiss/repos/Release-Specs> pytest -k 'spec04 and (task05 or task06)' --capture=tee-sys pid=93946
test: FAIL code 1 (183.24=setup[0.05]+cmd[183.20] seconds)
from release-specs.
I think I got it. Just need to add openmote to the board map :)
from release-specs.
Both #289 and RIOT-OS/RIOT#19979 will need to get in before starting RC2 as they fix some of the failing tests...
from release-specs.
doh, wasn't on the PR...
from release-specs.
Test Report
from release-specs.
So we will still need to wait for some sock, coap, psa, and release test fixes before RC2...
from release-specs.
There are still some backports required but maybe it would be good to start a RC2 after RIOT-OS/RIOT#20008 is merged just to see the current state.
from release-specs.
Closing in favor of #291
from release-specs.
Related Issues (20)
- Release 2022.07 - RC4 HOT 25
- Release 2022.10 - RC1 HOT 7
- Release 2022.10 - RC2 HOT 9
- Release 2022.10 - RC3 HOT 18
- Release 2023.01 - RC1 HOT 3
- Release 2023.01 - RC2 HOT 2
- Release 2023.01 - RC3 HOT 14
- 08 - Task 11: Building zephyr on atsamr21_xpro not possible HOT 4
- Release 2023.04 - RC1 HOT 12
- [RFC] Restructure/update Release Specs HOT 2
- Release 2023.04 - RC2 HOT 5
- Release 2023.04 - RC3 HOT 3
- Release 2023.07 - RC5 HOT 15
- Release 2023.10 - RC2 HOT 5
- Release 2023.10 - RC3 HOT 4
- Release 2024.01 - RC1 HOT 4
- Release 2024.01 - RC2 HOT 17
- Release 2024.04 - RC1 HOT 12
- Release 2024.04 - RC2 HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from release-specs.