Why no output sections for Xpass/Xfail? #9834
Answered
by
okken
jeffwright13
asked this question in
Q&A
-
|
We have separate output sections for |
Beta Was this translation helpful? Give feedback.
Answered by
okken
Feb 8, 2024
Replies: 5 comments 7 replies
-
|
Hi @jeffwright13, Can you paste what we have today and what you would like to see, to make sure we are all on the same page? Thanks. |
Beta Was this translation helpful? Give feedback.
3 replies
-
|
@nicoddemus - please see below for output generated by Pytest 7.1.1 with the As you can see, there are individual output sections (separated by
However, there are no output setctions for Xpass, Xfail, or Skipped. In my opinion, because the XFail and XPass results do not get counted in the final Failed and Passed statistics, they should have their own output section. Same would also apply to Skipped. I hope this makes sense? |
Beta Was this translation helpful? Give feedback.
-
|
Thanks @jeffwright13!
But they are counted, no? |
Beta Was this translation helpful? Give feedback.
-
|
Yes, they are counted, so the final statistics are correct. I'm just curious why they don't get their own sections in the terminal output. And while we are talking about it, how come the "warnings summery" and "test session starts" sections are lower case, but ERRORS, PASSES and FAILS are upper case? As you can see, I have a preference for consistency. :-) |
Beta Was this translation helpful? Give feedback.
-
|
Beta Was this translation helpful? Give feedback.
1 reply
-
|
Testfiles that create the above output are available at https://github.com/jeffwright13/pytest-fold/tree/main/tests. |
Beta Was this translation helpful? Give feedback.
-
|
I'm running into this problem also. Example: test_foo.py import pytest
def test_pass():
print('in test_pass()')
a, b = 1, 1
assert a == b
def test_fail():
print('in test_fail()')
a, b = 1, 2
assert a == b
@pytest.mark.xfail
def test_xfail():
print('in test_xfail()')
a, b = 1, 2
assert a == b
@pytest.mark.xfail
def test_xpass():
print('in test_xpass()')
a, b = 1, 1
assert a == bCurrent output: Observations:
Opinion on how to fix this:
My opinions, of course. But this would follow the idea of "behavior with the least surprise". And it doesn't require any extra flags. |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
Most of this has been implemented in pytest 8.0.0 |
Beta Was this translation helpful? Give feedback.
-
|
(I had the same problem) its hacky but its a solution and execute pytest with
EDIT: |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
pytest 8.0.0 reports output for xpass and xfail if you use |
Beta Was this translation helpful? Give feedback.
-
|
pytest 8.0.0 reports ouptut for xpass and xfail if you use |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
With pytest 8.0, there are now indeed separate sections with the verbose output when enabled ( It seems the |
Beta Was this translation helpful? Give feedback.
Answer selected by
okken
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
pytest 8.0.0 reports ouptut for xpass and xfail if you use
-rxXor-ra(which includes-rxfor xfail and-rXfor xpass )