[Openid-specs-ab] Issue #84: Test Traces ONLY refer to last test run. (openid/certification)
issues-reply at bitbucket.org
Wed Mar 11 18:01:50 UTC 2015
New issue 84: Test Traces ONLY refer to last test run.
Steps to reproduce:
1. Run OAuth-2nd-30s test at https://op.certification.openid.net:60218 (It passes).
2. Look at OAuth-2nd-30s test trace (It says PASSED)
3. Run OAuth-2nd (It fails)
4. Look at OAuth-2nd-30s and OAuth-2nd test traces (They both say FAILED now).
See screenshots attached for more information.
OAuthBehaviors.png shows that OAuth-2nd fails while OAuth-2nd-30s passes.
OAuth2-2nd-30sPassed.png shows the result after Step 1 above.
OAuth2-2nd-30sFailed.png shows the result for OAuth-2nd-30s after Step 3 above.
OAuth-2nd-Failed.png shows the result for OAuth-2nd after Step 3 above.
I'm not sure what's going on, but the conflicting test traces are confusing to understand.
More information about the Openid-specs-ab