[Openid-specs-ab] optional vs mandatory tests in OP certification suite

Mike Jones Michael.Jones at microsoft.com
Thu Dec 22 16:24:19 UTC 2016


FYI, the colors in the OpenID Conformance Profiles tables at http://openid.net/wordpress-content/uploads/2016/12/OpenID-Connect-Conformance-Profiles.pdf mean this:
	Green - Required for certification
	Yellow - Optional for certification
	Orange (with "no err" text) - Test must be run and not result in an error, but supporting functionality not required for certification
	White - Extra test either not required for certification or not applicable to the response types

				-- Mike

-----Original Message-----
From: Openid-specs-ab [mailto:openid-specs-ab-bounces at lists.openid.net] On Behalf Of Mike Jones via Openid-specs-ab
Sent: Wednesday, December 21, 2016 9:02 AM
To: Prateek Mishra <Prateek.Mishra at oracle.com>
Cc: openid-specs-ab at lists.openid.net; Yihan Li <yihan.li at oracle.com>
Subject: Re: [Openid-specs-ab] optional vs mandatory tests in OP certification suite

The information is presented to testers by the test tool itself.  Once you configure your test instance, unless you check the box saying that you want extra tests to be shown, only those required for certification will be shown when you select each response_type.  For instance, if you look at the lists of tests shown at https://op.certification.openid.net:60363/, there will only be circular icons to click for the necessary tests for the selected response_type.  Using the "If you want to change this you can do it here" link, the tester can choose different response_type values and then run tests for each one in turn.

The other place that this information is available is in the Certification Submission Examples document, which is referenced from the submission instructions.  The current version of this is at http://openid.net/wordpress-content/uploads/2016/12/Certification-Submission-Examples.pdf.

				Best wishes,
				-- Mike

P.S.  I'll plan to document the meaning of the color coding in the conformance profiles document when it's next revised.  Thanks for pointing out that this wasn't explicit in the document.

-----Original Message-----
From: Openid-specs-ab [mailto:openid-specs-ab-bounces at lists.openid.net] On Behalf Of Prateek Mishra via Openid-specs-ab
Sent: Wednesday, December 14, 2016 4:11 PM
To: openid-specs-ab at lists.openid.net
Cc: Yihan Li <yihan.li at oracle.com>
Subject: [Openid-specs-ab] optional vs mandatory tests in OP certification suite

Our development team is looking for a list of mandatory tests for OP certification. Our understanding is that its only necessary to successfully pass these tests to obtain OP certification.

As far as we can determine, the individual test traces themselves do not include this information (e.g. an OPTIONAL flag).

Upon reviewing  “OpenID Connect Conformance Profiles V2.0- Dec 5, 2016” we do not find any explicit guidance on this issue. We do see some “color coding” in the document but its meaning its not defined within the document.

Is this information available from some other source? 

Thanks,
prateek



_______________________________________________
Openid-specs-ab mailing list
Openid-specs-ab at lists.openid.net
http://lists.openid.net/mailman/listinfo/openid-specs-ab
_______________________________________________
Openid-specs-ab mailing list
Openid-specs-ab at lists.openid.net
http://lists.openid.net/mailman/listinfo/openid-specs-ab


More information about the Openid-specs-ab mailing list