[Openid-specs-ab] Proposed next set of Certification tests for OpenID Federation

[Michael Jones]

As a result of discussions with the Certification team and the Connect working group, we decided that the next steps for certifying OpenID Federation deployments and implementations would be to add tests exchanging protocol messages between the implementation being tested and federation conformance testing software at www.certification.openid.net<http://www.certification.openid.net>.  The attached spreadsheet defines an initial set of such tests, both using Automatic Registration and Explicit Registration.  It also includes the previous set of tests, updated per feedback from Marcus Almgren, who implemented them.

As described in the (short) attached Word doc, we plan for there to be three modes of tests available for Federations:

  *   Deployed Single Entity Testing:  Tests the properties of an Entity deployed in a Federation in detail.  Obviously, only features used by the Entity can be tested.  All the tests we have now use this mode.
  *   Deployed Entire Federation Testing:  Tests the properties of an entire deployed Federation graph.  Obviously only limited information can be logged so that the log sizes for Federations with thousands of Entities do not become unwieldy. We expect this mode to be useful to Federation Operators for identifying problems in their federations.
  *   Entity Joined to Test Federation:  Tests the behavior an Entity within a custom federation created for certification testing purposes.  Both positive and negative tests can be run in this manner, as are tests over a broader range of inputs controlled by the certification suite.

The new "Test Modes" column in the spreadsheet indicates which combinations of the three modes tests are applicable for:  Deployed (1), Entire Fed (2), Test Fed. (3), or All.

These tests are informed by the tests developed by the Italian SPID CIE team and also by discussions with those involved in the Italian and multiple other European deployments, Australian deployments, the Connect working group, and the Certification team.  Please let us know what you'd like to see us do next!

                                                                Happy New Year!
                                                                -- Mike

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openid.net/pipermail/openid-specs-ab/attachments/20250101/30ccd2a7/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: OpenID Federation Conformance Features 31-Dec-24.xlsx
Type: application/vnd.openxmlformats-officedocument.spreadsheetml.sheet
Size: 512577 bytes
Desc: OpenID Federation Conformance Features 31-Dec-24.xlsx
URL: <http://lists.openid.net/pipermail/openid-specs-ab/attachments/20250101/30ccd2a7/attachment-0001.xlsx>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Certification Testing for OpenID Federation 29-Dec-24.docx
Type: application/vnd.openxmlformats-officedocument.wordprocessingml.document
Size: 24136 bytes
Desc: Certification Testing for OpenID Federation 29-Dec-24.docx
URL: <http://lists.openid.net/pipermail/openid-specs-ab/attachments/20250101/30ccd2a7/attachment-0001.docx>