[Openid-specs-ab] Initial cut at certification tests for OpenID Federation

[Michael Jones]

It's the responsibility of working groups to define certification tests for their specifications.  As the OpenID Federation specification and deployments mature, it makes sense to start that process.

As some of you know, there are test cases for one of the Italian deployments of OpenID Federation.  Their test case spreadsheet<https://docs.google.com/spreadsheets/d/1uDlren1xXtsqCt9zroviS_UUVJLKZp-u/edit#gid=1876261402> contains 791 test descriptions, but some of them test things specific to that Italian deployment and some of them test OpenID Connect functionality (which overlaps with the OpenID Connect tests at https://openid.net/certification/).  I filtered their spreadsheet to remove the Connect tests and those for extension entity types and got it down to 212 test descriptions, which are in the attached spreadsheet.  I then read all 212 and annotated them as to whether they tested general-purpose Federation functionality or whether they are testing things specific to the Italian profile.

That resulted in 60 general-purpose tests (marked "Yes") and another 7 that can be used when optional features are present (marked "Conditional").  Those marked "?" bear further evaluation to determine if there is a related test that we should create that is general-purpose or conditional.  Those marked "No" are typically testing Italian-specific functionality.

I'm certain that we'll want additional tests, but it made sense to start with test definitions others had already created.  That gives us a solid starting point.

There will be a certification team face-to-face before the OAuth Security workshop in Rome next week.  Federation Certification will be one of the topics there.

By all means, review the tests marked "Yes" and "Conditional" and add your thoughts.  And if you're daring, also take a stab at what we should do about the ones marked "?".

                                                                Thanks all,
                                                                -- Mike

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openid.net/pipermail/openid-specs-ab/attachments/20240331/2cbbde6a/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Federation Certification Tests by Italian SPID CIE Filtered and Assessed.xlsx
Type: application/vnd.openxmlformats-officedocument.spreadsheetml.sheet
Size: 39300 bytes
Desc: Federation Certification Tests by Italian SPID CIE Filtered and Assessed.xlsx
URL: <http://lists.openid.net/pipermail/openid-specs-ab/attachments/20240331/2cbbde6a/attachment-0001.xlsx>