[OpenID] Backwards Compatibility

[Brett McDowell]

Sorry John, I've been traveling too much lately and missed that you  
had directed a question my way on this thread (see below).

On Mar 18, 2009, at 11:24 PM, John Bradley wrote:

> The latest Liberty Interoperability Testing report and Procedures,   
> are interesting as a reference.
> Testing
> http://www.projectliberty.org/liberty/content/download/4435/30275/file/SAML_3Q08_%20Interoperability_PUBLIC_Final_Report_102308-FINAL.pdf
> Test Procedures
> http://www.projectliberty.org/liberty/content/download/2273/15001/file/ID-WSF-2-0-TestProcedures-v1-01.pdf
> http://www.projectliberty.org/liberty/content/download/4160/27946/file/Liberty_Interoperability_SAML_Test_Plan_v3.1.pdf
>
> However even there most of the testing appears to be manual.
>
> Perhaps Brett knows if there are IPR free/Open Source tools that  
> could be used to construct these sorts of Conformance and Full  
> Matrix Tests.   I am certain that there are proprietary tools.  I am  
> looking for open-source friendly tools.

We hired some test tool development done to created "negative testing"  
tools specific to the SAML 2.0 events.  We didn't open source those...  
but probably only because no one asked.  I don't see why we couldn't  
or wouldn't.  I'll take that action item.

But I don't imagine that is either relevant to the OpenID test or what  
you were asking about.  We once got a quote for doing a comprehensive  
automated test suite but it was a long time ago and incredibly  
expenses.  We have found that full-matrix interoperability testing of  
actual implementations "from the wild" provides more value to  
deployers at the end of the day than a master automated conformance  
suite would (because deployers want stuff to work with each other more  
than they want it to be perfectly implemented, necessarily).
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openid.net/pipermail/openid-general/attachments/20090327/e29a70f6/attachment-0002.htm>