[Openid-specs-digital-credentials-protocols] What is the state of the conformance tests?

[Richard Esplin]

This is really helpful information. Thank you Joseph and Marcos!

We appreciate all the work this group does to move forward these standards,
and thank you for helping us with our efforts to interoperate.

-- Richard

On Thu, Aug 22, 2024 at 2:35 AM Marcos Caceres <caceres_m at apple.com> wrote:

> Hi Richards,
>
> Not sure if it helps, but for the (W3C/Browser) Digital Credentials API
> side of things, the test suite lives here:
> https://github.com/web-platform-tests/wpt/tree/master/digital-credentials
>
> Our intention is to enable conformance testing for Openid4vp against the Digital
> Credentials API there too. Here’s an entry point:
>
> https://github.com/web-platform-tests/wpt/blob/5aca137acce75f539da359667cb5ddef2cca0ea5/digital-credentials/support/helper.js#L57
>
> Right now, the testing framework supports passing in bogus/malformed
> request, as we well as checking against some (yet to be defined) canonical
> structure. We (W3C folks) will provide instructions for how to run things.
> There’s already general instructions here:
> https://web-platform-tests.org/
>
> We also welcome and encourage contributions should you have cycles to
> contribute!
>
> W3C folks are also hoping to create a [Web Driver] API that developers can
> use to make requests and vend fake credentials, as well as simulate user
> actions (e.g., user cancels). The WICG has an open issue for this here:
> https://github.com/WICG/digital-credentials/issues/131
>
> The Web Driver API will probably be based on (or just reuse!) the W3C’s
> Web Auth one, as they are structurally pretty much the same behavior
> requirements:
> https://w3c.github.io/webauthn/#sctn-automation
>
> Hope that helps!
> Marcos
>
> [WebDriver] https://www.w3.org/TR/webdriver2/
>
>
>
> On 21 Aug 2024, at 10:42 PM, Joseph Heenan via
> Openid-specs-digital-credentials-protocols <
> openid-specs-digital-credentials-protocols at lists.openid.net> wrote:
>
> Hi Richard
>
> Sorry, I've been out of the office most of the last two weeks. The best
> email for conformance tests questions is certification at oidf.org
>
> The instructions at
> https://openid.net/certification/conformance-testing-for-openid-for-verifiable-presentations/ are
> still current and cover the VP tests for wallets. The code for that is so
> far only deployed on the demo system linked and can be found in the demo
> branch on the git repo:
> https://gitlab.com/openid/conformance-suite/-/tree/demo?ref_type=heads
>
> VCI tests for issuers are planned for this year and then we’ll look at
> filling out VP tests for verifiers and VCI tests for wallets - we’ll keep
> the working group up to date (via the mail list and in the meetings) and
> will also present updates in the OIDF workshops.
>
> Any questions please just email certification at oidf.org
>
> Thanks
>
> Joseph
>
>
> On 19 Aug 2024, at 23:19, Richard Esplin via
> Openid-specs-digital-credentials-protocols <
> openid-specs-digital-credentials-protocols at lists.openid.net> wrote:
>
> Would someone be willing to point us toward the information we need or
> summarize the status of the conformance tests?
>
> Thank you in advance,
>
> -- Richard
>
>
> On Tue, Aug 13, 2024 at 11:27 AM Richard Esplin <richard at dock.io> wrote:
>
>> We are currently updating our support for OID4VCI and OID4VCP from an
>> early draft to the latest version. We would like to confirm that we are
>> compliant with the standard.
>>
>> I see the instructions for running the conformance tests:
>>
>> https://openid.net/certification/conformance-testing-for-openid-for-verifiable-presentations/
>>
>> It would help us to see the source code for the tests. I thought they
>> might be in the OID4VP repo, but these tests don't seem to match:
>> https://github.com/openid/OpenID4VP/tree/main/tests
>>
>> I also looked in the Conformance Suite, but there doesn't appear to be
>> any VC related stuff there.
>> https://gitlab.com/openid/conformance-suite
>>
>> I see the issue in Bitbucket from 2022, and the issue in GitLab from
>> 2023, but I don't see any links to code.
>>
>> https://bitbucket.org/openid/connect/issues/1464/certification-conformance-testing-for
>> https://gitlab.com/openid/conformance-suite/-/issues/1244
>>
>> Where should I be looking?
>>
>> We are specifically interested in tests for the OID4VCI issuance flows
>> and the flows for OID4VP relying parties.
>>
>> Thank you for your help,
>>
>> -- Richard
>> --
>> Richard Esplin
>> Head of Product, Dock Labs
>> +1-801-735-4220
>> Empowering lives through verifiable data.
>>
> --
> Openid-specs-digital-credentials-protocols mailing list
> Openid-specs-digital-credentials-protocols at lists.openid.net
>
> https://lists.openid.net/mailman/listinfo/openid-specs-digital-credentials-protocols
>
>
> --
> Openid-specs-digital-credentials-protocols mailing list
> Openid-specs-digital-credentials-protocols at lists.openid.net
>
> https://lists.openid.net/mailman/listinfo/openid-specs-digital-credentials-protocols
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openid.net/pipermail/openid-specs-digital-credentials-protocols/attachments/20240822/a370e188/attachment-0001.html>