test: introduce BDD e2e tests

[odubajDT]

This PR

• adds test-harness submodule to this repository
• adds e2e tests
• refactors CI executing the tests

Related Issues

Fixes #111

[codecov]

Codecov Report

Merging #124 (8b235d1) into main (b19e6e5) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main     #124   +/-   ##
=======================================
  Coverage   90.95%   90.95%           
=======================================
  Files          27       27           
  Lines         553      553           
  Branches       37       37           
=======================================
  Hits          503      503           
  Misses         37       37           
  Partials       13       13           

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

[toddbaert]

Awesome work @odubajDT ! Very good to have this in the dotnet SDK! It's a real confidence booster. I will review.

[toddbaert]

@odubajDT I'm OK with consolidating jobs, but we need to run a build on windows-latest to ensure the integrity of the net462 build.

Also, if possible (and easy) it would be good to run the e2e tests there too. If that's not possible that's OK though.

[odubajDT]

good point, will fix

[odubajDT]

Fixed, so in the current state the following tests are ran:

linux: unit tests with .Net 6 and .Net 7 + E2E tests
windows: unit tests with .Net 6, .Net 7 and .Net 4.6.2

Running e2e tests on windows might be a little bit problematic due to that container operations are only supported on Linux runners. Therefore we are unable to start the flagd container. I guess it is ok when the e2e tests are ran only on linux.

Hope this meets the requirements.

[toddbaert]

I was worried because I didn't see test commands specifically targeting the bin\Release\net462\ folder, but it seems like they are being picked up automatically in the windows build:

Starting test execution, please wait...
A total of 1 test files matched the specified pattern.
D:\a\dotnet-sdk\dotnet-sdk\test\OpenFeature.Tests\bin\Release\net6.0\OpenFeature.Tests.dll
[xUnit.net 00:00:00.00] xUnit.net VSTest Adapter v2.4.3+1b45f5407b (64-bit .NET 6.0.16)
[xUnit.net 00:00:07.30]   Discovering: OpenFeature.Tests
[xUnit.net 00:00:07.54]   Discovered:  OpenFeature.Tests
[xUnit.net 00:00:07.54]   Starting:    OpenFeature.Tests

So I think we're good!

[toddbaert]

This is great! The only thing blocking my approval is this.

[toddbaert]

Awesome. This is great to finally have. Thanks @odubajDT !