Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Delimited integration test #435

Merged
merged 2 commits into from
Nov 3, 2017
Merged

Delimited integration test #435

merged 2 commits into from
Nov 3, 2017

Conversation

bluemonk3y
Copy link

#434 - to provide coverage and validation. Includes extending IntegrationTestHarness to support other Serdes

@bluemonk3y bluemonk3y requested a review from dguy November 2, 2017 16:47
private String topicName = "TestTopic";
private TestDataProvider dataProvider;

String format = DataSource.DataSourceSerDe.DELIMITED.name();
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: inline?


Map<String, GenericRow> expectedResults = Collections.singletonMap("ITEM_1", new GenericRow(Arrays.asList( "ITEM_1", "home cinema")));

Map<String, GenericRow> results = testHarness.consumeData(testStreamName, dataProvider.schema(), 1, new StringDeserializer(), IntegrationTestHarness.RESULTS_POLL_MAX_TIME_MS);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we add retries here similar to what has been done in WindowingIntTest, i.e,

TestConditions.waitForCondition(() -> {
     // return true if test condition satisfied
}, timeout, "failure message")

Copy link
Author

@bluemonk3y bluemonk3y Nov 3, 2017

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Im not sure its needed - we aren't windowing/using a table, just pulling from a stream

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

if it proves flakey I will add it in...

Copy link
Contributor

@hjafarpour hjafarpour left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

Copy link
Contributor

@dguy dguy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, though you might want to run the tests a few times to make sure the new test isn't flakey

@bluemonk3y bluemonk3y merged commit a252c75 into confluentinc:4.0.x Nov 3, 2017
@bluemonk3y bluemonk3y deleted the DelimitedIntegrationTest branch November 3, 2017 11:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants