Skip to content
This repository has been archived by the owner on Jul 24, 2024. It is now read-only.

Lightning, check that the data is not actually imported in the target table, but no error is reported in the log #1306

Open
Novsev opened this issue Jul 2, 2021 · 3 comments
Labels
type/feature-request New feature or request

Comments

@Novsev
Copy link

Novsev commented Jul 2, 2021

Feature Request

Describe your feature request related problem:

When using the lightning , the csv file in the data-source-dir path is not named according to the correct naming rules, and there is no warn or error warning in the lightning.log.
Check that no data is actually imported in the target table, but no errors are reported in the log

Describe the feature you'd like:

According to the above situation, should there be a related alarm in the log?

Describe alternatives you've considered:

Teachability, Documentation, Adoption, Migration Strategy:

@Novsev Novsev added the type/feature-request New feature or request label Jul 2, 2021
@kennytm
Copy link
Collaborator

kennytm commented Jul 2, 2021

there should be a [loader] file is filtered by file router log entry for every skipped file. maybe we can improve the wordings.

@IANTHEREAL
Copy link
Collaborator

can we record them in report?

@kennytm
Copy link
Collaborator

kennytm commented Jul 24, 2021

@IANTHEREAL what kind of report?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
type/feature-request New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants