Skip to content

Commit

Permalink
fixes #8
Browse files Browse the repository at this point in the history
> Currently, the value for "max empty response" is set to 10 and cannot
be modified via an option of the commandline command. However, we
discovered cases, were we run into this issue and I guess it would be
nice, if we could increase it a bit, to see whether we'll get some more
data out of the OAI endpoint.
  • Loading branch information
miku committed Oct 10, 2018
1 parent 94af72c commit 40fe16d
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion cmd/metha-sync/main.go
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,7 @@ func main() {
from := flag.String("from", "", "set the start date, format: 2006-01-02, use only if you do not want the endpoints earliest date")
quiet := flag.Bool("q", false, "suppress all output")
endpointList := flag.Bool("list", false, "list a selection of OAI endpoints (might be outdated)")
maxEmptyReponses := flag.Int("max-empty-responses", 10, "allow a number of empty responses before failing")

logFile := flag.String("log", "", "filename to log to")

Expand Down Expand Up @@ -80,7 +81,7 @@ func main() {
harvest.MaxRequests = *maxRequests
harvest.CleanBeforeDecode = true
harvest.DisableSelectiveHarvesting = *disableSelectiveHarvesting
harvest.MaxEmptyResponses = 10
harvest.MaxEmptyResponses = *maxEmptyReponses
harvest.IgnoreHTTPErrors = *ignoreHTTPErrors
harvest.SuppressFormatParameter = *suppressFormatParameter
harvest.DailyInterval = *daily
Expand Down

0 comments on commit 40fe16d

Please sign in to comment.