Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] Salesforce does not download all results for large result set #1685

Closed
dacort opened this issue May 10, 2016 · 4 comments
Closed

[WIP] Salesforce does not download all results for large result set #1685

dacort opened this issue May 10, 2016 · 4 comments

Comments

@dacort
Copy link
Contributor

dacort commented May 10, 2016

For particularly large result sets, Salesforce will return multiple result IDs for a single batch.

However, in get_batch_results, only the first result ID is being returned. The code should utilize ET.findall to return a list of result IDs and download each of those to append to the output file.

I'm planning on submitting a PR for this in the next couple of days.

@dlstadther
Copy link
Collaborator

@dacort Sorry about this. I wrote the bulk of Salesforce.py. Most of my salesforce queries involve the salesforce version of joins and so I was never able to use/test batch results well.

Thanks for your desire to improve this module!

@dacort
Copy link
Contributor Author

dacort commented May 11, 2016

No problem @dlstadther! Happy to be able to contribute. :)

@dacort dacort changed the title Salesforce does not download all results for large result set [WIP] Salesforce does not download all results for large result set May 12, 2016
@dacort
Copy link
Contributor Author

dacort commented May 12, 2016

Just realized this creates a CSV file with multiple headers. This shouldn't be merged in yet.

@dlstadther
Copy link
Collaborator

Once things are fixed, i'll review once more

Tarrasch pushed a commit that referenced this issue May 19, 2016
* #1685 Add support for multiple results in batch jobs
Adds a new method 'get_batch_result_ids' and maintains backwards compatibility
with the old method, adding a warning.

* Add the ability to merge result sets and basic testing.
Note that this only supports CSV since this is what the library does by default.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants