…azure, hadoop-aws, hadoop-openstack and implicitly their transitive dependencies are resolved. They don't verify all dependency setup, specifically that Jackson versions are consistent; that needs integration testing.

…opriately

…eam tests which pulled in spark-cloud but not spark-hive were ending up with inconsistent versions. Add a test for the missing class being there too.

…s; link to remaning docs from top level.

…CP is set up consistently for the later versions of the AWS SDK

…and docs

…anup

…ct references to AWS classes failing. Cut them and rely on transitive load through FS class instantation to force the load. All that happens is that failures to link will be slightly less easy to debug.

…ack JARs, transitive dependencies on aws and azure SDKs

…ranch-2, s3 ireland

Change-Id: I3dea2544f089615493163f0fae482992873f9c35

Change-Id: Ibd6d40df2bc8a2edf19a058c458bea233ba414fd

… as well as 2.7, keeping azure the 2.7.x dependency. All dependencies are scoped @ hadoop.scope

Change-Id: I80bd95fd48e21cf2eb4d94907ac99081cd3bd375

Change-Id: I91f764aeed7d832df1538453d869a7fd83964d65

Change-Id: I12ea6ed72ffa9edee964c90c862ff4c45bc4f47f

…urity, spark-specific options + links elsewhere

Change-Id: I7e9efe20d116802a403af875b241b91178078d78

Change-Id: I1923a4b6a959d86aa2c5b3d71faaaf2541d3ba85

Change-Id: I6a0b0b9f06a4adcdf55ef75161dc1039961bc7a1

Change-Id: Ic4804667af8e52b7be11fb00621ad8b69a1d2569

Change-Id: I2b75a2722f0082b916b9be20bd23a0bdc2d36615

*  module is renamed hadoop-cloud in POMs, sbt, docs
*  hadoop-aws/azure/openstack declarations pushed down to hadoop-cloud pom, along with jackson-cbor
* docs around the commit algorithm option make clear that you should only worry about v1 vs v2 if the blobstore is consistent

Change-Id: Ia114bc8cd2ef731d54a83774d9dc2cf9e4c6e7d4

…oud. Added an extra callout to the docs "without some form of consistency layer, Amazon S3 cannot

be safely used as the direct destination of work with the normal rename-based committer"

That holds for all Spark-in-EC deployments; EMR has a consistency option, as do/will others; different committers can work reliably.

Change-Id: Ibbf8b1b9de10b5bb83b647cc663ceb970f70ff2d
Testing: SBT and maven, with & without the hadoop-2.7 option.

…uple of superflous blank lines

Change-Id: Iee9f0e0527de7bb875d1c2a805a0847702bb4e11