From 66f5e9f57f82e5179abaa6af3396db39c93c8be3 Mon Sep 17 00:00:00 2001 From: Harsha Vamsi Kalluri Date: Fri, 2 Jun 2023 15:16:57 -0700 Subject: [PATCH 01/16] Adds new blog post announcing opensearch hadoop Signed-off-by: Harsha Vamsi Kalluri --- ...23-06-05-opensearch-hadoop-launch.markdown | 50 +++++++++++++++++++ 1 file changed, 50 insertions(+) create mode 100644 _posts/2023-06-05-opensearch-hadoop-launch.markdown diff --git a/_posts/2023-06-05-opensearch-hadoop-launch.markdown b/_posts/2023-06-05-opensearch-hadoop-launch.markdown new file mode 100644 index 0000000000..3ee51c6158 --- /dev/null +++ b/_posts/2023-06-05-opensearch-hadoop-launch.markdown @@ -0,0 +1,50 @@ +--- +layout: post +title: "Announcing the general availability of the OpenSearch Hadoop client" +authors: + - hvamsi + - nknize +date: 2023-05-06 12:15:00 -0700 +categories: + - releases +meta_keywords: opensearch hadoop, apache spark, apache hive, apache hadoop, openseearch, mapreduce, hdfs +meta_description: OpenSearch Hadoop is now generally available with support for multiple versions of OpenSearch to run on Spark and Hive. +twittercard: + description: OpenSearch Hadoop is now generally available with support for multiple versions of OpenSearch to run on Spark and Hive. +excerpt: We are excited to announce the release of the new OpenSearch-Hadoop connector. This tool enables efficient interaction between your Hadoop-based Big Data operations and OpenSearch clusters, supporting all versions of OpenSearch. +--- + +We are excited to announce the release of the new OpenSearch-Hadoop connector. This tool enables efficient interaction between your Hadoop-based Big Data operations and OpenSearch clusters, supporting all versions of OpenSearch. + +## OpenSearch-Hadoop Connector Features: + +- **Versatility**: Compatible with Scala up to version 2.13.x and Spark up to version 3.2.x, the connector facilitates data processing and analysis operations across different environments. +- **Memory and I/O Efficient**: The connector is designed with a focus on performance. It uses pull-based parsing, supports bulk updates, and direct conversion to/of native types, resulting in efficient memory and network I/O usage. +- **Adaptive I/O**: The connector can detect transport errors and retry automatically. In case of node failures, it can re-route requests to available nodes. If OpenSearch is overloaded, the connector can detect data rejection and resend it. +- **Facilitates Data Co-Location**: The connector integrates with Hadoop to expose network access information, enabling co-located OpenSearch and Hadoop clusters to be aware of each other, thus reducing network I/O. +- **Secure Access**: Supports IAM for AWS-managed OpenSearch, ensuring secure access to your AWS resources. + +## Compatibility with OpenSearch + +The below matrix shows the compatibility of the [`opensearch-hadoop`](https://central.sonatype.com/artifact/org.opensearch.client/opensearch-hadoop) with versions of [`OpenSearch`](https://opensearch.org/downloads.html#opensearch). + +| Client Version | OpenSearch Version | ElasticSearch Version | +| -------------- | ------------------ | --------------------- | +| 1.0.1 | 1.0.0-2.8.0 | 7.10 | + +## Compatibility with Spark and Scala + +| Client Version | Spark Version | Scala Version(s) | +| -------------- | ------------- | ---------------- | +| 1.0.1 | 2.2.3 | 2.10 | +| 1.0.1 | 2.4.4 | 2.11/2.12 | +| 1.0.1 | 3.2.4 | 2.12/2.13 | + +## Compatibility with AWS Glue + +| Client Version | Spark Version | Glue Version(s) | +| -------------- | ------------- | --------------- | +| 1.0.1 | 2.4.4 | 2 | +| 1.0.1 | 3.2.4 | 3/4 | + +This connector is a crucial tool for anyone looking to leverage the full power of OpenSearch alongside their Hadoop ecosystem. Download and start using it today. From b28eb9163eef8df76379ec5e799e3a0321f3b1d4 Mon Sep 17 00:00:00 2001 From: Harsha Vamsi Kalluri Date: Tue, 6 Jun 2023 09:00:58 -0700 Subject: [PATCH 02/16] Fix vale grammar errors Signed-off-by: Harsha Vamsi Kalluri --- _posts/2023-06-05-opensearch-hadoop-launch.markdown | 10 +++++----- 1 file changed, 5 insertions(+), 5 deletions(-) diff --git a/_posts/2023-06-05-opensearch-hadoop-launch.markdown b/_posts/2023-06-05-opensearch-hadoop-launch.markdown index 3ee51c6158..f095382e70 100644 --- a/_posts/2023-06-05-opensearch-hadoop-launch.markdown +++ b/_posts/2023-06-05-opensearch-hadoop-launch.markdown @@ -16,7 +16,7 @@ excerpt: We are excited to announce the release of the new OpenSearch-Hadoop con We are excited to announce the release of the new OpenSearch-Hadoop connector. This tool enables efficient interaction between your Hadoop-based Big Data operations and OpenSearch clusters, supporting all versions of OpenSearch. -## OpenSearch-Hadoop Connector Features: +## OpenSearch-Hadoop connector features: - **Versatility**: Compatible with Scala up to version 2.13.x and Spark up to version 3.2.x, the connector facilitates data processing and analysis operations across different environments. - **Memory and I/O Efficient**: The connector is designed with a focus on performance. It uses pull-based parsing, supports bulk updates, and direct conversion to/of native types, resulting in efficient memory and network I/O usage. @@ -28,13 +28,13 @@ We are excited to announce the release of the new OpenSearch-Hadoop connector. T The below matrix shows the compatibility of the [`opensearch-hadoop`](https://central.sonatype.com/artifact/org.opensearch.client/opensearch-hadoop) with versions of [`OpenSearch`](https://opensearch.org/downloads.html#opensearch). -| Client Version | OpenSearch Version | ElasticSearch Version | +| Client version | OpenSearch version | Elasticsearch version | | -------------- | ------------------ | --------------------- | | 1.0.1 | 1.0.0-2.8.0 | 7.10 | -## Compatibility with Spark and Scala +## Compatibility with spark and scala -| Client Version | Spark Version | Scala Version(s) | +| Client version | Spark version | Scala version(s) | | -------------- | ------------- | ---------------- | | 1.0.1 | 2.2.3 | 2.10 | | 1.0.1 | 2.4.4 | 2.11/2.12 | @@ -42,7 +42,7 @@ The below matrix shows the compatibility of the [`opensearch-hadoop`](https://ce ## Compatibility with AWS Glue -| Client Version | Spark Version | Glue Version(s) | +| Client version | Spark version | Glue version(s) | | -------------- | ------------- | --------------- | | 1.0.1 | 2.4.4 | 2 | | 1.0.1 | 3.2.4 | 3/4 | From bb8a3f7422eb21fbb1c18d4ca8d75c41e8c7a54f Mon Sep 17 00:00:00 2001 From: Harsha Vamsi Kalluri Date: Tue, 6 Jun 2023 10:55:59 -0700 Subject: [PATCH 03/16] Update _posts/2023-06-05-opensearch-hadoop-launch.markdown Co-authored-by: Melissa Vagi Signed-off-by: Harsha Vamsi Kalluri --- _posts/2023-06-05-opensearch-hadoop-launch.markdown | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/_posts/2023-06-05-opensearch-hadoop-launch.markdown b/_posts/2023-06-05-opensearch-hadoop-launch.markdown index f095382e70..830afe50c8 100644 --- a/_posts/2023-06-05-opensearch-hadoop-launch.markdown +++ b/_posts/2023-06-05-opensearch-hadoop-launch.markdown @@ -16,7 +16,7 @@ excerpt: We are excited to announce the release of the new OpenSearch-Hadoop con We are excited to announce the release of the new OpenSearch-Hadoop connector. This tool enables efficient interaction between your Hadoop-based Big Data operations and OpenSearch clusters, supporting all versions of OpenSearch. -## OpenSearch-Hadoop connector features: +## OpenSearch Hadoop connector features: - **Versatility**: Compatible with Scala up to version 2.13.x and Spark up to version 3.2.x, the connector facilitates data processing and analysis operations across different environments. - **Memory and I/O Efficient**: The connector is designed with a focus on performance. It uses pull-based parsing, supports bulk updates, and direct conversion to/of native types, resulting in efficient memory and network I/O usage. From 8d90bbc440d147731a18b3cf2224ebe86ff93f92 Mon Sep 17 00:00:00 2001 From: Harsha Vamsi Kalluri Date: Tue, 6 Jun 2023 10:56:06 -0700 Subject: [PATCH 04/16] Update _posts/2023-06-05-opensearch-hadoop-launch.markdown Co-authored-by: Melissa Vagi Signed-off-by: Harsha Vamsi Kalluri --- _posts/2023-06-05-opensearch-hadoop-launch.markdown | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/_posts/2023-06-05-opensearch-hadoop-launch.markdown b/_posts/2023-06-05-opensearch-hadoop-launch.markdown index 830afe50c8..f9c1a9929a 100644 --- a/_posts/2023-06-05-opensearch-hadoop-launch.markdown +++ b/_posts/2023-06-05-opensearch-hadoop-launch.markdown @@ -11,7 +11,7 @@ meta_keywords: opensearch hadoop, apache spark, apache hive, apache hadoop, open meta_description: OpenSearch Hadoop is now generally available with support for multiple versions of OpenSearch to run on Spark and Hive. twittercard: description: OpenSearch Hadoop is now generally available with support for multiple versions of OpenSearch to run on Spark and Hive. -excerpt: We are excited to announce the release of the new OpenSearch-Hadoop connector. This tool enables efficient interaction between your Hadoop-based Big Data operations and OpenSearch clusters, supporting all versions of OpenSearch. +excerpt: We are excited to announce the release of the new OpenSearch Hadoop connector. This tool enables efficient interaction between your Hadoop-based Big Data operations and OpenSearch clusters, supporting all versions of OpenSearch. --- We are excited to announce the release of the new OpenSearch-Hadoop connector. This tool enables efficient interaction between your Hadoop-based Big Data operations and OpenSearch clusters, supporting all versions of OpenSearch. From 615e2d387a92d1693a46bd2551648799fd7f9f65 Mon Sep 17 00:00:00 2001 From: Harsha Vamsi Kalluri Date: Tue, 6 Jun 2023 10:56:12 -0700 Subject: [PATCH 05/16] Update _posts/2023-06-05-opensearch-hadoop-launch.markdown Co-authored-by: Melissa Vagi Signed-off-by: Harsha Vamsi Kalluri --- _posts/2023-06-05-opensearch-hadoop-launch.markdown | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/_posts/2023-06-05-opensearch-hadoop-launch.markdown b/_posts/2023-06-05-opensearch-hadoop-launch.markdown index f9c1a9929a..c00937f501 100644 --- a/_posts/2023-06-05-opensearch-hadoop-launch.markdown +++ b/_posts/2023-06-05-opensearch-hadoop-launch.markdown @@ -19,7 +19,7 @@ We are excited to announce the release of the new OpenSearch-Hadoop connector. T ## OpenSearch Hadoop connector features: - **Versatility**: Compatible with Scala up to version 2.13.x and Spark up to version 3.2.x, the connector facilitates data processing and analysis operations across different environments. -- **Memory and I/O Efficient**: The connector is designed with a focus on performance. It uses pull-based parsing, supports bulk updates, and direct conversion to/of native types, resulting in efficient memory and network I/O usage. +- **Memory and Input/Output (I/O) Efficient**: The connector is designed with a focus on performance. It uses pull-based parsing and supports bulk updates to and direct conversion of native types, resulting in efficient memory and network I/O usage. - **Adaptive I/O**: The connector can detect transport errors and retry automatically. In case of node failures, it can re-route requests to available nodes. If OpenSearch is overloaded, the connector can detect data rejection and resend it. - **Facilitates Data Co-Location**: The connector integrates with Hadoop to expose network access information, enabling co-located OpenSearch and Hadoop clusters to be aware of each other, thus reducing network I/O. - **Secure Access**: Supports IAM for AWS-managed OpenSearch, ensuring secure access to your AWS resources. From b738d94e7c46b9394f98422d0dd9bdf311a30d90 Mon Sep 17 00:00:00 2001 From: Harsha Vamsi Kalluri Date: Tue, 6 Jun 2023 10:56:17 -0700 Subject: [PATCH 06/16] Update _posts/2023-06-05-opensearch-hadoop-launch.markdown Co-authored-by: Melissa Vagi Signed-off-by: Harsha Vamsi Kalluri --- _posts/2023-06-05-opensearch-hadoop-launch.markdown | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/_posts/2023-06-05-opensearch-hadoop-launch.markdown b/_posts/2023-06-05-opensearch-hadoop-launch.markdown index c00937f501..b4746117fe 100644 --- a/_posts/2023-06-05-opensearch-hadoop-launch.markdown +++ b/_posts/2023-06-05-opensearch-hadoop-launch.markdown @@ -20,7 +20,7 @@ We are excited to announce the release of the new OpenSearch-Hadoop connector. T - **Versatility**: Compatible with Scala up to version 2.13.x and Spark up to version 3.2.x, the connector facilitates data processing and analysis operations across different environments. - **Memory and Input/Output (I/O) Efficient**: The connector is designed with a focus on performance. It uses pull-based parsing and supports bulk updates to and direct conversion of native types, resulting in efficient memory and network I/O usage. -- **Adaptive I/O**: The connector can detect transport errors and retry automatically. In case of node failures, it can re-route requests to available nodes. If OpenSearch is overloaded, the connector can detect data rejection and resend it. +- **Adaptive I/O**: The connector can detect transport errors and retry automatically. In case of node failures, it can reroute requests to available nodes. If OpenSearch is overloaded, the connector can detect data rejection and resend it. - **Facilitates Data Co-Location**: The connector integrates with Hadoop to expose network access information, enabling co-located OpenSearch and Hadoop clusters to be aware of each other, thus reducing network I/O. - **Secure Access**: Supports IAM for AWS-managed OpenSearch, ensuring secure access to your AWS resources. From b9d86ea62463d2ae4cef4a9244c16eac3526129d Mon Sep 17 00:00:00 2001 From: Harsha Vamsi Kalluri Date: Tue, 6 Jun 2023 10:56:24 -0700 Subject: [PATCH 07/16] Update _posts/2023-06-05-opensearch-hadoop-launch.markdown Co-authored-by: Melissa Vagi Signed-off-by: Harsha Vamsi Kalluri --- _posts/2023-06-05-opensearch-hadoop-launch.markdown | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/_posts/2023-06-05-opensearch-hadoop-launch.markdown b/_posts/2023-06-05-opensearch-hadoop-launch.markdown index b4746117fe..925d69d299 100644 --- a/_posts/2023-06-05-opensearch-hadoop-launch.markdown +++ b/_posts/2023-06-05-opensearch-hadoop-launch.markdown @@ -21,7 +21,7 @@ We are excited to announce the release of the new OpenSearch-Hadoop connector. T - **Versatility**: Compatible with Scala up to version 2.13.x and Spark up to version 3.2.x, the connector facilitates data processing and analysis operations across different environments. - **Memory and Input/Output (I/O) Efficient**: The connector is designed with a focus on performance. It uses pull-based parsing and supports bulk updates to and direct conversion of native types, resulting in efficient memory and network I/O usage. - **Adaptive I/O**: The connector can detect transport errors and retry automatically. In case of node failures, it can reroute requests to available nodes. If OpenSearch is overloaded, the connector can detect data rejection and resend it. -- **Facilitates Data Co-Location**: The connector integrates with Hadoop to expose network access information, enabling co-located OpenSearch and Hadoop clusters to be aware of each other, thus reducing network I/O. +- **Data Co-location Integration**: The connector integrates with Hadoop to expose network access information, enabling co-located OpenSearch and Hadoop clusters to be aware of each other, thus reducing network I/O. - **Secure Access**: Supports IAM for AWS-managed OpenSearch, ensuring secure access to your AWS resources. ## Compatibility with OpenSearch From 14d65f7b03c29d9c99967c4a602c28b58dba80f5 Mon Sep 17 00:00:00 2001 From: Harsha Vamsi Kalluri Date: Tue, 6 Jun 2023 10:56:31 -0700 Subject: [PATCH 08/16] Update _posts/2023-06-05-opensearch-hadoop-launch.markdown Co-authored-by: Melissa Vagi Signed-off-by: Harsha Vamsi Kalluri --- _posts/2023-06-05-opensearch-hadoop-launch.markdown | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/_posts/2023-06-05-opensearch-hadoop-launch.markdown b/_posts/2023-06-05-opensearch-hadoop-launch.markdown index 925d69d299..91fddb5248 100644 --- a/_posts/2023-06-05-opensearch-hadoop-launch.markdown +++ b/_posts/2023-06-05-opensearch-hadoop-launch.markdown @@ -22,7 +22,7 @@ We are excited to announce the release of the new OpenSearch-Hadoop connector. T - **Memory and Input/Output (I/O) Efficient**: The connector is designed with a focus on performance. It uses pull-based parsing and supports bulk updates to and direct conversion of native types, resulting in efficient memory and network I/O usage. - **Adaptive I/O**: The connector can detect transport errors and retry automatically. In case of node failures, it can reroute requests to available nodes. If OpenSearch is overloaded, the connector can detect data rejection and resend it. - **Data Co-location Integration**: The connector integrates with Hadoop to expose network access information, enabling co-located OpenSearch and Hadoop clusters to be aware of each other, thus reducing network I/O. -- **Secure Access**: Supports IAM for AWS-managed OpenSearch, ensuring secure access to your AWS resources. +- **Secure Access**: Supports identity and access management (IAM) for AWS-managed OpenSearch, ensuring secure access to your AWS resources. ## Compatibility with OpenSearch From ecbce98e3cec2d2aa5f1e9f4c13709499a0bd272 Mon Sep 17 00:00:00 2001 From: Harsha Vamsi Kalluri Date: Tue, 6 Jun 2023 10:56:37 -0700 Subject: [PATCH 09/16] Update _posts/2023-06-05-opensearch-hadoop-launch.markdown Co-authored-by: Melissa Vagi Signed-off-by: Harsha Vamsi Kalluri --- _posts/2023-06-05-opensearch-hadoop-launch.markdown | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/_posts/2023-06-05-opensearch-hadoop-launch.markdown b/_posts/2023-06-05-opensearch-hadoop-launch.markdown index 91fddb5248..f163980015 100644 --- a/_posts/2023-06-05-opensearch-hadoop-launch.markdown +++ b/_posts/2023-06-05-opensearch-hadoop-launch.markdown @@ -26,7 +26,7 @@ We are excited to announce the release of the new OpenSearch-Hadoop connector. T ## Compatibility with OpenSearch -The below matrix shows the compatibility of the [`opensearch-hadoop`](https://central.sonatype.com/artifact/org.opensearch.client/opensearch-hadoop) with versions of [`OpenSearch`](https://opensearch.org/downloads.html#opensearch). +The following matrix shows the compatibility of [`opensearch-hadoop`](https://central.sonatype.com/artifact/org.opensearch.client/opensearch-hadoop) with versions of [`OpenSearch`](https://opensearch.org/downloads.html#opensearch). | Client version | OpenSearch version | Elasticsearch version | | -------------- | ------------------ | --------------------- | From 71dd439066cc3c75bb87f9a869175cc67d988f52 Mon Sep 17 00:00:00 2001 From: Harsha Vamsi Kalluri Date: Tue, 6 Jun 2023 10:56:43 -0700 Subject: [PATCH 10/16] Update _posts/2023-06-05-opensearch-hadoop-launch.markdown Co-authored-by: Melissa Vagi Signed-off-by: Harsha Vamsi Kalluri --- _posts/2023-06-05-opensearch-hadoop-launch.markdown | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/_posts/2023-06-05-opensearch-hadoop-launch.markdown b/_posts/2023-06-05-opensearch-hadoop-launch.markdown index f163980015..e8c015b5c6 100644 --- a/_posts/2023-06-05-opensearch-hadoop-launch.markdown +++ b/_posts/2023-06-05-opensearch-hadoop-launch.markdown @@ -32,7 +32,7 @@ The following matrix shows the compatibility of [`opensearch-hadoop`](https://ce | -------------- | ------------------ | --------------------- | | 1.0.1 | 1.0.0-2.8.0 | 7.10 | -## Compatibility with spark and scala +## Compatibility with Spark and Scala | Client version | Spark version | Scala version(s) | | -------------- | ------------- | ---------------- | From 15cf7b5a7b230bc990738f77b4e55d3028f2b1e9 Mon Sep 17 00:00:00 2001 From: Harsha Vamsi Kalluri Date: Tue, 6 Jun 2023 13:17:19 -0700 Subject: [PATCH 11/16] Update _posts/2023-06-05-opensearch-hadoop-launch.markdown Co-authored-by: Melissa Vagi Signed-off-by: Harsha Vamsi Kalluri --- _posts/2023-06-05-opensearch-hadoop-launch.markdown | 2 ++ 1 file changed, 2 insertions(+) diff --git a/_posts/2023-06-05-opensearch-hadoop-launch.markdown b/_posts/2023-06-05-opensearch-hadoop-launch.markdown index e8c015b5c6..39bac7740f 100644 --- a/_posts/2023-06-05-opensearch-hadoop-launch.markdown +++ b/_posts/2023-06-05-opensearch-hadoop-launch.markdown @@ -47,4 +47,6 @@ The following matrix shows the compatibility of [`opensearch-hadoop`](https://ce | 1.0.1 | 2.4.4 | 2 | | 1.0.1 | 3.2.4 | 3/4 | +## Get started today! + This connector is a crucial tool for anyone looking to leverage the full power of OpenSearch alongside their Hadoop ecosystem. Download and start using it today. From 8d2f0927713cdbce96bcd50f2d9e0371114a668e Mon Sep 17 00:00:00 2001 From: Harsha Vamsi Kalluri Date: Tue, 6 Jun 2023 13:18:26 -0700 Subject: [PATCH 12/16] Update _posts/2023-06-05-opensearch-hadoop-launch.markdown Co-authored-by: Heather Halter Signed-off-by: Harsha Vamsi Kalluri --- _posts/2023-06-05-opensearch-hadoop-launch.markdown | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/_posts/2023-06-05-opensearch-hadoop-launch.markdown b/_posts/2023-06-05-opensearch-hadoop-launch.markdown index 39bac7740f..0eb1a7d8bd 100644 --- a/_posts/2023-06-05-opensearch-hadoop-launch.markdown +++ b/_posts/2023-06-05-opensearch-hadoop-launch.markdown @@ -49,4 +49,4 @@ The following matrix shows the compatibility of [`opensearch-hadoop`](https://ce ## Get started today! -This connector is a crucial tool for anyone looking to leverage the full power of OpenSearch alongside their Hadoop ecosystem. Download and start using it today. +The OpenSearch-Hadoop connector is a must-have tool for anyone looking to leverage the full power of OpenSearch alongside their Hadoop ecosystem. Download and get started today, available on the OpenSearch Downloads page. From 8b1b82237e1d2e8163be908555a688fd4e296fdb Mon Sep 17 00:00:00 2001 From: Harsha Vamsi Kalluri Date: Tue, 6 Jun 2023 15:30:36 -0700 Subject: [PATCH 13/16] Update _posts/2023-06-05-opensearch-hadoop-launch.markdown Co-authored-by: Melissa Vagi Signed-off-by: Harsha Vamsi Kalluri --- _posts/2023-06-05-opensearch-hadoop-launch.markdown | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/_posts/2023-06-05-opensearch-hadoop-launch.markdown b/_posts/2023-06-05-opensearch-hadoop-launch.markdown index 0eb1a7d8bd..e825ca15fe 100644 --- a/_posts/2023-06-05-opensearch-hadoop-launch.markdown +++ b/_posts/2023-06-05-opensearch-hadoop-launch.markdown @@ -16,7 +16,7 @@ excerpt: We are excited to announce the release of the new OpenSearch Hadoop con We are excited to announce the release of the new OpenSearch-Hadoop connector. This tool enables efficient interaction between your Hadoop-based Big Data operations and OpenSearch clusters, supporting all versions of OpenSearch. -## OpenSearch Hadoop connector features: +## OpenSearch-Hadoop connector features - **Versatility**: Compatible with Scala up to version 2.13.x and Spark up to version 3.2.x, the connector facilitates data processing and analysis operations across different environments. - **Memory and Input/Output (I/O) Efficient**: The connector is designed with a focus on performance. It uses pull-based parsing and supports bulk updates to and direct conversion of native types, resulting in efficient memory and network I/O usage. From 6c2f17d7564f1d7936a97fafd47702768de782b5 Mon Sep 17 00:00:00 2001 From: Harsha Vamsi Kalluri Date: Tue, 6 Jun 2023 16:18:22 -0700 Subject: [PATCH 14/16] Update _posts/2023-06-05-opensearch-hadoop-launch.markdown Co-authored-by: Melissa Vagi Signed-off-by: Harsha Vamsi Kalluri --- _posts/2023-06-05-opensearch-hadoop-launch.markdown | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/_posts/2023-06-05-opensearch-hadoop-launch.markdown b/_posts/2023-06-05-opensearch-hadoop-launch.markdown index e825ca15fe..86b508d217 100644 --- a/_posts/2023-06-05-opensearch-hadoop-launch.markdown +++ b/_posts/2023-06-05-opensearch-hadoop-launch.markdown @@ -10,7 +10,7 @@ categories: meta_keywords: opensearch hadoop, apache spark, apache hive, apache hadoop, openseearch, mapreduce, hdfs meta_description: OpenSearch Hadoop is now generally available with support for multiple versions of OpenSearch to run on Spark and Hive. twittercard: - description: OpenSearch Hadoop is now generally available with support for multiple versions of OpenSearch to run on Spark and Hive. + description: OpenSearch-Hadoop is now generally available with support for multiple versions of OpenSearch to run on Spark and Hive. excerpt: We are excited to announce the release of the new OpenSearch Hadoop connector. This tool enables efficient interaction between your Hadoop-based Big Data operations and OpenSearch clusters, supporting all versions of OpenSearch. --- From 1d24543f09b5ed1fc4909e83d9d4abe8d2e5f667 Mon Sep 17 00:00:00 2001 From: Harsha Vamsi Kalluri Date: Tue, 6 Jun 2023 16:18:30 -0700 Subject: [PATCH 15/16] Update _posts/2023-06-05-opensearch-hadoop-launch.markdown Co-authored-by: Melissa Vagi Signed-off-by: Harsha Vamsi Kalluri --- _posts/2023-06-05-opensearch-hadoop-launch.markdown | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/_posts/2023-06-05-opensearch-hadoop-launch.markdown b/_posts/2023-06-05-opensearch-hadoop-launch.markdown index 86b508d217..23f27b8209 100644 --- a/_posts/2023-06-05-opensearch-hadoop-launch.markdown +++ b/_posts/2023-06-05-opensearch-hadoop-launch.markdown @@ -11,7 +11,7 @@ meta_keywords: opensearch hadoop, apache spark, apache hive, apache hadoop, open meta_description: OpenSearch Hadoop is now generally available with support for multiple versions of OpenSearch to run on Spark and Hive. twittercard: description: OpenSearch-Hadoop is now generally available with support for multiple versions of OpenSearch to run on Spark and Hive. -excerpt: We are excited to announce the release of the new OpenSearch Hadoop connector. This tool enables efficient interaction between your Hadoop-based Big Data operations and OpenSearch clusters, supporting all versions of OpenSearch. +excerpt: We are excited to announce the release of the new OpenSearch-Hadoop connector. This tool enables efficient interaction between your Hadoop-based Big Data operations and OpenSearch clusters, supporting all versions of OpenSearch. --- We are excited to announce the release of the new OpenSearch-Hadoop connector. This tool enables efficient interaction between your Hadoop-based Big Data operations and OpenSearch clusters, supporting all versions of OpenSearch. From 34d689239174071db75ae6cf1b6f86cb01a6af8b Mon Sep 17 00:00:00 2001 From: Harsha Vamsi Kalluri Date: Wed, 7 Jun 2023 09:59:52 -0700 Subject: [PATCH 16/16] Add download links Signed-off-by: Harsha Vamsi Kalluri --- _posts/2023-06-05-opensearch-hadoop-launch.markdown | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/_posts/2023-06-05-opensearch-hadoop-launch.markdown b/_posts/2023-06-05-opensearch-hadoop-launch.markdown index 23f27b8209..404ba605b0 100644 --- a/_posts/2023-06-05-opensearch-hadoop-launch.markdown +++ b/_posts/2023-06-05-opensearch-hadoop-launch.markdown @@ -16,7 +16,7 @@ excerpt: We are excited to announce the release of the new OpenSearch-Hadoop con We are excited to announce the release of the new OpenSearch-Hadoop connector. This tool enables efficient interaction between your Hadoop-based Big Data operations and OpenSearch clusters, supporting all versions of OpenSearch. -## OpenSearch-Hadoop connector features +## The following highlights the connector's features: - **Versatility**: Compatible with Scala up to version 2.13.x and Spark up to version 3.2.x, the connector facilitates data processing and analysis operations across different environments. - **Memory and Input/Output (I/O) Efficient**: The connector is designed with a focus on performance. It uses pull-based parsing and supports bulk updates to and direct conversion of native types, resulting in efficient memory and network I/O usage. @@ -49,4 +49,4 @@ The following matrix shows the compatibility of [`opensearch-hadoop`](https://ce ## Get started today! -The OpenSearch-Hadoop connector is a must-have tool for anyone looking to leverage the full power of OpenSearch alongside their Hadoop ecosystem. Download and get started today, available on the OpenSearch Downloads page. +The OpenSearch-Hadoop connector is a must-have tool for anyone looking to leverage the full power of OpenSearch alongside their Hadoop ecosystem. Download and get started today [here](https://central.sonatype.com/artifact/org.opensearch.client/opensearch-hadoop/1.0.1).