Does AWS SDK CPP 1.11.217 support openssl 3.x

[disa6302]

Hello,

I am trying to use this SDK as a dependency in a project's gtest framework. The unit test is running on an ubuntu 22.04 instance which comes with openssl 3.x by default. The instance has libcurl4-openssl-dev installed which installed openssl 3.x libraries. This is my problematic code block:

   Aws::KinesisVideo::Model::CreateStreamOutcome createStreamOutcome;
    Aws::KinesisVideo::Model::CreateStreamRequest createStreamRequest;
    std::string nameSuffix = generate_hex(16);
    std::string a = "test";
    std::string b = "test";
    createStreamRequest.WithStreamName(b);
    createStreamRequest.WithDataRetentionInHours(24);
    createStreamOutcome = mKvsClient.CreateStream(createStreamRequest);

When this code block executes, I see this stack trace:

0x0000555555a5a074 in EC_GROUP_order_bits ()
(gdb) bt
#0  0x0000555555a5a074 in EC_GROUP_order_bits ()
#1  0x00007ffff6d6aa8d in ?? () from /lib/x86_64-linux-gnu/libcrypto.so.3
#2  0x00007ffff6d70deb in ENGINE_init () from /lib/x86_64-linux-gnu/libcrypto.so.3
#3  0x00007ffff6da7301 in ?? () from /lib/x86_64-linux-gnu/libcrypto.so.3
#4  0x00007ffff71963d3 in SSL_CTX_new_ex () from /lib/x86_64-linux-gnu/libssl.so.3
#5  0x00007ffff7dea1d7 in ?? () from /lib/x86_64-linux-gnu/libcurl.so.4
#6  0x00007ffff7df0417 in ?? () from /lib/x86_64-linux-gnu/libcurl.so.4
#7  0x00007ffff7decd0b in ?? () from /lib/x86_64-linux-gnu/libcurl.so.4
#8  0x00007ffff7da5076 in ?? () from /lib/x86_64-linux-gnu/libcurl.so.4
#9  0x00007ffff7dbeef6 in ?? () from /lib/x86_64-linux-gnu/libcurl.so.4
#10 0x00007ffff7dc13ee in curl_multi_perform () from /lib/x86_64-linux-gnu/libcurl.so.4
#11 0x00007ffff7d9deb3 in curl_easy_perform () from /lib/x86_64-linux-gnu/libcurl.so.4
#12 0x00005555558e339f in Aws::Http::CurlHttpClient::MakeRequest(std::shared_ptr<Aws::Http::HttpRequest> const&, Aws::Utils::RateLimits::RateLimiterInterface*, Aws::Utils::RateLimits::RateLimiterInterface*) const ()
#13 0x000055555585320b in std::_Function_handler<std::shared_ptr<Aws::Http::HttpResponse> (), Aws::Client::AWSClient::AttemptOneRequest(std::shared_ptr<Aws::Http::HttpRequest> const&, Aws::AmazonWebServiceRequest const&, char const*, char const*, char const*) const::{lambda()#3}>::_M_invoke(std::_Any_data const&) ()
#14 0x00005555558beb7b in std::shared_ptr<Aws::Http::HttpResponse> smithy::components::tracing::TracingUtils::MakeCallWithTiming<std::shared_ptr<Aws::Http::HttpResponse> >(std::function<std::shared_ptr<Aws::Http::HttpResponse> ()>, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, smithy::components::tracing::Meter const&, std::map<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::less<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::allocator<std::pair<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > >&&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&) ()
#15 0x000055555589a3ce in Aws::Client::AWSClient::AttemptOneRequest(std::shared_ptr<Aws::Http::HttpRequest> const&, Aws::AmazonWebServiceRequest const&, char const*, char const*, char const*) const ()
--Type <RET> for more, q to quit, c to continue without paging--
#16 0x00005555558a130e in Aws::Client::AWSClient::AttemptExhaustively(Aws::Http::URI const&, Aws::AmazonWebServiceRequest const&, Aws::Http::HttpMethod, char const*, char const*, char const*) const ()
#17 0x00005555558a41bf in Aws::Client::AWSJsonClient::MakeRequest(Aws::Http::URI const&, Aws::AmazonWebServiceRequest const&, Aws::Http::HttpMethod, char const*, char const*, char const*) const ()
#18 0x00005555558a4b78 in Aws::Client::AWSJsonClient::MakeRequest(Aws::AmazonWebServiceRequest const&, Aws::Endpoint::AWSEndpoint const&, Aws::Http::HttpMethod, char const*, char const*, char const*) const ()
#19 0x0000555555811dcf in Aws::KinesisVideo::KinesisVideoClient::CreateStream(Aws::KinesisVideo::Model::CreateStreamRequest const&) const::{lambda()#1}::operator()() const ()
#20 0x0000555555811ec5 in std::_Function_handler<Aws::Utils::Outcome<Aws::KinesisVideo::Model::CreateStreamResult, Aws::KinesisVideo::KinesisVideoError> (), Aws::KinesisVideo::KinesisVideoClient::CreateStream(Aws::KinesisVideo::Model::CreateStreamRequest const&) const::{lambda()#1}>::_M_invoke(std::_Any_data const&) ()
#21 0x000055555581253a in Aws::KinesisVideo::KinesisVideoClient::CreateStream(Aws::KinesisVideo::Model::CreateStreamRequest const&) const ()
#22 0x0000555555667e86 in com::amazonaws::kinesis::video::webrtcclient::IngestionFunctionalityTest::createStreamAndChannelAndLink (this=0x55555609a420)
    at /home/ubuntu/amazon-kinesis-video-streams-webrtc-sdk-c/tst/IngestionFunctionalityTests.cpp:106
#23 0x000055555566a128 in com::amazonaws::kinesis::video::webrtcclient::IngestionFunctionalityTest_basicCreateConnectJoinSession_Test::TestBody (this=0x55555609a420)
    at /home/ubuntu/amazon-kinesis-video-streams-webrtc-sdk-c/tst/IngestionFunctionalityTests.cpp:322
#24 0x00005555557e95c5 in void testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) ()
#25 0x00005555557e21cb in void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) ()
#26 0x00005555557be5ca in testing::Test::Run() ()
#27 0x00005555557bf09d in testing::TestInfo::Run() ()
#28 0x00005555557bf9db in testing::TestSuite::Run() ()
#29 0x00005555557cfc0d in testing::internal::UnitTestImpl::RunAllTests() ()
#30 0x00005555557ea64c in bool testing::internal::HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) ()
#31 0x00005555557e33a9 in bool testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testin--Type <RET> for more, q to quit, c to continue without paging--
g::internal::UnitTestImpl::*)(), char const*) ()
#32 0x00005555557ce22f in testing::UnitTest::Run() ()
#33 0x00005555557a7314 in RUN_ALL_TESTS () at /home/ubuntu/amazon-kinesis-video-streams-webrtc-sdk-c/open-source/include/gtest/gtest.h:2293
#34 0x00005555557a6e86 in main (argc=1, argv=0x7fffffffe328) at /home/ubuntu/amazon-kinesis-video-streams-webrtc-sdk-c/tst/main.cpp:78
(gdb)

When I run the same test on an ubuntu 20.04 instance, same set up (openssl 1.x gets installed when running sudo apt-get -y install libcurl4-openssl-dev, I do not see any crash happening. Do the AWS SDKs support openssl 3.x?

[disa6302]

Can I get a response on this issue please?

[jmklix]

#2966 (comment)

CPP sdk is finding 1.1.1t on the build path, so if curl is compiled against 3.0, it will probably not work as those 2 are not abi compatible.

1.11.x did fix several bugs around how CPP SDK was trying to resolve where to find libcrypto. 1.9 might be resolving a different path for libcrypto in your case and thats why it works. Hard to tell what exact difference might be as, there are over 2 years of diffs between the 2.

CPP SDK will do a static build against openssl by default, so it will bring in openssl 1.1.1 symbols into the process first and then curl will load later and will crash when it sees openssl symbols already loaded that do not match the openssl version it was compiled against. BUILD_SHARED_LIBS probably works because in that case cpp sdk is still compiled against 1.1.1, but linking is done at runtime and it find openssl 3 in its runtime closure, which mostly works with openssl 1.1.1 headers. You can experiment with building only openssl in shared mode and everything else in static mode. But i would recommend figuring out how to get everything to use same openssl version