Kafka-MATLAB integration 'Received unexpected handshake message'

I am currently trying to connect MATLAB via my desktop (windows 11) to a server on 'AWS' via Kafka. I am, however, getting the following error message in MATLAB:

Error using webread

Error connecting to http://localhost:61402/consumer/messages?topic=scratch.tiod.inmotion-01: Failed to connect to localhost

port 61402 after 2212 ms: Couldn't connect to server

and this error on my broker:

tls: received unexpected handshake message of type *tls.clientHelloMsg when waiting for *tls.certificateMsg" .

I have used the following code which should allow me to at least make a proper connection, but it already goes wrong with the handshake. All variables are have the proper values, as the same parameters yield positive results from a .go application and the computer CLI. The ssl messages indicate where it goes wrong. Might there be a problem in this configuration or do I need to add something else?

dataKS = kafkaStream(kafkaHost, kafkaPort, TOPIC, ...
    "group.id", GROUP_ID, ...
    "client.id", CLIENT_ID, ...
    "security.protocol", "ssl", ...
    "ssl.truststore.type", "SSL", ...
    "ssl.key.location", PKI_KEY, ... 
    "ssl.certificate.location", PKI_CERT, ...
    "ssl.ca.location", PKI_CACERT, ...
    "enable.ssl.certificate.verification" , "true");

tt1 = readtimetable(dataKS);

Answer 1

[Dheeraj]

Hi,

I understand you are trying to connect to MATLAB on a AWS server with Kafka as message broker but the initial handshake is throwing an error.

The error message "tls: received unexpected handshake message of type *tls.clientHelloMsg when waiting for *tls.certificateMsg" on your Kafka broker indicates that there is a problem with the TLS handshake process.

The TLS certificate of your Kafka broker is not trusted by your MATLAB program, or the TLS version or ciphers supported by your MATLAB program are not compatible with the TLS version or ciphers supported by your Kafka broker. Check the configuration and network if properly configured with right compatibility.

You could look at the below MATLAB documentation for better insight on how to customize security configuration.

https://mathworks.com/help/mps/java/customize-ssl-configuration.html