Event Stream Processing
When you install the Streaming Data Framework for MATLAB® Production Server™, you can:
Read and write event streams from an event streaming platform, such as Kafka.
Simulate the production environment for testing your streaming analytic algorithms. (Requires MATLAB Compiler SDK™)
Scale your streaming analytic algorithms by deploying them. (Requires MATLAB Production Server)
Install the Streaming Data Framework for MATLAB Production Server support package from the MATLAB Add-On Explorer. For information about installing add-ons, see Get and Manage Add-Ons (MATLAB).
Connect to Event Streams
|Create connection to event stream in Kafka topic|
|Create connection to event stream hosted by MATLAB without schema processing applied|
|Create connection to event stream hosted by MATLAB with schema processing applied|
Read and Write Events
Basic Import and Export
|Read timetable from event stream|
|Write timetable to event stream|
|Set read position in event stream|
|Preview subset of events from event stream|
|Event stream name|
Import and Export Options
|Create import options based on event stream content|
|Create options for importing events from stream into MATLAB|
|Import options for event stream|
|Data types used to export variables to stream|
|Set data types used to import and export variables to stream|
|Create export options based on event stream content|
|Export options for event stream|
Kafka Stream Operations
|Read raw events from Kafka stream without schema processing applied|
|Reset read window boundaries|
|Stop processing event streams from Kafka topic|
|Create topic in Kafka cluster|
|Remove topic from Kafka cluster|
|Error information for Kafka stream operation|
Kafka Provider Properties
|Kafka stream provider property list|
|Kafka stream configuration property data|
|Set properties specific to Kafka configuration|
|Determine if Kafka stream provider property is set|
Simulate Production Environment
|Apply stream analytic function to event stream|
|Execute event stream processing function on specific number of event windows|
|Package stream processing function into deployable archive configured by
|Set position in event stream to begin processing events|
|Start processing event streams using local test server|
|Start local test server|
|Stop processing event streams using local test server|
|Shut down local test server|
Deploy Streaming Analytic
Process Event Streams
- Streaming Data Framework for MATLAB Production Server Basics
Use Streaming Data Framework for MATLAB Production Server to read from and write to event streaming platforms, such as Kafka.
- Process Kafka Events Using MATLAB
Process events from a Kafka stream using a streaming analytic function.
- Connect to Secure Kafka Cluster
Set Kafka provider properties during stream object creation.
Test and Deploy Streaming Analytic Function
- Test Streaming Analytic Function Using Local Test Server
Use the development version of MATLAB Production Server to test a streaming analytic function before deployment to MATLAB Production Server.
- Deploy Streaming Analytic Function to MATLAB Production Server
Package a streaming analytic function and deploy to server.
Obtain Kafka Event Stream Log Files
Locate event stream log files to help with debugging issues.