Event Stream Processing
When you install the Streaming Data Framework for MATLAB® Production Server™, you can:
Read and write event streams from an event streaming platform, such as Kafka.
Simulate the production environment for testing your streaming analytic algorithms. (Requires MATLAB Compiler SDK™)
Scale your streaming analytic algorithms by deploying them. (Requires MATLAB Production Server)
Install the Streaming Data Framework for MATLAB Production Server support package from the MATLAB Add-On Explorer. For information about installing add-ons, see Get and Manage Add-Ons (MATLAB).
Connect to Event Streams
Read and Write Events
Basic Import and Export
|Read timetable from event stream (Since R2022b)
|Write timetable to event stream (Since R2022b)
|Set read position in event stream (Since R2022b)
|Preview subset of events from event stream (Since R2022b)
|Event stream name (Since R2022b)
Import and Export Options
|Create import options based on event stream content (Since R2022b)
|Create options for importing events from stream into MATLAB (Since R2022b)
|Import options for event stream (Since R2022b)
|Data types used to export variables to stream (Since R2022b)
|Set data types used to import and export variables to stream (Since R2022b)
|Create export options based on event stream content (Since R2022b)
|Export options for event stream (Since R2022b)
Kafka Stream Operations
|Read raw events from Kafka stream without schema processing applied (Since R2022b)
|Reset read window boundaries (Since R2022b)
|Stop processing event streams from Kafka topic (Since R2022b)
|Create topic in Kafka cluster (Since R2022b)
|Remove topic from Kafka cluster (Since R2022b)
|Error information for Kafka stream operation (Since R2022b)
Kafka Provider Properties
Simulate Production Environment
|Apply stream analytic function to event stream (Since R2022b)
|Execute event stream processing function on specific number of event windows (Since R2022b)
|Package stream processing function into deployable archive configured by
EventStreamProcessor (Since R2022b)
|Set position in event stream to begin processing events (Since R2022b)
|Start processing event streams using local test server (Since R2022b)
|Start local test server (Since R2022b)
|Stop processing event streams using local test server (Since R2022b)
|Shut down local test server (Since R2022b)
Deploy Streaming Analytic
Process Event Streams
- Streaming Data Framework for MATLAB Production Server Basics
Use Streaming Data Framework for MATLAB Production Server to read from and write to event streaming platforms, such as Kafka.
- Process Kafka Events Using MATLAB
Process events from a Kafka stream using a streaming analytic function.
- Connect to Secure Kafka Cluster
Set Kafka provider properties during stream object creation.
Test and Deploy Streaming Analytic Function
- Test Streaming Analytic Function Using Local Test Server
Use the development version of MATLAB Production Server to test a streaming analytic function before deployment to MATLAB Production Server.
- Deploy Streaming Analytic Function to MATLAB Production Server
Package a streaming analytic function and deploy to server.
Locate event stream log files to help with debugging issues.