Module handler_core

Source
Expand description

Core functionality for handlers.

Constants§

DEFAULT_CHANNEL_BUFFER_SIZE
Default buffer size for the response channel used in streaming operations.

Functions§

create_response_channel
Creates a channel for response communication.
send_request
Sends a request to the model processing pipeline.
send_request_with_model