Expand description
Core functionality for handlers.
Constants§
- DEFAULT_
CHANNEL_ BUFFER_ SIZE - Default buffer size for the response channel used in streaming operations.
Functions§
- create_
response_ channel - Creates a channel for response communication.
- send_
request - Sends a request to the model processing pipeline.
- send_
request_ with_ model