ModelContainerMultiModelConfig class
Constructors
-
ModelContainerMultiModelConfig({Input<String?>? modelCacheSetting})
-
Creates a new ModelContainerMultiModelConfig.
modelCacheSetting Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the endpoint might perform better if you disable model caching. To disable model caching, set the value of this parameter to Disabled. Allowed values are: Enabled and Disabled.
const
-
ModelContainerMultiModelConfig.fromMap(Map<String, dynamic> map)
-
factory
Properties
-
hashCode
→ int
-
The hash code for this object.
no setterinherited
-
modelCacheSetting
→ Input<String?>?
-
Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the endpoint might perform better if you disable model caching. To disable model caching, set the value of this parameter to
Disabled. Allowed values are: Enabled and Disabled.
final
-
runtimeType
→ Type
-
A representation of the runtime type of the object.
no setterinherited
