Skip to content

Latest commit

 

History

History
34 lines (25 loc) · 1.79 KB

File metadata and controls

34 lines (25 loc) · 1.79 KB

CacheConfig

Configuration for retriever result caching. Controls how retriever results are cached to improve performance and reduce redundant compute. Caching can be configured at specific stages in the retriever pipeline. If no stages are specified, the final results are cached by default.

Properties

Name Type Description Notes
enabled bool Whether caching is enabled for this retriever [optional] [default to True]
ttl_seconds int Time-to-live for cached results in seconds. Default: 1 hour [optional] [default to 3600]
cache_stage_names List[str] List of stage names to cache results after. Stage names must match the stage_name field in the retriever's stages. If not specified, caches the final results after all stages. Examples: ['semantic_search'], ['semantic_search', 'rerank'] [optional]
exclude_fields List[str] Fields to exclude from caching (e.g., PII fields) [optional]
stats CacheStatistics Cache performance statistics [optional]

Example

from mixpeek.models.cache_config import CacheConfig

# TODO update the JSON string below
json = "{}"
# create an instance of CacheConfig from a JSON string
cache_config_instance = CacheConfig.from_json(json)
# print the JSON string representation of the object
print(CacheConfig.to_json())

# convert the object into a dict
cache_config_dict = cache_config_instance.to_dict()
# create an instance of CacheConfig from a dict
cache_config_from_dict = CacheConfig.from_dict(cache_config_dict)

[Back to Model list] [Back to API list] [Back to README]