grafana / loki

Like Prometheus, but for logs.
https://grafana.com/loki
GNU Affero General Public License v3.0
24.08k stars 3.47k forks source link

SERVER_ERROR object too large for cache #14067

Open sslny57 opened 2 months ago

sslny57 commented 2 months ago
0 query_referenced_structured_metadata=false pipeline_wrapper_filtered_lines=0 chunk_refs_fetch_time=1.384079ms cache_chunk_req=3 cache_chunk_hit=2 cache_chunk_bytes_stored=100799 cache_chunk_bytes_fetched=202365 cache_chunk_download_time=311.415µs cache_index_req=0 cache_index_hit=0 cache_index_download_time=0s cache_stats_results_req=1 cache_stats_results_hit=1 cache_stats_results_download_time=788.237µs cache_volume_results_req=0 cache_volume_results_hit=0 cache_volume_results_download_time=0s cache_result_req=0 cache_result_hit=0 cache_result_download_time=0s cache_result_query_length_served=0s ingester_chunk_refs=0 ingester_chunk_downloaded=0 ingester_chunk_matches=0 ingester_requests=0 ingester_chunk_head_bytes=0B ingester_chunk_compressed_bytes=0B ingester_chunk_decompressed_bytes=0B ingester_post_filter_lines=0 congestion_control_latency=0s index_total_chunks=0 index_post_bloom_filter_chunks=0 index_bloom_filter_ratio=0.00 index_shard_resolver_duration=0s disable_pipeline_wrappers=false
level=warn ts=2024-09-06T05:36:32.649852792Z caller=background.go:200 msg="backgroundCache writeBackLoop Cache.Store fail" err="server=10.160.148.220:11211: memcache: unexpected response line from \"set\": \"SERVER_ERROR object too large for cache\\r\\n\""
level=warn ts=2024-09-06T05:36:32.656258908Z caller=background.go:200 msg="backgroundCache writeBackLoop Cache.Store fail" err="server=10.160.148.220:11211: memcache: unexpected response line from \"set\": \"SERVER_ERROR object too large for cache\\r\\n\""

I keep getting this error not sure what's the fix

pavelchalyk commented 2 months ago

Hi, I guess you should check the maximum size for an item in your memcached config

nandlalyadav57 commented 2 months ago

Do you have any examples of how we can set it in Loki?

JStickler commented 1 month ago

Configuration questions have a better chance of being answered if you ask them on the community forums.