owid / etl

A compute graph for loading and transforming OWID's data
https://docs.owid.io/projects/etl
MIT License
85 stars 23 forks source link

:bug: Fix caching of staging creation time #3564

Closed Marigold closed 3 days ago

Marigold commented 3 days ago

I encountered a nasty bug causing owidbot to post "No charts for review," even when there were actual charts for review. The issue was that scan-chart-diff iterates over all staging servers, but get_staging_creation_time was using a cached value from the key staging_creation_time. This resulted in staging_creation_time being fetched for only the first staging server and reused for the others.

This PR resolves the issue by clearing the cache with st.session_state.clear() before processing each staging server and by using a unique key for caching staging_creation_time based on the engine in use.

owidbot commented 3 days ago
Quick links (staging server): Site Admin Wizard Docs

Login: ssh owid@staging-site-fix-staging-create

chart-diff: ✅ No charts for review.
data-diff: ❌ Found differences ```diff = Dataset garden/artificial_intelligence/2024-02-15/epoch_llms = Table epoch_llms ~ Column dataset_size__tokens (changed metadata) - - Owen, David. (2023). Large Language Model performance and compute, Epoch (2023) [Data set]. In Extrapolating performance in language modeling benchmarks. Published online at epochai.org. Retrieved from: 'https://epochai.org/blog/extrapolating-performance-in-language-modelling-benchmarks' . ? ^^^^^^^ ^^^^^^ + + Owen, David. (2023). Large Language Model performance and compute, Epoch (2023) [Data set]. In Extrapolating performance in language modeling benchmarks. Published online at epoch.ai. Retrieved from: 'https://epoch.ai/blog/extrapolating-performance-in-language-modelling-benchmarks' . ? ^^^^ ^^^ - - url_main: https://epochai.org/blog/extrapolating-performance-in-language-modelling-benchmarks ? ---- + + url_main: https://epoch.ai/blog/extrapolating-performance-in-language-modelling-benchmarks ? + - - url: https://epochai.org/blog/extrapolating-performance-in-language-modelling-benchmarks ? ---- + + url: https://epoch.ai/blog/extrapolating-performance-in-language-modelling-benchmarks ? + ~ Column mmlu_avg (changed metadata) - - Owen, David. (2023). Large Language Model performance and compute, Epoch (2023) [Data set]. In Extrapolating performance in language modeling benchmarks. Published online at epochai.org. Retrieved from: 'https://epochai.org/blog/extrapolating-performance-in-language-modelling-benchmarks' . ? ^^^^^^^ ^^^^^^ + + Owen, David. (2023). Large Language Model performance and compute, Epoch (2023) [Data set]. In Extrapolating performance in language modeling benchmarks. Published online at epoch.ai. Retrieved from: 'https://epoch.ai/blog/extrapolating-performance-in-language-modelling-benchmarks' . ? ^^^^ ^^^ - - url_main: https://epochai.org/blog/extrapolating-performance-in-language-modelling-benchmarks ? ---- + + url_main: https://epoch.ai/blog/extrapolating-performance-in-language-modelling-benchmarks ? + - - url: https://epochai.org/blog/extrapolating-performance-in-language-modelling-benchmarks ? ---- + + url: https://epoch.ai/blog/extrapolating-performance-in-language-modelling-benchmarks ? + ~ Column model_size__parameters (changed metadata) - - Owen, David. (2023). Large Language Model performance and compute, Epoch (2023) [Data set]. In Extrapolating performance in language modeling benchmarks. Published online at epochai.org. Retrieved from: 'https://epochai.org/blog/extrapolating-performance-in-language-modelling-benchmarks' . ? ^^^^^^^ ^^^^^^ + + Owen, David. (2023). Large Language Model performance and compute, Epoch (2023) [Data set]. In Extrapolating performance in language modeling benchmarks. Published online at epoch.ai. Retrieved from: 'https://epoch.ai/blog/extrapolating-performance-in-language-modelling-benchmarks' . ? ^^^^ ^^^ - - url_main: https://epochai.org/blog/extrapolating-performance-in-language-modelling-benchmarks ? ---- + + url_main: https://epoch.ai/blog/extrapolating-performance-in-language-modelling-benchmarks ? + - - url: https://epochai.org/blog/extrapolating-performance-in-language-modelling-benchmarks ? ---- + + url: https://epoch.ai/blog/extrapolating-performance-in-language-modelling-benchmarks ? + ~ Column organisation (changed metadata) - - Owen, David. (2023). Large Language Model performance and compute, Epoch (2023) [Data set]. In Extrapolating performance in language modeling benchmarks. Published online at epochai.org. Retrieved from: 'https://epochai.org/blog/extrapolating-performance-in-language-modelling-benchmarks' . ? ^^^^^^^ ^^^^^^ + + Owen, David. (2023). Large Language Model performance and compute, Epoch (2023) [Data set]. In Extrapolating performance in language modeling benchmarks. Published online at epoch.ai. Retrieved from: 'https://epoch.ai/blog/extrapolating-performance-in-language-modelling-benchmarks' . ? ^^^^ ^^^ - - url_main: https://epochai.org/blog/extrapolating-performance-in-language-modelling-benchmarks ? ---- + + url_main: https://epoch.ai/blog/extrapolating-performance-in-language-modelling-benchmarks ? + - - url: https://epochai.org/blog/extrapolating-performance-in-language-modelling-benchmarks ? ---- + + url: https://epoch.ai/blog/extrapolating-performance-in-language-modelling-benchmarks ? + ~ Column training_computation_petaflop (changed metadata) - - Owen, David. (2023). Large Language Model performance and compute, Epoch (2023) [Data set]. In Extrapolating performance in language modeling benchmarks. Published online at epochai.org. Retrieved from: 'https://epochai.org/blog/extrapolating-performance-in-language-modelling-benchmarks' . ? ^^^^^^^ ^^^^^^ + + Owen, David. (2023). Large Language Model performance and compute, Epoch (2023) [Data set]. In Extrapolating performance in language modeling benchmarks. Published online at epoch.ai. Retrieved from: 'https://epoch.ai/blog/extrapolating-performance-in-language-modelling-benchmarks' . ? ^^^^ ^^^ - - url_main: https://epochai.org/blog/extrapolating-performance-in-language-modelling-benchmarks ? ---- + + url_main: https://epoch.ai/blog/extrapolating-performance-in-language-modelling-benchmarks ? + - - url: https://epochai.org/blog/extrapolating-performance-in-language-modelling-benchmarks ? ---- + + url: https://epoch.ai/blog/extrapolating-performance-in-language-modelling-benchmarks ? + = Dataset garden/artificial_intelligence/2024-06-06/epoch_compute_cost = Table epoch_compute_cost ~ Column cost__inflation_adjusted (changed metadata) - - url_main: https://epochai.org/blog/how-much-does-it-cost-to-train-frontier-ai-models ? ---- + + url_main: https://epoch.ai/blog/how-much-does-it-cost-to-train-frontier-ai-models ? + ~ Column domain (changed metadata) - - url_main: https://epochai.org/blog/how-much-does-it-cost-to-train-frontier-ai-models ? ---- + + url_main: https://epoch.ai/blog/how-much-does-it-cost-to-train-frontier-ai-models ? + ~ Column publication_date (changed metadata) - - url_main: https://epochai.org/blog/how-much-does-it-cost-to-train-frontier-ai-models ? ---- + + url_main: https://epoch.ai/blog/how-much-does-it-cost-to-train-frontier-ai-models ? + Legend: +New ~Modified -Removed =Identical Details Hint: Run this locally with etl diff REMOTE data/ --include yourdataset --verbose --snippet ``` Automatically updated datasets matching _weekly_wildfires|excess_mortality|covid|fluid|flunet|country_profile|garden/ihme_gbd/2019/gbd_risk_ are not included

Edited: 2024-11-19 11:39:50 UTC Execution time: 16.14 seconds