search

wri / wri_sites

WRI profile
2 stars 2 forks source link

Investigate indexing issues #243

Closed monicapatel21 closed 6 months ago

monicapatel21 commented 9 months ago

The index is showing 100% on wri.org, but the the editorial team flagged that not all Insights articles are getting pulled into https://www.wri.org/resources/type/insights-50 (for example this one from Dec 8: https://www.wri.org/insights/oil-natural-gas-emissions-us). Any idea what the issue might be?

mariacha commented 9 months ago

I was seeing some odd behavior for this as well -- the node changes, but the issue is the same. Here's how I'm testing it:

This is a view built with solr: https://www.wri.org/resources/type/insights-50

And this is a view built with a database query: https://www.wri.org/admin/tmp-insights

Screenshot 2024-01-02 at 2 11 42 PM

Two high-up articles - Outside the Spotlight, Forests and Nature Saw Important Wins at COP28 and Under New Guidance, “Sustainable” Aviation Fuel in the US Could Be Anything But didn't show up for the solr search, but did for the database search.

Re-indexing fixed it, but I don't suspect it's fixed forever. I'll check back on it.

mariacha commented 9 months ago

Still looks good this morning, but I'll also review after new content is posted tomorrow to see if that changes anything.

mariacha commented 9 months ago

Update - I checked back today and there were 2 missing items -- the top one, and 3 Cutting-Edge Satellite Technologies Showcase Nature’s Impact on Water. Re-saving the top item made both show up. Total results were 2591 afterwards (I didn't note what it was before).

So there must be something about adding a new node to the list that's altering it. I can see if I can reproduce that on a multidev.

mariacha commented 9 months ago

Next steps here:

mariacha commented 6 months ago

This is tied to https://github.com/wri/wriflagship/issues/1160 and so can be closed as a duplicate.