search

subconsciousnetwork / subconscious

Apache License 2.0
9 stars 0 forks source link

Something is spamming many memo reads in own sphere #942

Closed gordonbrander closed 1 year ago

gordonbrander commented 1 year ago

This seems to happen before database migration, as well as occasionally afterward.

Logs:

sphereIdentity="did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP"
2023-10-18 11:00:09.635465-0400 Subconscious[5740:1633712] [app] Readying database
2023-10-18 11:00:09.637516-0400 Subconscious[5740:1633712] [AppAction] appear
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug ai...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug alan-kay...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug alfred-lotka...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug all-systems-are-models-of-other-systems...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug an-architecture-of-information...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug any-sufficiently-advanced-technology-is-indistinguishable-from-nature...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug arpa...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug arpanet...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug belief-is-for-when-there-is-an-indirect-relationship-between-cause-and-effect...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug ben-thompson...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug better-roughly-right-than-precisely-wrong...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug book...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug brian-eno...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug ceos-live-in-oral-culture...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug charismatic-authority...
2023-10-18 11:00:09.718845-0400 Subconscious[5740:1633712] Metal API Validation Enabled
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug charles-darwin...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug clayton-christensen...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug climate...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug complex-system...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug complexity-science...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug containment-can-lead-to-contagion...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug culture-is-everything-we-dont-have-to-do-eno...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug cybernetics...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug dag...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug desirability-feasibility-viability...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug directly-responsible-individual...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug disruption...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug distribution-vs-innovation...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug dunbar-scale-social...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug _profile_...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug dynabook...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug economics...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug error-drives-discovery...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug eugene-wei...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug evolution...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug evolutionary-design-by-computers...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug existentialism...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug extreme-competition-does-not-select-for-the-best...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug galls-law...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug games-spark-innovation...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug i-do-not-understand-why-perfection-should-be-a-state-of-rest-rather-than-a-state-of-change...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug ipfs...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug is-ai-rare-or-everywhere...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug islands-of-decreasing-entropy...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug it-would-be-ridiculous-if-we-didnt-have-x-in-y-years...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug jcr-licklider...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug john-gall...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug karl-schroeder...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug knowledge-is-embodied-in-the-structure-of-the-system...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug knowledge-structures...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug language-as-an-intelligence...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug lao-tzu...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug life-improves-the-closed-systems-capacity-to-sustain-life...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug llm...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug local-maxima...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug local-maxima-are-rare-in-high-dimensional-space...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug lotkas-beetle...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug lotkas-maximum-power-principle...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug low-end-disruption...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug ludwig-wittgenstein...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug lumpers-and-splitters...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug max-weber...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug memorandum-for-members-and-affiliates-of-the-intergalactic-computer-network...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug metatropolis...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug minimal-definition-of-user-agency...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug network-theory...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug norbert-wiener...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug novelty-is-a-shortcut-for-identifying-interestingness...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug oblique-strategies...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug oozification...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug parc...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug peers-in-spheres-always-look-back-in-time...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug requisite-variety...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug research-timeframe...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug scale-free...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug scale-free-small-worlds...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug science-is-the-set-of-things-we-can-reproduce-through-experiment...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug sfi...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug smalltalk...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug social-network...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug start-with-a-toy...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug stealing-worlds...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug stepping-stone-collector...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug stewart-brand...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug strategy...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug subconscious...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug systemantics...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug systems...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug tao-te-ching-verse-16...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug tao-te-ching-verse-38...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug tell-me-how-you-are-searching-and-i-will-tell-you-what-you-are-searching-for...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug the-flow-of-energy-through-a-system-acts-to-organize-that-system...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug the-nature-of-technology...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug the-species-is-fundamentally-aim-less...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug the-structure-of-scientific-revolutions...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug this-was-a-draft-and-now-its-public...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug thomas-s-kuhn...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug to-reject-one-paradigm-without-simultaneously-substituting-another-is-to-reject-science-itself...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug tools-for-thought...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug tools-for-thought-give-you-requisite-variety-to-navigate-complexity...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug turchins-end-times...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug twitter-animosity-is-driven-by-semi-global-timeline...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug ubiquitous-computing...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug very-small-very-fast-very-smart...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug w-brian-arthur...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug w-ross-ashby...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug what-made-xerox-parc-so-special...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug whole-earth-catalog...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug why-greatness-cannot-be-planned...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug wicked-problem...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug worse-but-better...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug you-are-the-squishy-part-of-the-loop...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug _profile_...
2023-10-18 11:00:10.163957-0400 Subconscious[5740:1633712] [AppAction] presentRecoveryMode(false)
2023-10-18 11:00:10.165645-0400 Subconscious[5740:1633712] [AppAction] succeedRefreshSphereVersion("bafyr4idzedbbgvpalwnzbdahmaqiwtw3kwj2opzixmdde66w4wc7wwpvl4")
2023-10-18 11:00:10.165700-0400 Subconscious[5740:1633712] [app] Refreshed sphere version: bafyr4idzedbbgvpalwnzbdahmaqiwtw3kwj2opzixmdde66w4wc7wwpvl4
2023-10-18 11:00:10.166018-0400 Subconscious[5740:1633712] [AppAction] succeedMigrateDatabase(1686760140)
2023-10-18 11:00:10.167480-0400 Subconscious[5740:1633712] [NotebookAction] ready
2023-10-18 11:00:10.167795-0400 Subconscious[5740:1633712] [app] Database version: 1686760140
2023-10-18 11:00:10.168784-0400 Subconscious[5740:1633712] [app] Last index for our sphere identity="did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP" version="bafyr4idzedbbgvpalwnzbdahmaqiwtw3kwj2opzixmdde66w4wc7wwpvl4"
2023-10-18 11:00:10.169137-0400 Subconscious[5740:1633712] [app] Syncing with gateway url="https://bdyqgy2aa23hjn3nu6x2qmlfqebnt75h.sphere.plato.subconscious.cloud/"
2023-10-18 11:00:10.169530-0400 Subconscious[5740:1633712] [app] File sync started
Update NavigationAuthority bound path tried to update multiple times per frame.
2023-10-18 11:00:10.183164-0400 Subconscious[5740:1633712] [AppAction] succeedFetchNicknameFromProfile(gordon)
2023-10-18 11:00:10.275954-0400 Subconscious[5740:1633712] [NotebookAction] search(setSuggestions(...8))
2023-10-18 11:00:10.281535-0400 Subconscious[5740:1633712] [AppAction] scenePhaseChange(SwiftUI.ScenePhase.active)
2023-10-18 11:00:10.281643-0400 Subconscious[5740:1633712] [NotebookAction] setEntryCount(118)

I have a hunch this has to do with the own-profile view. Note the actions before the spamming:

Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug _profile_...
2023-10-18 11:00:45.301374-0400 Subconscious[5740:1633712] [AppAction] setSelectedAppTab(Subconscious.AppTab.notebook)
2023-10-18 11:00:45.341841-0400 Subconscious[5740:1633712] [NotebookAction] appear
2023-10-18 11:01:48.856940-0400 Subconscious[5740:1633712] [AppAction] setSelectedAppTab(Subconscious.AppTab.profile)
Update NavigationAuthority bound path tried to update multiple times per frame.
2023-10-18 11:01:48.928210-0400 Subconscious[5740:1633712] [HomeProfileAction] appear
2023-10-18 11:01:48.938288-0400 Subconscious[5740:1633712] [UserProfileDetailAction] appear(/_profile_, 0)
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug ai...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug alan-kay...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug alfred-lotka...
Reading sphere did:key:z6MkwUEJssUJDfRaA71cyuC5nZenVPuUw3ueB7ugMdkUG8pP slug all-systems-are-models-of-other-systems...
...
bfollington commented 1 year ago

This is expected, we list your sphere to produce the profile view, but it should happen when you first present the profile tab not on app startup.

We were accidentally triggering this listing twice, see: https://github.com/subconsciousnetwork/subconscious/pull/944

Unfortunately this explains pretty much nothing about app performance in general.

gordonbrander commented 1 year ago

As a rule of thumb, my sense is that we should be pulling all list views, including this one, from SQLLite (index), and individual detail views from the sphere (source of truth).

@cdata do you have a sense if this kind of mass reading of own-sphere data is an ok thing to do?

bfollington commented 1 year ago

@gordonbrander I think it's a little ambiguous whether the profile is a list view or a detail view overall. I think we should read the profile header from the sphere regardless, but the "Notes" tab is a different matter.

We can (should?) load the owner's posts from SQLite, we just have to be careful that we refresh after each DB mutation to keep it in sync.

gordonbrander commented 1 year ago

Let's call this good for now.