in membrane.feed.articles, extraction is happening for every entry whether or not an Article already exists for it. this involves a lot of unnecessary/redundant network requests. instead, the extractor functionality should be moved to membrane.collector.collect and executed only if an Article does not already exist for that entry data.
but perhaps it makes more sense to do the Article checking from within membrane.feed.articles.
in
membrane.feed.articles, extraction is happening for every entry whether or not an Article already exists for it. this involves a lot of unnecessary/redundant network requests. instead, the extractor functionality should be moved tomembrane.collector.collectand executed only if an Article does not already exist for that entry data.but perhaps it makes more sense to do the Article checking from within
membrane.feed.articles.