Open bmoscon opened 10 years ago
current classifier only is using anchor density and word count. Need to include sentence analysis (number and average length), average word length, number of upper case words, anchor count, and section position
started. also added stop word analysis
now that new features are detected, we need a new classifier to classify each section as boilerplate or content