Indexer

[ahmedoshelmy]

• [x] TF (Term Frequency)
• [x] DF (Document Frequency)
• [x] IDF (Inverse Document Frequency = TF / # of documents )
• [x] Stemming
• [x] Stop Words( The - an , and , ... )
• [x] Cleaning Page Body (Using Regex)
• [x] Tokenization (Splitting sentences to words)
• [ ] Adding Stop Words
• [ ] multithreading