WIP: Move Text Extraction

[MarkDavidson]

This is an architectural change to support the eventual implementation of fulltext ML models

What Changed:

• Moved text extraction out of the ML Model and into TRAM. Practically this means:
  • Reports are no longer created by an ML Model, Mappings are. Therefore the ml_model property has been moved.
  • Reports are created by TRAM
• Refactored SKLearn model so that classes have a more specific purpose:
  • Text operations have been moved to a new TextUtils class
  • Database interaction has (somewhat) moved to a new DbUtils class
• Changed attack_technique to attack_object in many places
• Added f strings in some places
• Added sentence property to reports (report.sentence) for developer ergonomics

Limitations:

• Model detail has bugs (view it as a user to see). Tests and fixes are needed before this PR can be merged.
• Technique detail (eg /ml/techniques/T1059):
  • Has bugs and needs fixes; view as a user to see.
  • Still uses the word technique instead of something else.

[codecov[bot]]

Codecov Report

Merging #122 (375b52f) into master (435e501) will increase coverage by 1.71%. The diff coverage is 98.55%.

@@            Coverage Diff             @@
##           master     #122      +/-   ##
==========================================
+ Coverage   94.43%   96.15%   +1.71%     
==========================================
  Files          20       21       +1     
  Lines         827      832       +5     
==========================================
+ Hits          781      800      +19     
+ Misses         46       32      -14     

Impacted Files	Coverage Δ
src/tram/tram/serializers.py	95.16% <ø> (ø)
src/tram/tram/views.py	94.84% <ø> (ø)
src/tram/tram/ml/base.py	98.73% <98.33%> (+5.84%)	:arrow_up:
src/tram/tram/admin.py	100.00% <100.00%> (ø)
...rc/tram/tram/migrations/0011_auto_20211213_1353.py	100.00% <100.00%> (ø)
src/tram/tram/models.py	100.00% <100.00%> (ø)

---

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 435e501...375b52f. Read the comment docs.

[sonarcloud[bot]]

Kudos, SonarCloud Quality Gate passed!   

0 Bugs
0 Vulnerabilities
0 Security Hotspots
0 Code Smells

No Coverage information
0.0% Duplication