jackchinski / ezterms-backend

The backend work for ezterms
0 stars 1 forks source link

split terms and conditions don't have full sections #5

Open jackchinski opened 6 months ago

jackchinski commented 6 months ago

this might be a big one to tackle, not sure if in scope of MVP

when splitting the document into sections to be categorized, we used to just do it based on words, but that would cut off in the middle of sentences -- wrong

we are now cutting based on the endings of sentences, BUT this becomes a problem when one sentence is a part of another section.

Therefore if a section was cut in half, the other half does not know what section these clauses were a part of, and so for section reference it returns "Not specified" -- wrong.

Not sure how to cut each section, other than manually, would have to somehow either put all of the original docs, into some kind of standardized format, or manually chop them up based on sections.

For now, small bug that will exist