Arbital refactor

[Thomas-Lemoine]

modified a few functions, especially markdownify_text, so that summaries are saved as summaries rather than as part of the text

• tests

[Thomas-Lemoine]

I fetched a bunch of arbital articles to check that it worked correctly and it seems fine, but occasionally there is stuff like:

The reasoning for an instrumental convergence claim says that for many utility functions $U_k$ and situations $S_i$ a $U_k$-consequentialist in situation $S_i$ will probably find some best policy $\pi_k = \underset{\pi_i \in \Pi}{\operatorname{argmax}}  \mathbb E [U_k | S_i, \pi_i ](https://arbital.com/p/)$ that happens to be inside the partition $X$.  If instead in situation $S_k$...

Where some (https://arbital.com/p/) comes out of nowhere

[Thomas-Lemoine]

my guess is that this would also be a problem for the current dataset though, since I don't see how that behaviour would have changed with my new code. basically formulas that use brackets will confuse the parser

[mruwnik]

That's mathjax code. It should be fine. Might even be worth adding mathjax to the chatbot and seeing if it can generate pretty equations?

[Thomas-Lemoine]

That's mathjax code. It should be fine. Might even be worth adding mathjax to the chatbot and seeing if it can generate pretty equations?

You might be misunderstanding what I meant when I quoted that result. somewhere in that answer, which corresponds to this I think: https://arbital.com/p/instrumental_convergence/ there's a usage of mathjax code, but our parsers sees it as brackets and treats it like a link ([123