Failed to parse XML: internal. Error: Huge input lookup

[vadzimsharai]

>>> xmlua.XML.parse(xml_doc)

Version: 1.1.4

[kou]

Could you provide a XML that reproduces this case?

[vadzimsharai]

You can use this python script for generating a similar XML file.
As I understand it, this happens when I use Unicode.

NODES_COUNT = 100000
CHUNK_SIZE = 1024*1024

data = '''
    <node attr="Attr">
        <title attr="Attr">Title</title>
        <description attr="Attr">%s</description>
    </node>
''' % (''.join(chr(1000+i) for i in range(300))) * NODES_COUNT

doc = '''<?xml version="1.0" encoding="UTF-8"?>
<root>
%s
</root>
''' % data

with open("example.xml", "w") as f:
    for i in range(0, len(doc), CHUNK_SIZE):
        f.write(doc[i:i + CHUNK_SIZE])  

[vadzimsharai]

My solution: add XML_PARSE_HUGE parse option to xml2.xmlCtxtReadMemory

[kou]

Thanks. I've added a feature to pass XML_PARSE_HUGE:

xmlua.XML.parse(xml, {parse_options = {"default", "huge"}})