RMLio / RML-Mapper

Generate High Quality Linked Data from multiple originally (semi-)structured data (legacy)
http://RML.io
52 stars 20 forks source link

Memory consumption, scalability #25

Open D063520 opened 7 years ago

D063520 commented 7 years ago

Hello,

I wanted to ask if you have some experience regarding scalability. I'm trying to map an xml file that is 2Gb big. It seams to eat up a lot of memory and it is not finished yet.

Thank you

andimou commented 7 years ago

Hm we also experienced some issues with big XMLs, we worked in a fix internally.

Could you send as an e-mail (anastasia.dimou@ugent.be) with the file if possible (or not) to test with the fix we have (which is not pushed publicly yet)?