RMLio / rmlmapper-java

The RMLMapper executes RML rules to generate high quality Linked Data from multiple originally (semi-)structured data sources
http://rml.io
MIT License
151 stars 61 forks source link

Large csv input used with rmlmapper #203

Closed titoarrabal closed 1 year ago

titoarrabal commented 1 year ago

Hi! Im trying to use rmlmapper over my csv files (1.400.000 rows), but it doesnt give any output because it keeps thinking. Is there another rmlToRdf conversor which could make that job? Thank you!

titoarrabal commented 1 year ago

RML streamer gives me an error, and I dont know how to solve it. I leave the error here! Exception in thread "main" java.util.NoSuchElementException: None.get at scala.None$.get(Option.scala:347) at scala.None$.get(Option.scala:345) at io.rml.framework.Main$.main(Main.scala:124) at io.rml.framework.Main.main(Main.scala)

bjdmeest commented 1 year ago

Could you provide the mapping file and cli arguments you're using to try the rmlstreamer? It should be able to handle this amount of data :)

Op ma 15 mei 2023 19:48 schreef titoarrabal @.***>:

RML streamer gives me an error, and I dont know how to solve it. I leave the error here! Exception in thread "main" java.util.NoSuchElementException: None.get at scala.None$.get(Option.scala:347) at scala.None$.get(Option.scala:345) at io.rml.framework.Main$.main(Main.scala:124) at io.rml.framework.Main.main(Main.scala)

— Reply to this email directly, view it on GitHub https://github.com/RMLio/rmlmapper-java/issues/203#issuecomment-1548286355, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAFDHJNAFNYBI7DXS7KZOFTXGJT63ANCNFSM6AAAAAAYCQYI7A . You are receiving this because you are subscribed to this thread.Message ID: @.***>

titoarrabal commented 1 year ago

Meteorologicos.zip I am using yarrrml-paser to obtain map1.rml.ttl. Then, i use this command: java -jar rmlstreamer.jar toFile --mapping-file C:/Users/Usuario/Desktop/TFG/Mapping/ComunidadMadrid/Meteorologicos/map1.rml.ttl --output-path prueba.nt It gives me this error image

bjdmeest commented 1 year ago

@ghsnd ?

ghsnd commented 1 year ago

Hi! Did you try the standalone version of RMLStreamer? It looks like this is the version that has to be deployed on a Flink cluster.

DylanVanAssche commented 1 year ago

No response for a while, re-open if needed