fluenda / ParCEFone

JAVA Common Event Format log parser
Apache License 2.0
8 stars 7 forks source link

CEF parsing type error #30

Open burkon opened 11 months ago

burkon commented 11 months ago

Hello, Im using CEFParser with Nifi.

I have a problem, sometimes a parser error occurs when the numberf is exceeded Integer Is there any way to solve it, for example by adding LONG type for the key "out" somewhere and so on?

Please Kind Regards Marek

CEF Message example from Fortigate (Key: out was an bigger than Integer) ### :

<165>Oct 23 22:10:20 FGT-DEV-FW1 CEF: 0|Fortinet|Fortigate|v7.0.12|00020|traffic:forward accept|3|deviceExternalId=FGXXXXXXX012 FTNTFGTeventtime=1698091820252030526 FTNTFGTtz=+0200 FTNTFGTlogid=0000000020 cat=traffic:forward FTNTFGTsubtype=forward FTNTFGTlevel=notice FTNTFGTvd=root src=172.37.1.1 spt=9004 deviceInboundInterface=VPN-DEV_Off-1 FTNTFGTsrcintfrole=undefined dst=172.30.2.180 dpt=514 deviceOutboundInterface=741_CZ_Srv FTNTFGTdstintfrole=lan FTNTFGTsrccountry=Reserved FTNTFGTdstcountry=Reserved externalId=573022232 proto=17 act=accept FTNTFGTpolicyid=527 FTNTFGTpolicytype=policy FTNTFGTpoluuid=73816fb2-6720-51ec-c859-c84211230e24 FTNTFGTpolicyname=Office-2 app=udp/514 FTNTFGTtrandisp=noop FTNTFGTduration=331878 out=3443586134 in=0 FTNTFGTsentpkt=3420478 FTNTFGTrcvdpkt=0 FTNTFGTvpntype=ipsecvpn FTNTFGTappcat=unscanned FTNTFGTsentdelta=959006 FTNTFGTrcvddelta=0 ### CEFParser type ERROR ### : 2023-10-23 20:10:18,127 INFO [FileSystemRepository Workers Thread-1] [o.a.n.c.repository.FileSystemRepository](http://o.a.n.c.repository.filesystemrepository/) Successfully archived 4 Resource Claims for Container default in 10 millis 2023-10-23 20:10:21,003 ERROR [Timer-Driven Process Thread-4] [o.a.nifi.processors.standard.ParseCEF](http://o.a.nifi.processors.standard.parsecef/) ParseCEF[id=100411d1-1e6d-12bc-5347-9553a96ec9a5] CEF Parsing Failed: StandardFlowFileRecord[uuid=6198fa4d-69a9-4a60-9062-21dff7a16a05,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1698091820924-6175, container=default, section=31], offset=13986, length=911],offset=0,name=6198fa4d-69a9-4a60-9062-21dff7a16a05,size=911] [java.lang.NumberFormatException](http://java.lang.numberformatexception/): For input string: "3443586134" at [java.base/…own](http://java.base/java.lang.NumberFormatException.forInputString(Unknown) Source) at [java.base/…own](http://java.base/java.lang.Integer.parseInt(Unknown) Source) at [java.base/…own](http://java.base/java.lang.Integer.valueOf(Unknown) Source) at [com.fluenda.parcefone.event.CefRev23.setExtension(CefRev23.java:660](http://com.fluenda.parcefone.event.cefrev23.setextension%28cefrev23.java:660/)) at [com.fluenda.parcefone.parser.CEFParser.parse(CEFParser.java:235](http://com.fluenda.parcefone.parser.cefparser.parse%28cefparser.java:235/)) at [com.fluenda.parcefone.parser.CEFParser.parse(CEFParser.java:109](http://com.fluenda.parcefone.parser.cefparser.parse%28cefparser.java:109/)) at [org.apache.nifi.processors.standard.ParseCEF.onTrigger(ParseCEF.java:277](http://org.apache.nifi.processors.standard.parsecef.ontrigger%28parsecef.java:277/)) at [org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27](http://org.apache.nifi.processor.abstractprocessor.ontrigger%28abstractprocessor.java:27/)) at [org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1361](http://org.apache.nifi.controller.standardprocessornode.ontrigger%28standardprocessornode.java:1361/)) at [org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:247](http://org.apache.nifi.controller.tasks.connectabletask.invoke%28connectabletask.java:247/)) at [org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:102](http://org.apache.nifi.controller.scheduling.timerdrivenschedulingagent%241.run%28timerdrivenschedulingagent.java:102/)) at [org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110](http://org.apache.nifi.engine.flowengine%242.run%28flowengine.java:110/)) at [java.base/…own](http://java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown) Source) at [java.base/…own](http://java.base/java.util.concurrent.FutureTask.runAndReset(Unknown) Source) at [java.base/…own](http://java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown) Source) at [java.base/…own](http://java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown) Source) at [java.base/…own](http://java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown) Source) at [java.base/…own](http://java.base/java.lang.Thread.run(Unknown) Source)