openappsec / waf-comparison-project

Testing datasets and tools to compare WAF efficacy
https://www.openappsec.io
Apache License 2.0
144 stars 24 forks source link

JSONDecodeError: Invalid \uXXXX escape #5

Open Tom-Gorup opened 1 year ago

Tom-Gorup commented 1 year ago

I keep getting a JSONDecodeError: Invalid \uXXXX escape at step 7 of 8. I made some adjustments to the load_data function in helper.py in an attempt to isolate the problem:

def load_data(_log_file):
    """
    Load each data set as json file
    """
    # Load the data
    with open(_log_file) as _file:
        try:
            print(_file)
            return_set = json.load(_file)
            return return_set
        except Exception as e:
            print(_file)
            print(e)

It appears the tool is struggling with the browsing_365mashbir.json file. Any idea's on how to resolve this? I've attempted to look at character 9,502,718, but uncertain as to what I should expect to see vs what's there.

<_io.TextIOWrapper name='Data/Legitimate/browsing_365mashbir.json' mode='r' encoding='UTF-8'>
<_io.TextIOWrapper name='Data/Legitimate/browsing_365mashbir.json' mode='r' encoding='UTF-8'>                                                                                                                                                                               
Invalid \uXXXX escape: line 1 column 9502719 (char 9502718)                                                                                                                                                                                                                 

Traceback (most recent call last):
  File "/home/ubuntu/waf-comparison-project/runner.py", line 158, in <module>                                                                                                                                                                                               
    main()
  File "/home/ubuntu/waf-comparison-project/runner.py", line 153, in main
    wafs.send_payloads()
  File "/home/ubuntu/waf-comparison-project/runner.py", line 142, in send_payloads
    self._send_payloads(data, url, test_name)
  File "/home/ubuntu/waf-comparison-project/runner.py", line 95, in _send_payloads
    _executor.map(
  File "/usr/lib/python3.10/concurrent/futures/_base.py", line 610, in map
    fs = [self.submit(fn, *args) for args in zip(*iterables)]
TypeError: 'NoneType' object is not iterable

Appreciate the assist!