DFKI-NLP / InterroLang

InterroLang: Exploring NLP Models and Datasets through Dialogue-based Explanations [EMNLP 2023 Findings]
https://arxiv.org/abs/2310.05592
5 stars 1 forks source link

No output for nlp attribute (local_feature_importance_sentence.txt) #100

Closed schopra6 closed 1 year ago

schopra6 commented 1 year ago

Given Input : Most important phrases in id 12

Log trace


During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/src/app/flask_app.py", line 164, in get_bot_response
    response = BOT.update_state(user_text, conversation)
  File "/usr/src/app/logic/core.py", line 881, in update_state
    parse_tree, parsed_text = self.compute_parse_text(text)
  File "/usr/src/app/logic/core.py", line 639, in compute_parse_text
    api_response = self.decoder.complete(
  File "/usr/src/app/logic/decoder.py", line 118, in complete
    completed = self.gen_completions(prompt, grammar)
  File "/usr/src/app/logic/decoder.py", line 84, in complete
    return predict_f(text=prompt, grammar=grammar)
  File "/usr/src/app/parsing/gpt/few_shot_inference.py", line 36, in predict_f
    parser = GuidedParser(grammar, tokenizer, model="gpt")
  File "/usr/src/app/parsing/guided_decoding/gd_logits_processor.py", line 43, in __init__
    self.text_parser = Lark(self.text_grammar, parser="lalr")
  File "/usr/local/lib/python3.9/site-packages/lark/lark.py", line 333, in __init__
    self.grammar, used_files = load_grammar(grammar, self.source_path, self.options.import_paths, self.options.keep_all_tokens)
  File "/usr/local/lib/python3.9/site-packages/lark/load_grammar.py", line 1408, in load_grammar
    builder.load_grammar(grammar, source)
  File "/usr/local/lib/python3.9/site-packages/lark/load_grammar.py", line 1233, in load_grammar
    tree = _parse_grammar(grammar_text, grammar_name)
  File "/usr/local/lib/python3.9/site-packages/lark/load_grammar.py", line 964, in _parse_grammar
    raise GrammarError("Unexpected input at line %d column %d in %s: \n\n%s" %
lark.exceptions.GrammarError: Unexpected input at line 87 column 5 in <string>: 

id: " id 12
    ^

[2023-06-02 08:16:10,663] INFO in flask_app: Traceback getting bot response: Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/lark/load_grammar.py", line 961, in _parse_grammar
    tree = _get_parser().parse(text + '\n', start)
  File "/usr/local/lib/python3.9/site-packages/lark/parser_frontends.py", line 96, in parse
    return self.parser.parse(stream, chosen_start, **kw)
  File "/usr/local/lib/python3.9/site-packages/lark/parsers/lalr_parser.py", line 41, in parse
    return self.parser.parse(lexer, start)
  File "/usr/local/lib/python3.9/site-packages/lark/parsers/lalr_parser.py", line 171, in parse
    return self.parse_from_state(parser_state)
  File "/usr/local/lib/python3.9/site-packages/lark/parsers/lalr_parser.py", line 188, in parse_from_state
    raise e
  File "/usr/local/lib/python3.9/site-packages/lark/parsers/lalr_parser.py", line 178, in parse_from_state
    for token in state.lexer.lex(state):
  File "/usr/local/lib/python3.9/site-packages/lark/lexer.py", line 456, in lex
    yield self.next_token(state, parser_state)
  File "/usr/local/lib/python3.9/site-packages/lark/lexer.py", line 466, in next_token
    raise UnexpectedCharacters(lex_state.text, line_ctr.char_pos, line_ctr.line, line_ctr.column,
lark.exceptions.UnexpectedCharacters: No terminal matches '"' in the current parser context, at line 87 col 5

id: " id 12
    ^
Expected one of: 
    * _RBRACE
    * _COMMA
    * _LBRACE
    * _OVERRIDE
    * NUMBER
    * TILDE
    * _EXTEND
    * _RBRA
    * _NL_OR
    * _OR
    * _RPAR
    * OP
    * _DECLARE
    * _LPAR
    * REGEXP
    * RULE_MODIFIERS
    * _IGNORE
    * _LBRA
    * _DOT
    * _TO
    * TERMINAL
    * _NL
    * RULE
    * _COLON
    * STRING
    * _IMPORT
    * _DOTDOT

Previous tokens: Token('_COLON', ':')

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/src/app/flask_app.py", line 164, in get_bot_response
    response = BOT.update_state(user_text, conversation)
  File "/usr/src/app/logic/core.py", line 881, in update_state
    parse_tree, parsed_text = self.compute_parse_text(text)
  File "/usr/src/app/logic/core.py", line 639, in compute_parse_text
    api_response = self.decoder.complete(
  File "/usr/src/app/logic/decoder.py", line 118, in complete
    completed = self.gen_completions(prompt, grammar)
  File "/usr/src/app/logic/decoder.py", line 84, in complete
    return predict_f(text=prompt, grammar=grammar)
  File "/usr/src/app/parsing/gpt/few_shot_inference.py", line 36, in predict_f
    parser = GuidedParser(grammar, tokenizer, model="gpt")
  File "/usr/src/app/parsing/guided_decoding/gd_logits_processor.py", line 43, in __init__
    self.text_parser = Lark(self.text_grammar, parser="lalr")
  File "/usr/local/lib/python3.9/site-packages/lark/lark.py", line 333, in __init__
    self.grammar, used_files = load_grammar(grammar, self.source_path, self.options.import_paths, self.options.keep_all_tokens)
  File "/usr/local/lib/python3.9/site-packages/lark/load_grammar.py", line 1408, in load_grammar
    builder.load_grammar(grammar, source)
  File "/usr/local/lib/python3.9/site-packages/lark/load_grammar.py", line 1233, in load_grammar
    tree = _parse_grammar(grammar_text, grammar_name)
  File "/usr/local/lib/python3.9/site-packages/lark/load_grammar.py", line 964, in _parse_grammar
    raise GrammarError("Unexpected input at line %d column %d in %s: \n\n%s" %
lark.exceptions.GrammarError: Unexpected input at line 87 column 5 in <string>: 

id: " id 12
    ^

[2023-06-02 08:16:10 +0000] [8] [INFO] Exception getting bot response: Unexpected input at line 87 column 5 in <string>: 

id: " id 12
    ^

[2023-06-02 08:16:10,663] INFO in flask_app: Exception getting bot response: Unexpected input at line 87 column 5 in <string>: 

id: " id 12
qiaw99 commented 1 year ago

Ah okay, you are using GPT, then probably Nils has changed grammar at some point @nfelnlp

schopra6 commented 1 year ago

here is the link http://134.96.191.208:4000/ if you want to try. I am using the default settings from main branch.

qiaw99 commented 1 year ago

The provided URL not accessible

qiaw99 commented 1 year ago

image

qiaw99 commented 1 year ago

Fixed in this commit, referring this tutorial