search

SME-Issues / issues

0 stars 0 forks source link

Query Balance Tests Canonical - 30/11/2018 - 5004 #1513

Closed SME-Issues closed 5 years ago

SME-Issues commented 5 years ago

Query Balance Tests Canonical

SME-Issues commented 5 years ago

Failed with exception

Expressions Notes Base Expression
tell me the balance of my current account in june of last year PulseAPI .Tests .Reporting .Helpers .TestFailedException: Error running test ---> System .InvalidOperationException: Found multiple datetime entities in 'tell me the balance of my current account in june …
what was the balance of the business account last week on thursday PulseAPI .Tests .Reporting .Helpers .TestFailedException: Error running test ---> System .InvalidOperationException: Found multiple datetime entities in 'what was the balance of the business account last …
SME-Issues commented 5 years ago

Understood and failed - AI only

Fail - Understanding: Partial - Failed

Expressions Notes Base Expression
what are the funds available to me in my current account Account type reference mismatch . Looking for: 'current account', found: (none)

Fail - Understanding: Full - Failed

Expressions Notes Base Expression
give us the position of the club accounts now expected intent to be query_balance but found query_payment
tell me how much i can spend from the charity account before i come overdrawn expected intent to be query_balance but found query_payment
what is the amount of cash i had in my current account on may 7th expected intent to be query_balance but found query_payment
what was the status of my charity instant access last week expected intent to be query_balance but found query_payment
what is in my charity term deposits account Account type reference mismatch . Looking for: 'charity term deposits account', found: 'deposits deposits account'
what's the balance of my charity term deposits account Account type reference mismatch . Looking for: 'charity term deposits account', found: 'deposits deposits account'
do i have much left in my charity terms deposit account Account type reference mismatch . Looking for: 'charity terms deposit account', found: 'terms terms deposit account'
do i have much left in my charity terms deposits account Account type reference mismatch . Looking for: 'charity terms deposits account', found: 'deposits deposits deposits account'
what balance was in my savings account on june 3rd Account type reference mismatch . Looking for: 'savings account', found: (none)
what was left in the business account at the end of the last financial year Expected {date_mod} to have single value 'last' but found 'the'
tell me the balance of my savings account for april last year Expected to find entity 'date_mod' but found only {datetime, text, acct_type, balance}
how far is the business account balance from the overdraft limit Expected to find entity 'overdraft_limit' but found only {text, acct_type, balance, overdraft}
SME-Issues commented 5 years ago

Understood and failed - Code only

Fail_As_Expected - Understanding: Full - Failed

Expressions Notes Base Expression
back in june how much money did i have in the bank Expected context .UnsupportedType to be BalanceByDate, but found None. (back in june how much money did i have in the bank - Fail)
by how much was i overdrawn last month Expected context .UnsupportedType to be BalanceByDate, but found None. (by how much was i overdrawn last month - Fail)
can you bring up the balance of my charity account for last week Expected context .UnsupportedType to be BalanceByDate, but found None. (can you bring up the balance of my charity account for last week - Fail)
did i access my overdraft in 2017 Expected context .UnsupportedType to be BalanceByDate, but found None. (did i access my overdraft in 2017 - Fail)
did i enter my overdraft last year Expected context .UnsupportedType to be BalanceByDate, but found None. (did i enter my overdraft last year - Fail)
did i go into my overdraft in 2017 Expected context .UnsupportedType to be BalanceByDate, but found None. (did i go into my overdraft in 2017 - Fail)
did i go into my overdraft in march Expected context .UnsupportedType to be BalanceByDate, but found None. (did i go into my overdraft in march - Fail)
did i go into my overdraft last year Expected context .UnsupportedType to be BalanceByDate, but found None. (did i go into my overdraft last year - Fail)
did i touch my overdraft last month Expected context .UnsupportedType to be BalanceByDate, but found None. (did i touch my overdraft last month - Fail)
give me my savings account balance from april Expected context .UnsupportedType to be BalanceByDate, but found None. (give me my savings account balance from april - Fail)
give me my savings account figure from jan Expected context .UnsupportedType to be BalanceByDate, but found None. (give me my savings account figure from jan - Fail)
give me the amount of money in my current account last year Expected context .UnsupportedType to be BalanceByDate, but found None. (give me the amount of money in my current account last year - Fail)
give me the balance for my savings account last april Expected context .UnsupportedType to be BalanceByDate, but found None. (give me the balance for my savings account last april - Fail)
give me the figure for my current account last june Expected context .UnsupportedType to be BalanceByDate, but found None. (give me the figure for my current account last june - Fail)
give me the final cash balance from last week Expected context .UnsupportedType to be BalanceByDate, but found None. (give me the final cash balance from last week - Fail)
give us the position of the club accounts for may Expected context .UnsupportedType to be BalanceByDate, but found None. (give us the position of the club accounts for may - Fail)
give us the position of the club accounts for this week Expected context .UnsupportedType to be BalanceByDate, but found None. (give us the position of the club accounts for this week - Fail)
how did my current account look in october Expected context .UnsupportedType to be BalanceByDate, but found None. (how did my current account look in october - Fail)
how did my savings account look in december Expected context .UnsupportedType to be BalanceByDate, but found None. (how did my savings account look in december - Fail)
how far was i overdrawn in feb Expected context .UnsupportedType to be BalanceByDate, but found None. (how far was i overdrawn in feb - Fail)
how much did i have in my charity term deposits last month Expected context .UnsupportedType to be BalanceByDate, but found None. (how much did i have in my charity term deposits last month - Fail)
how much did i have in my club and societies choice account in feb Expected context .UnsupportedType to be BalanceByDate, but found None. (how much did i have in my club and societies choice account in feb - Fail)
how much did my current account contain in july Expected context .UnsupportedType to be BalanceByDate, but found None. (how much did my current account contain in july - Fail)
how much did my current account have in it in april Expected context .UnsupportedType to be BalanceByDate, but found None. (how much did my current account have in it in april - Fail)
how much money did i have in my current account in may Expected context .UnsupportedType to be BalanceByDate, but found None. (how much money did i have in my current account in may - Fail)
how much money did my savings account contain in 2012 Expected context .UnsupportedType to be BalanceByDate, but found None. (how much money did my savings account contain in 2012 - Fail)
how much was in my account in march Expected context .UnsupportedType to be BalanceByDate, but found None. (how much was in my account in march - Fail)
how much was in my business choice account on monday Expected context .UnsupportedType to be BalanceByDate, but found None. (how much was in my business choice account on monday - Fail)
how much was in my business choice charities account in march Expected context .UnsupportedType to be BalanceByDate, but found None. (how much was in my business choice charities account in march - Fail)
how much was in my business current account on february 2nd Expected context .UnsupportedType to be BalanceByDate, but found None. (how much was in my business current account on february 2nd - Fail)
how much was in my charity accounts last week Expected context .UnsupportedType to be BalanceByDate, but found None. (how much was in my charity accounts last week - Fail)
how much was in my club and societies account last month Expected context .UnsupportedType to be BalanceByDate, but found None. (how much was in my club and societies account last month - Fail)
how much was in my Club and Societies Choice account last year Expected context .UnsupportedType to be BalanceByDate, but found None. (how much was in my Club and Societies Choice account last year - Fail)
how much was there in my business choice account on monday Expected context .UnsupportedType to be BalanceByDate, but found None. (how much was there in my business choice account on monday - Fail)
how much was there in my business choice charities account in march Expected context .UnsupportedType to be BalanceByDate, but found None. (how much was there in my business choice charities account in march - Fail)
how much was there in my business current account on february 2nd Expected context .UnsupportedType to be BalanceByDate, but found None. (how much was there in my business current account on february 2nd - Fail)
how much was there in my charity accounts last tuesday Expected context .UnsupportedType to be BalanceByDate, but found None. (how much was there in my charity accounts last tuesday - Fail)
how much was there in my club and societies account last month Expected context .UnsupportedType to be BalanceByDate, but found None. (how much was there in my club and societies account last month - Fail)
how much was there in my Club and Societies Choice account last year Expected context .UnsupportedType to be BalanceByDate, but found None. (how much was there in my Club and Societies Choice account last year - Fail)
how was my current account looking back in june Expected context .UnsupportedType to be BalanceByDate, but found None. (how was my current account looking back in june - Fail)
how was my overdraft last year Expected context .UnsupportedType to be BalanceByDate, but found None. (how was my overdraft last year - Fail)
how was my savings account looking in may Expected context .UnsupportedType to be BalanceByDate, but found None. (how was my savings account looking in may - Fail)
i want to know what figure was in my current account last year Expected context .UnsupportedType to be BalanceByDate, but found None. (i want to know what figure was in my current account last year - Fail)
i want to know what i had in my savings account last june Expected context .UnsupportedType to be BalanceByDate, but found None. (i want to know what i had in my savings account last june - Fail)
i want to know what was in my current account in 2012 Expected context .UnsupportedType to be BalanceByDate, but found None. (i want to know what was in my current account in 2012 - Fail)
in 2010 how much cash did i have in my savings account Expected context .UnsupportedType to be BalanceByDate, but found None. (in 2010 how much cash did i have in my savings account - Fail)
In april how much money was in my current account Expected context .UnsupportedType to be BalanceByDate, but found None. (In april how much money was in my current account - Fail)
last month, how much was in my savings account Expected context .UnsupportedType to be BalanceByDate, but found None. (last month, how much was in my savings account - Fail)
last week, how much did i have in my current account Expected context .UnsupportedType to be BalanceByDate, but found None. (last week, how much did i have in my current account - Fail)
my savings account balance last year? Expected context .UnsupportedType to be BalanceByDate, but found None. (my savings account balance last year? - Fail)
on july 29th was i in my overdraft Expected context .UnsupportedType to be BalanceByDate, but found None. (on july 29th was i in my overdraft - Fail)
on may 6th how much was in my current account Expected context .UnsupportedType to be BalanceByDate, but found None. (on may 6th how much was in my current account - Fail)
show me my current account balance from june Expected context .UnsupportedType to be BalanceByDate, but found None. (show me my current account balance from june - Fail)
tell me my current account balance from april Expected context .UnsupportedType to be BalanceByDate, but found None. (tell me my current account balance from april - Fail)
tell me what my current account balance was last monday Expected context .UnsupportedType to be BalanceByDate, but found None. (tell me what my current account balance was last monday - Fail)
was i in my overdraft last june Expected context .UnsupportedType to be BalanceByDate, but found None. (was i in my overdraft last june - Fail)
was i overdrawn in february Expected context .UnsupportedType to be BalanceByDate, but found None. (was i overdrawn in february - Fail)
what amount did i have within my current account last april Expected context .UnsupportedType to be BalanceByDate, but found None. (what amount did i have within my current account last april - Fail)
what amount of money did i have in my savings account in may Expected context .UnsupportedType to be BalanceByDate, but found None. (what amount of money did i have in my savings account in may - Fail)
what balance did i sit at in my current account in june Expected context .UnsupportedType to be BalanceByDate, but found None. (what balance did i sit at in my current account in june - Fail)
what balance was in my current account last year Expected context .UnsupportedType to be BalanceByDate, but found None. (what balance was in my current account last year - Fail)
what balance was my current account on in may Expected context .UnsupportedType to be BalanceByDate, but found None. (what balance was my current account on in may - Fail)
what balance was my saving account on in 2014 Expected context .UnsupportedType to be BalanceByDate, but found None. (what balance was my saving account on in 2014 - Fail)
what did i have in my current account in may Expected context .UnsupportedType to be BalanceByDate, but found None. (what did i have in my current account in may - Fail)
what did i have in my savings account back in june Expected context .UnsupportedType to be BalanceByDate, but found None. (what did i have in my savings account back in june - Fail)
what did my current account contain in june Expected context .UnsupportedType to be BalanceByDate, but found None. (what did my current account contain in june - Fail)
what did my savings account balance look like in june Expected context .UnsupportedType to be BalanceByDate, but found None. (what did my savings account balance look like in june - Fail)
what did my savings account balance sit at in june Expected context .UnsupportedType to be BalanceByDate, but found None. (what did my savings account balance sit at in june - Fail)
what did my savings account contain in may Expected context .UnsupportedType to be BalanceByDate, but found None. (what did my savings account contain in may - Fail)
what figure was in my current account in may Expected context .UnsupportedType to be BalanceByDate, but found None. (what figure was in my current account in may - Fail)
what is the amount of money i had in my current account last year Expected context .UnsupportedType to be BalanceByDate, but found None. (what is the amount of money i had in my current account last year - Fail)
what is the volume of money i had last june in my savings account Expected context .UnsupportedType to be BalanceByDate, but found None. (what is the volume of money i had last june in my savings account - Fail)
what was in my account in june Expected context .UnsupportedType to be BalanceByDate, but found None. (what was in my account in june - Fail)
what was in my current account in 2017 Expected context .UnsupportedType to be BalanceByDate, but found None. (what was in my current account in 2017 - Fail)
what was in my savings account on june 2nd Expected context .UnsupportedType to be BalanceByDate, but found None. (what was in my savings account on june 2nd - Fail)
what was my current account balance in april Expected context .UnsupportedType to be BalanceByDate, but found None. (what was my current account balance in april - Fail)
what was my savings account balance in june Expected context .UnsupportedType to be BalanceByDate, but found None. (what was my savings account balance in june - Fail)
what was my savings account balance looking like in june Expected context .UnsupportedType to be BalanceByDate, but found None. (what was my savings account balance looking like in june - Fail)
what was my savings account balance sitting at in june Expected context .UnsupportedType to be BalanceByDate, but found None. (what was my savings account balance sitting at in june - Fail)
what was the balance of my current account on june 8th Expected context .UnsupportedType to be BalanceByDate, but found None. (what was the balance of my current account on june 8th - Fail)
what was the balance of my savings account in 2013 Expected context .UnsupportedType to be BalanceByDate, but found None. (what was the balance of my savings account in 2013 - Fail)
what was the balance of the business account last week Expected context .UnsupportedType to be BalanceByDate, but found None. (what was the balance of the business account last week - Fail)
what was the balance of the business account on thurs Expected context .UnsupportedType to be BalanceByDate, but found None. (what was the balance of the business account on thurs - Fail)
what was the current account balance last year Expected context .UnsupportedType to be BalanceByDate, but found None. (what was the current account balance last year - Fail)
what was the figure in my savings account in may Expected context .UnsupportedType to be BalanceByDate, but found None. (what was the figure in my savings account in may - Fail)
what was the savings account balance in september Expected context .UnsupportedType to be BalanceByDate, but found None. (what was the savings account balance in september - Fail)
what was the status of my savings in june Expected context .UnsupportedType to be BalanceByDate, but found None. (what was the status of my savings in june - Fail)
what were my available funds in june Expected context .UnsupportedType to be BalanceByDate, but found None. (what were my available funds in june - Fail)
when was my business account balance above a million pounds Expected context .UnsupportedType to be BalanceByDate, but found None. (when was my business account balance above a million pounds - Fail)
SME-Issues commented 5 years ago

Failed as not understood

Fail - Understanding: None - Failed

Expressions Notes Base Expression
put a number on the amount i have in the bank expected intent to be query_balance but found marked_as_none - unrecognised text: 'a number on the amount i have in the bank'
last week, how much was available in my business account expected intent to be query_balance but found marked_as_none - unrecognised text: 'available'
what is my balance at the moment in my business current account expected intent to be query_balance but found marked_as_none - unrecognised text: 'balance'
i am curious how much cash i have currently in my savings account expected intent to be query_balance but found marked_as_none - unrecognised text: 'curious'
i'm curious about how much money i have in my business term deposit account expected intent to be query_balance but found marked_as_none - unrecognised text: 'curious'
tell me the amount of dollars in the business choice account expected intent to be query_balance but found marked_as_none - unrecognised text: 'dollars'
how big is the figure in my business choice account expected intent to be query_balance but found marked_as_none - unrecognised text: 'how'
how big was my overdraft in may expected intent to be query_balance but found marked_as_none - unrecognised text: 'how'
the balance in my current account if possible expected intent to be query_balance but found marked_as_none - unrecognised text: 'if possible'
i am interested to know the amount in my savings account expected intent to be query_balance but found marked_as_none - unrecognised text: 'interested'
i'm interested to know the balance of my current account expected intent to be query_balance but found marked_as_none - unrecognised text: 'interested'
how much is in the charity accounts and the business accounts expected intent to be query_balance but found marked_as_none - unrecognised text: 'the charity accounts and, the charity accounts and'
can you inform me of the amount of cash i have expected intent to be query_balance but found none
from the charity funds, what is left expected intent to be query_balance but found none
how much did i possess in my savings account on jan 1st expected intent to be query_balance but found none
how much money did i possess in my current account in june expected intent to be query_balance but found none
how much money did i possess in my savings account last year expected intent to be query_balance but found none
what did i possess in my current account on may 3rd expected intent to be query_balance but found none
what did i possess in my savings account on the 3rd of may expected intent to be query_balance but found none
can you tell me how much i have expected intent to be query_balance but found query_unfilled
how much is remaining expected intent to be query_balance but found query_unfilled
tell me my savings amount expected intent to be query_balance but found query_unfilled
when was my charity term deposit last over £500k Account type reference mismatch . Looking for: 'charity term deposit', found: (none)

Fail_As_Expected - Understanding: None - Failed

Expressions Notes Base Expression
do i have a healthy bank balance Mixed bag of understandings: unrecognized: 'do i have,healthy' (do i have a healthy bank balance - Fail)
how is my current account balance Mixed bag of understandings: unrecognized: 'how' (how is my current account balance - Fail)