Meerkat Changes

[vnagarajY]

Definition of Done: Update Meerkat service in the data_deal branch to allow acceptance of City, state, country, postal code and Phone # as optional attributes for a transaction. Integrate the flow with changes to RNN and search functionality. Search is only for US -

1) Execute CNN 2) Execute RNN 3) If transaction is for a CNN merchant and is available in AGG to CNN mapping - Execute Agg_search using merchant_name =Agg_name from mapping file and city, state, postal code, Phone # - as available in input and Store # (from RNN) 4) Else - Execute Factual Search Merchant name= CNN_merchant name or RNN Merchant name and city, state, postal code, Phone # - as available in input

CNN_Agg.txt

[diwu001]

We have a new web service for datadeal project, and its route is "/meerkat_datadeal/"

Transaction Input fields:

• required fields: transaction_id, description,amount, date, ledger_entry
• optional fields: city, state, country, postal_code, RNN_merchant_name, website_url, store_number, phone_number, input_description

Transaction Output fields:

required_fields: row_id, input_description, merchant_name, description_substring, address, city, state, zip_code, phone, longitude, latitude, website_url, store_number

In debug mode, besides the above required fields, we add the following fields:

• Agg_Name,
• CNN: {label, merchant_score},
• RNN_merchant_name,
• input: {city, state, postal_code, country, store_number, phone_number, website_url}
• agg_search: {address, city, latitude, longitude, list_name, phone_number, source_url, state, store_number, zip_code}
  or factual_search: {street, city, latitude, longitude, merchant_name, phone_number, website, state, store_id, postal_code, confidence_score, country, category_labels, chain_name, fax_number, neighbourhood, source_merchant_id}

Web service Work flow:

• Run merchant CNN
• Run elasticsearch
  • If transaction is for a CNN merchant and is available in AGG to CNN mapping:
    Execute Agg Search using merchant_name = Agg_name from mapping file
    and city, state, postal_code, phone, store_number
  • Else:
    Execute Factual Search using merchant name = CNN merchant name or RNN merchant name
    and city, state, postal_code, phone
  • If not found any result in Agg search, execute Factual search
• Merge fields and ensure output schema
  rules:
  • merchant name : CNN > agg/factual search
  • description_substring: RNN_merchant_name. Only output description substring when CNN merchant name is empty
  • city / state / zipcode / website / phone / store_number : agg / factual search > input
  • address / longitude / latitude : add from agg / factual search
  • if store number in the agg search is empty, store number in the output should be empty

Run a json sample

Code is at branch issue_951 To run a json sample through the meerkat_datadeal web service:

[~/git/Meerkat @ issue_951] ./web_service_tester/single_post_datadeal.sh sample.json