How did you guys use the results from entity retrieval and context retrieval

[652994331]

HI, how did you guys use results from entity retrieval and context retrieval . I saw this diagram

to my understanding , you used result from entity retrieval and context retrieval in the column filtering step, but when I looked at the prompt of column filtering part, it's looks like it's a iterative process and you used this prompt "column by column" to check the relevance of columns and question, and I did not see entity and context part In this prompt.

[ShayanTalaei]

Hi, thanks for your questions, and sorry for the delayed reply!

For prompts with the database schema, we pass the retrieved entities and context as comments in the database schema for their corresponding column. For instance:

CREATE TABLE from
(
...
`County Name` TEXT null, -- Example Values: `Los Angeles`, 
`Free Meal Count (K-12)` REAL null, -- Column Description: Free Meal Count (K-12) | Value Description: eligible free rate = Free Meal Count / Enrollment,
...
) 

For the column filtering prompt specifically, we pass it in the COLUMN_PROFILE, which contains the table name, column name, the retrieved relevant values, and the context of that column.