C11-public : courses filter search : create customizable criteria based filter search

[Chamindana]

Business benefit: Display all the available courses in a variable manner according to one or more filters. For the public user we can not directly say what are the institutes that should display first. Therefore it's important to find a proper way of display the all courses randomly.

Estimation: UI - 32sp Dev - 48sp Testing - 48sp

[pabodhaW]

Mock-up design of the proposed UI - Filter search

[pabodhaW]

201610241706-PN

• created branch c11-criteria-based-filter-search-pn of GENESIIS/campus pabodhaW pushed 1 commit to campus:
• c11-criteria-based-filter-search-pn- c11-criteria-based-filter-search : designed a sample UI to implement filter search. - 3b143573d0

[pabodhaW]

201610251536 PN pabodhaW pushed 2 commits to campus:c11-criteria-based-filter-search-pn

• c11-criteria-based-filter-search : modified the JavaScript code to add addsearchData() method to pass data to the servlet. - 5fae553a20
• c11-criteria-based-filter-search INIT PublicCmdFactory.java. INIT CmdGetSearchData.java and implement execute() method. - 79c6170fc1

[pabodhaW]

201610252314 PN pabodhaW pushed 3 commits to campus:c11-criteria-based-filter-search-pn

• c11-criteria-based-filter-search: modified execute() method. - 9ec540a1a0
• c11-criteria-based-filter-search: c11-criteria-based-filter-search: INIT the class to implement search DAO methods. - 699687d6b7
• c11-criteria-based-filter-search: c11-criteria-based-filter-search INIT QueryBuildingHelper.java to implement query building helper method. - 023dc24acf

[pabodhaW]

201610261715 PN pabodhaW pushed 3 commits to campus:c11-criteria-based-filter-search-pn

• c11-criteria-based-filter-search: modified xml files for configure Lucane. - 6437007691
• c11-criteria-based-filter-search INIT LuceneTest.java to implement filter search. - 21a2bf6fca
• Lucene test class with copied methods. - 9cc6f91053

[pabodhaW]

201610271718 PN pabodhaW pushed 4 commits to campus:c11-criteria-based-filter-search-pn

• c11-criteria-based-filter-search modified execute() method for test LuceneAPI and QueryBuildingHelper.java class - 910818441a
• c11-criteria-based-filter-search modified assignMapData() method and extractFromJason() method. - WIP - fa0853982d
• c11-criteria-based-filter-search : modified the JavaScript code to fix a bug encountered in passing data to the JSon. - feec18a9e6
• c11-criteria-based-filter-search copied classes from Internet to test Lucene. - b3db08bad9

[pabodhaW]

201610281042 PN pabodhaW pushed 3 commits to campus:c11-criteria-based-filter-search-pn

• c11-criteria-based-filter-search: added class attributes and data access methods. - 91b94d7948
• c11-criteria-based-filter-search: modified .tml file type into .jsp type. - c4306620cc
• c11-criteria-based-filter-search: modified .html type into .jsp class for all the UI related pages. - 4cd348be35

[pabodhaW]

201610281117 PN pabodhaW pushed 1 commit to campus:c11-criteria-based-filter-search-pn

• c11-criteria-based-filter-search changed the incorrect class paths mentioned in .jsp pages. added logger import for SearchDAO.java and CategoryDAO.java classes. - 0afe474ae0

[pabodhaW]

201610301944 PN

Commits on Oct 29, 2016 c11-criteria-based-filter-search: renamed class ProgramTown -> ProgrammeTown. - d0662d2 c11-criteria-based-filter-search implemented getAll() method for retrieve existing details - abe942e c11-criteria-based-filter-search modified sql query inside getAll() method. - 82517c2 PN c11-criteria-based-filter-search implemented findById() method. - fd7f1d0 c11-criteria-based-filter-search INIT the class and implemented execute() method. - 0909b4f c11-criteria-based-filter-search: added LIST_LEVEL_DATA,LIST_TOWN_DATA,LIST_MAJOR_DATA,LIST_DISTRICT_DATA attributes accordingly. - f200946

Commits on Oct 30, 2016 JavaScript functions to display criteria details included here. - 070d0bd Modified the servlet and command class to pass Gson data to the jsp page. - 7e77a1c Modified the UI to display data coming from the Servlet. - c5118c1 INIT the classes for display course details. - 56f6e41

I got stuck in display details which comes from servlet in jsp page.

Data is successfully passing to the JSP page from servlet and goes back to the JSP from the servlet successfully. Only thing not working here is, data not get set into the UI element.

I tried some references below as a help but I couldn't get it done.

1. Building Ajax-enabled auto-complete and cascading drop-down controls
2. Ajax Cascading DropDownList in JSP & Servlet using JQuery and JSON
3. AJAX implementation in Servlets using JQuery and JSON

Committing the code I have done so far and paused till I find a right thing to do also I'm planing to discuss with the team since all of us will face the same kind of problem when it comes to display the data on UI which comes from the servlet. @tharinduw FYI.

[pabodhaW]

201610311014 PN

pabodhaW pushed 3 commits to campus:c11-criteria-based-filter-search-pn

• C11: modified the servlet code to get the category details from the DB. - b12622be9a
• c11: removed sample dropdown added for testing purpose. - 3172d6e195
• c11: modified displayCategory() method to display details coming from the DB on dropdown. - e8a0224744

[pabodhaW]

201610311520 PN

pabodhaW pushed 2 commits to campus:c11-criteria-based-filter-search-pn

• c11: modifing UI to display details on floating checkbox/tag-input elements. - WIP - 7d3f8e7bf7
• c11: modified SQL query to take Major details. - b035a70ae9

pabodhaW pushed 1 commit to campus:c11-criteria-based-filter-search-pn

• c11: modifing JS functions to display details on UI elements. - 9d0ced3d9d

[pabodhaW]

201611011652 PN

pabodhaW pushed 2 commits to campus:c11-criteria-based-filter-search-pn

• Test files added temporary to test UI element data populating from DB values. - 931cca8acb
• c11: modified the courses.jsp page for populate dynamic div element using DB values. - 8e9202c37a

pabodhaW pushed 3 commits to campus:c11-criteria-based-filter-search-pn

• c11-criteria-based-filter-search modified getAll() method SQL query. - 21bbaa880f
• c11-criteria-based-filter-search modified execute() method parameter. - d8bfccf487
• c11-criteria-based-filter-search: added LIST_INSTITUTE_DATA attribute. - eaee002e0b

pabodhaW pushed 6 commits to campus:c11-criteria-based-filter-search-pn

• c11-criteria-based-filter-search: modified the execute() methodimplementation. INIT new CmdListInstitute.java class. - 4e28522b8f
• c11-criteria-based-filter-search modified the doPost method with a null validation for IView type object. - 0615361b6d
• c11-criteria-based-filter-search implemented findById() method. - 2322aec3d7
• c11-criteria-based-filter-search implemented findById() method. - 2cb0ac150b
• c11-criteria-based-filter-search implemented displayInstitute(), displayMajor(), displayLevel(), displayDistricts() and pad() method. - 9c5cef5ad2

[pabodhaW]

201611021233 PN pabodhaW pushed 5 commits to campus:c11-criteria-based-filter-search-pn

• c11: Required JS and CSS files to display datatable, are listed in campus.war/web/dist/datatable folder. - 287f4a1ac6
• INIT TableTest.jsp class for test bootstrap data table. - 724bde2517
• c11: modified css file to hide left search pannel. - 18428c6550
• c11-criteria-based-filter-search implement data table to display courses. - 8a281bdf1d
• c11: added datatable js and css file reference to the index page. - 66e6405a72

[pabodhaW]

201611021635 PN pabodhaW pushed 5 commits to campus:c11-criteria-based-filter-search-pn

• c11-criteria-based-filter-search modified execute() method get searchdata and pass it to ProgramDAO. - 3f4c5801ca
• c11-criteria-based-filter-search modified the sql query in findById() method. - c7374a4bcc
• c11-criteria-based-filter-search implementing findById() method to retrieve data according to the criteria. - 89e604e8d0
• c11-criteria-based-filter-search implemented getSelectedData(), getValueUsingParentTag() and addsearchData() method. - a04c92618e
• c11-criteria-based-filter-search implement data table to display courses. - b68950025a

[pabodhaW]

201611021635 PN pabodhaW pushed 3 commits to campus:c11-criteria-based-filter-search-pn

• c11: modified the execute() method. - 98ae24ffcd
• c11: modified the SQL query inside findById() method. - 1871d8101f
• c11: modified addsearchData() method. - 6e6ed91042

[pabodhaW]

201611022322 PN pabodhaW pushed 8 commits to campus:c11-criteria-based-filter-search-pn

• c11-criteria-based-filter-search modified CmdGetSearchData.execute() method. - 69919dc
• c11-criteria-based-filter-search modified execute() method by giving validation to 'categoryCode' - 92fceb5
• c11-criteria-based-filter-search modified execute() method by giving validation to 'categoryCode' - 37724b2
• c11-criteria-based-filter-search DistrictDAO.getAll() method implemented. - 8bce896
• c11-criteria-based-filter-search modified/implemented getAll() and findById() methods in InstituteDAO.java, MajorDAO and ProgremmeDAO.java. - 12a5bd1
• c11-criteria-based-filter-search changed dynamicQuery() methods' string concatenation order. - 7c59947
• c11-criteria-based-filter-search modified the UI to display the course details. - WIP - 814bdc9
• c11-criteria-based-filter-search modified addsearchData() method. - bc2be39

[pabodhaW]

201611030952 PN pabodhaW pushed 2 commits to campus:c11-criteria-based-filter-search-pn

• c11: resolved an NPX encountered in passing user input data to the DAO class through command class. - 718983fed4
• c11: modified SQL query inside getAll() and findById() methods - bd594e1e19

201611031617 PN pabodhaW pushed 5 commits to campus:c11-criteria-based-filter-search-pn

• c11: modified execute() method to load getAll() method and findById() method accordingly. - 085accc182
• c11: modified the UI elements by removing unnecessary comments. - cacfacb8d2
• c11: modified getAll() method and findById() method by changing the SQL query. - 9202f601d8
• c11: modified addsearchData() method to load data dynamically. - f97f8aeeb6
• c11: modified dynamicQuery() methods' string concatenation order. - 8a25360ad5

[pabodhaW]

201611040931 PN pabodhaW pushed 3 commits to campus:c11-criteria-based-filter-search-pn

• c11: INIT IQueryBuilder.java interface to define methods to query building helper. - e1e26224fc
• c11: modified the query building methods. - cff3e49ee2
• c11: modified findById() method. - 1cf287a039

[tharakaGen]

[pabodhaW]

201611040932 PN

Comments for QA

• There will be delay in data population to the UI elements or handled exceptions appear in serve-log, coming from the 'All Courses' page. Those issues encountered due to DB connections.
• DataTable search/sort functionality, which comes with default bootstrap data table js/css files, not working properly. This issue is a known issue and it's to be fix by @tharakaGen . (Discussed and confirmed with him.)
• The class hierarchy is slightly different from the "xeno". This issue is a known one and solution is currently under discussion.

@tharinduw This if FYI. Moving this issue to @HimashaFernando.

[pabodhaW]

201611081130 PN Due to the design change that's intended to support both JSTL and JSON data , through the same CampusController.java (servlet) and the decision to follow the multi-page Application approach instead of SPA (Single Page Application), the rest of the code progression will be conducted in c11-criteria-based-filter-search-MP-pn branch.

[pabodhaW]

201608111300 PN pabodhaW pushed 1 commit to campus:c11-criteria-based-filter-search-MP-pn

• C11: copied all the modified classes to the new branch. (Interface: IDataHelper.java ,class: DataHelper.java,Servlet: CampusController.java, PublicController.java,Enum: Operation.java, ResponseType.java) - bedb158249

[pabodhaW]

201611081437 PN pabodhaW pushed 1 commit to campus:c11-criteria-based-filter-search-MP-pn

• c11: merged with c11-ui-criteria-based-filter-search-MP-tr branch. - 3f77639fa3

[pabodhaW]

201611081540 PN pabodhaW pushed 1 commit to campus:c11-criteria-based-filter-search-MP-pn

• c11: removed all the .html files and chaged them into .jsp files. resolved all the UI file path issues. - 47c1e33e27

[pabodhaW]

201611082300 PN pabodhaW pushed 2 commits to campus:c11-criteria-based-filter-search-MP-pn

• c11: modified the method to check 404 error. - d0bd6e42ea
• c11: added imports for jQuery js file. Fixing 404 error WIP. - aad2aa7d62

This issue is not working with the new solution mentioned in rtc 201611081130 PN. 404 issue is encountered while Ajax call firing. So the error needs to be fix. - WIP

[pabodhaW]

201011091719 PN pabodhaW pushed 5 commits to campus:c11-criteria-based-filter-search-MP-pn

• c11-criteria-based-filter-search modified execute() to load more than one collection. - af86e91ade
• c11-criteria-based-filter-search changed ResponseType.JSP into ResponseType.JSON. - 9f903a12ff
• c11-criteria-based-filter-search modified the process() method to modify JSON object that passes to the JSP page. - b594ea99a3
• c11-criteria-based-filter-search modified getAjaxData() and addsearchData() method to load data dynamically. - b18be57472
• c11-criteria-based-filter-search modified UI to display dynamic data. - 00a6c9f48e

[pabodhaW]

201611101413 PN pabodhaW pushed 3 commits to campus:c11-criteria-based-filter-search-MP-pn

• c11: modified jQuery method to display searched data on dataTable. - 14525aa8b9
• c11: modified ResponseType.JSP into ResponseType.JSON in ResponseType Enum, GET_SEARCH_DATA attribute. - 5317df2356
• C11: changed the title name Level into Major on courses UI. - 5447d5979a

[pabodhaW]

201611101629 PN pabodhaW pushed 2 commits to campus:c11-criteria-based-filter-search-MP-pn

• C11: formatted logger statements. - 156a65151e
• C11: Formatted MajorCount display on UI. - 2fb3dc27a6

[pabodhaW]

201611101630 PN

Comments for QA

• There will be delay in data population to the UI elements or handled exceptions appear in serve-log, encountering from the 'All Courses' page. Those issues are due to DB connection.
• While the functionality testing you will see these errors from the browser. This 404 issues are known issues due to Google fonts and datatable warnings.. This is to be fixed by @tharakaGen . Uncaught Error: DataTables warning: table id=example - Cannot reinitialise DataTable. For more information about this error, please see http://datatables.net/tn/3(…) http://www.campus.dev:8080/dist/bower-components/fonts/glyphicons-halflings-regular.woff2 Failed to load resource: the server responded with a status of 404 (Not Found) http://www.campus.dev:8080/dist/bower-components/fonts/glyphicons-halflings-regular.woff Failed to load resource: the server responded with a status of 404 (Not Found) http://www.campus.dev:8080/dist/bower-components/fonts/glyphicons-halflings-regular.ttf Failed to load resource: the server responded with a status of 404 (Not Found)

@tharinduw This if FYI. Moving this issue to @HimashaFernando.

[pabodhaW]

201611141014 PN pabodhaW pushed 1 commit to campus:c11-criteria-based-filter-search-MP-pn

• c11: copied process() method into CampusController.java taken from campus:public-controller-testing-2 branch. - 012fe77b05

[pabodhaW]

201611141014 PN Moved c11-criteria-based-filter-search into crev stage.

[anuradha999]

201611161500 AS Code review comments Improvements

1. Remove unused imports. PublicCmdFactory.java
2. It's better to implement reset button in the UI for reset fields and labels, after search. I think it's user friendly.

@pabodhaW FYA

[pabodhaW]

201611161637 PN pabodhaW pushed 3 commits to campus:c11-criteria-based-filter-search-MP-pn

• c11: removed unused logger import from the class. - d804139492
• c11: adding reset functionality via check-box -WIP. - b493c69e4e
• c11: added a name and id to checkbox near 'All'. - 5b1986c852

[pabodhaW]

201611162119 PN Testing Guide.

What has been done(Scope) This issue defines the main filter search for courses. User can select any given criteria and select courses accordingly. Currently back-end code has done using pure SQL. But in future this needs to implement using a proper search methodology such as Elastic Search, Soler or Luscene.

Changed Files $ git diff --name-status d776aa1a90c40f68aab0b87f6c3d3a20339d12f3..5b1986c8525b556f796028f949e5a15662555978

Grade of risk of change High

Sprint released Sprint 1

Unit Test Done

How can it be tested Browse : localhost:8080 > All Courses > Select criteria as user wish > Click 'Apply Search'

What will it affect To the user's course selection.

What user roles are affected public user/admin/course provider

Other comments

• There will be delay in data population to the UI elements or handled exceptions appear in serve-log, encountering from the 'All Courses' page. Those issues are due to DB connection.
• While the functionality testing you will see these errors from the browser. This 404 issues are known issues due to Google fonts and datatable warnings.. This is to be fixed by @tharakaGen . Uncaught Error: DataTables warning: table id=example - Cannot reinitialise DataTable. For more information about this error, please see http://datatables.net/tn/3(…) http://www.campus.dev:8080/dist/bower-components/fonts/glyphicons-halflings-regular.woff2 Failed to load resource: the server responded with a status of 404 (Not Found) http://www.campus.dev:8080/dist/bower-components/fonts/glyphicons-halflings-regular.woff Failed to load resource: the server responded with a status of 404 (Not Found) http://www.campus.dev:8080/dist/bower-components/fonts/glyphicons-halflings-regular.ttf Failed to load resource: the server responded with a status of 404 (Not Found)
• Editable search functionality supplied to the UI by using data-list, which is comes with HTML5. Once user typed something on data-list and reset it using a jQuery/JavaScript event, could not complete within the code. Which means that if user select "All - checkbox", all the UI elements will refresh other than editable search fields. (i.e Category, Institute and District). This is to be resolved after completing the UI enhancements. KTD with @tharakaGen

[pabodhaW]

201611162125 PN Code modifications after crev.

rtc 201611161500 AS

1 Remove unused imports. PublicCmdFactory.java

Completed

• c11: removed unused logger import from the class. - d804139

2 It's better to implement reset button in the UI for reset fields and labels, after search. I think it's user friendly.

Completed To achieve this I used the checkbox near 'All'. Once user click on it the elements will be reset.

• c11: added a name and id to checkbox near 'All'. - 5b1986c
• c11: adding reset functionality via check-box -WIP. - b493c69
• c11: removed unwanted alerts from ui-populate-helper.js script. / by pabodhaW 87787886f0

Editable search functionality supplied to the UI by using data-list, which is comes with HTML5. Once user typed something on data-list and reset it using a jQuery/JavaScript event, could not complete within the code. Which means that if user select "All - checkbox", all the UI elements will refresh other than editable search fields. (i.e Category, Institute and District). This is to be resolved after completing the UI enhancements. KTD with @tharakaGen

@anuradhars assigning this back to you to do the verification.

[anuradha999]

201611171250 AS Code review comments rtc 201611162125 PN

To achieve this I used the checkbox near 'All'. Once user click on it the elements will be reset.

c11: added a name and id to checkbox near 'All'. - 5b1986c c11: adding reset functionality via check-box -WIP. - b493c69 c11: removed unwanted alerts from ui-populate-helper.js script. / by pabodhaW 8778788 Editable search functionality supplied to the UI by using data-list, which is comes with HTML5. Once user >typed something on data-list and reset it using a jQuery/JavaScript event, could not complete within the >code. Which means that if user select "All - checkbox", all the UI elements will refresh other than editable >search fields. (i.e Category, Institute and District). This is to be resolved after completing the UI >enhancements. KTD with @tharakaGen

- fixed

pushed 2 commits to campus:c11-criteria-based-filter-search-MP-pn

• c11-criteria-based-filter-search adding reset functionality via check-box fixed / by anuradhars 4a89d064ae
• c11-criteria-based-filter-search adding reset functionality via check-box fixed / by anuradhars efef3c45a8

Crev pass, move to RFQA.

[Chamindana]

201611231330 CN

QA comments

1.Load the site and go to the All courses page(Assumed that All-5) >>And select - All and click on APPLY SEARCH >>Then it is going to filter all search result >>After that go to the Search text box and search invalid record >>Then it is going to display the message "No data available in table">> And check the count of All /Major>>It is still displayed as All-5 and Major-6 :: It should be updated count as 0 for ALL/Major category when there is no data available in the table.

2.Noticed following errors on view course page.

3.Noticed following errors when search/select All and major

4.Drop downs(Select Educational area,Select Institute and Select District) list is viewed as empty list in IE and Firefox browses.

5.Its better to remove the ids of Drop downs(Select Educational area,Select Institute and Select District)

6.Sorting function is not working in Institute column.

Assigned back to @pabodhaW to consider above points.

[pabodhaW]

201611241120 PN MX Fixes are done

pabodhaW pushed 4 commits to campus:c11-criteria-based-filter-search-MP-pn

• c11-criteria-based-filter-search: added higer viersion of bootstrap.min.js file and google fonts folder to the war file. / by pabodhaW 2f84ec74b6
• c11-criteria-based-filter-search modified getAll() method and findById() method by changing the SQL query by selecting CP code. / by pabodhaW 58c53f3fe2
• c11-criteria-based-filter-search implemented getNumFilteredRows() method for display course count on search results. / by pabodhaW 4ffb91cc9b
• c11-criteria-based-filter-search modified bootstrap-3.3.7.min.js imports. / by pabodhaW 03c5445c4b

MX Fixes rtc 201611231330 CN QA comments

1. fixed by changing ui-populate-helper.js file to change the course count on DataTable search and sort events.

2. fixed by adding higher version of bootstrap.min.js file and google fonts folder to the war file.

3. fixed by selecting the display images from C:\sdb\ctxdeploy\education.war\provider\logo(providecode) folder. Please add this folder to the given path if you don't have any image yet. provider.zip

4. This issue is browser dependent and will talk with @tharakaGen. This issue noted while dev stage and couldn't do a fix yet.

5. This issue is also known issue. Will be resolved on styling stage.

6. Sorting function is coming from the default bootstrap settings. And sorting is not working because column is only a image.

Moving this to crev stage and assigning @anuradhars. @tharinduw FYI.

[anuradha999]

201611251135 AS Code review comments rtc 201611241120 PN QA comments are fixed

4. This issue browser dependent.
   • Solution: Fix this issue in the Front-end side. (UI styling stage.)

Moving this to QA stage and assigning @Chamindana

[Chamindana]

201611281715 CN -Local test cycle 2 summary

rtc 201611241120

Error 1, 2, 3, from test cycle 1 All fixed. Tested and verified.

@pabodhaW told me that Errors 4 & 5 will be fixed in future sprints. FYA @tharinduw

Moving the issue to next stage 'To be merged' and assigning to developer.