Dataset

[mcavdar]

Topic related to dataset preparation can be added/discussed here.

[mcavdar]

Requirements:

• Data format is text.
• Data should be in Turkish.
• Data should be related with Turkish contributions to scientific work.

[mcavdar]

• [ ] Some ontological resources can be very helpful, like structured databases.

• [ ] Some English resources(e.g., DBpedia,etc..) may be used by aid of system like START and Query Expansion. http://downloads.dbpedia.org/2016-10/ http://wiki.dbpedia.org/downloads-2016-10#dbpedia-ontology

• [x] https://github.com/dbpedia-spotlight/spotlight-docker https://github.com/dbpedia-spotlight/dbpedia-spotlight/wiki/Run-from-a-JAR

[mcavdar]

Some sources of information:

• http://www.google.com.tr/search?q=site:https://www.tubitak.gov.tr/tubitak_content_files//ozgecmis/&prmd=ivns&ei=dT3DWsRWxaiwAcqfrtgI&start=0&sa=N
• http://www.google.com.tr/search?q=site:http://www.bilimteknik.tubitak.gov.tr/sites/default/files/posterler&prmd=ivns&ei=3UHDWpeqCoSfsgHp-YyYCQ&start=60&sa=N
• http://www.bilimteknik.tubitak.gov.tr

[mcavdar]

Wikimedia-all backup https://dumps.wikimedia.org/trwikisource/latest/ https://dumps.wikimedia.org/trwiki/latest/ https://dumps.wikimedia.org/trwiktionary/latest/

• [x] Read SQuAD example.

[mcavdar]

• [ ] We need to convert some electronic books, papers or magazines in PDF format to text.

[mcavdar]

• [ ] Crawl news via RSS

[mcavdar]

• [ ] Crawl biyografya (only related categories) (for ex. http://www.biyografya.com/arama/category/81)

[mcavdar]

• [ ] Scan Işık's book if you can

[mcavdar]

• [ ] Crawl Osmanlı Bilimi Araştırmaları's pages

[mcavdar]

List of avaliable(ready to use) question-answering dataset: