issues
search
surfedushare
/
pol-harvester
A repository that harvests different sources for content
2
stars
0
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Update elastic and kibana to 6.8.6
#127
jelmerderonde
closed
4 years ago
0
Execute query rankings for the real EduRep, calculate dcg, precision, etc.
#126
fako
closed
4 years ago
1
Development
#125
fako
closed
4 years ago
0
Install Elastic Seach
#124
fako
closed
4 years ago
0
Berekenen hoe veel tijd Kaldi nodig heeft (sec / sec video) voor het transcriberen van 100 videos's en daar een gemiddelde van
#123
fako
closed
4 years ago
2
Development
#122
fako
closed
4 years ago
0
See how disciplines are present across duplicates
#121
fako
closed
4 years ago
0
Gamma freeze
#120
fako
closed
4 years ago
0
Bump pillow from 6.2.0 to 6.2.1 in /harvester
#119
dependabot[bot]
closed
4 years ago
0
Elastic filtering
#118
fako
closed
4 years ago
0
Elastic suggestions
#117
fako
closed
4 years ago
0
Data verzamelen voor de grafieken
#116
jelmerderonde
closed
4 years ago
1
Metabase toevoegen aan de docker stack
#115
jelmerderonde
closed
4 years ago
1
When enriching something using documents we should take proximity between query and enrichment inside those documents into account
#114
jelmerderonde
opened
4 years ago
0
Build a specific vocabulary for higher education terms
#113
jelmerderonde
opened
4 years ago
0
Use the English Wikipedia to include entities like Gordon Guyatt to vocabularies
#112
jelmerderonde
opened
4 years ago
0
Currently we're looking at the "synonym" relationship. We can enrich using different relationships. Such as the "causes of" relationship. This link shows the "causes of learn" as an example: http://conceptnet.io/c/en/learn?rel=/r/Causes&limit=1000
#111
jelmerderonde
opened
4 years ago
0
Use reliable sources within ConceptNet. Restricting lookups to English sources might improve enrichment results
#110
jelmerderonde
opened
4 years ago
0
Create a shared stop word list for English and Dutch to use in the TfidfVectorizer used for PRF. Or switch vectorizer when we see that language detection screwed up, because stop words are showing up.
#109
jelmerderonde
opened
4 years ago
0
Enable recursion for building vocabularies from categories to get more relevant articles.
#108
jelmerderonde
opened
4 years ago
0
Run the PRF, ConceptNet and Google comparisons again with the updated query rankings and see how results change from last time.
#107
jelmerderonde
closed
4 years ago
0
Try adding an arrangement_text field that contains text coming from sibling documents. Preferable this can be an array of documents inside the index.
#106
jelmerderonde
opened
4 years ago
0
After approval of the beta freeze there are a few things that we should clean up:
#105
jelmerderonde
closed
4 years ago
0
Change the Elasticsearch mapping so that more fields also have _keyword field. This will allow us to create charts in Kibana.
#104
jelmerderonde
closed
4 years ago
4
Bump pillow from 5.3.0 to 6.2.0 in /harvester
#103
dependabot[bot]
closed
4 years ago
1
There are KaldiNL commands that fail when getting all the confidences. Perhaps the output is overflowing some limits?
#102
fako
closed
4 years ago
2
Adds a health check to the API to prevent stale API instances
#101
fako
closed
4 years ago
3
Rateapp no longer displays saved rankings properly
#100
jelmerderonde
closed
4 years ago
3
Use first Kaldi transcript result to enrich a second run
#99
jelmerderonde
closed
4 years ago
0
Try the search "didactiek" on surfpol.nl. There seem to be a lot of duplicate results on the first few pages. Is this a bug?
#98
jelmerderonde
closed
4 years ago
1
At some point all Python applications inside the container died. We should probably auto-restart on such failures.
#97
jelmerderonde
closed
4 years ago
0
Improve language detection for videos
#96
jelmerderonde
closed
4 years ago
0
Migrate references to the new document references
#95
jelmerderonde
closed
4 years ago
4
Handle file types in a way that Edurep/zoekportal does. Add a filtype field, which we try to fill using mapping from either mimetype or extension. Mimetype can sometimes be not available.
#94
jelmerderonde
closed
4 years ago
2
Gh89 refactor pipeline 03
#93
fako
closed
4 years ago
0
Migrate to our new elastic instance (elastic.surfpol.nl)
#92
jelmerderonde
closed
4 years ago
4
Gh89 refactor pipeline 02
#91
fako
closed
4 years ago
0
Gh89 refactor pipeline 01
#90
fako
closed
5 years ago
0
Refactor harvest pipeline
#89
fako
closed
4 years ago
0
Look at Google results and see if any materials need to be added to the rankings
#88
jelmerderonde
closed
4 years ago
1
Look at ConceptNet enrichment results and see if any materials need to be added to the rankings
#87
jelmerderonde
closed
4 years ago
1
Look at PRF results and see if any results need to be added to the rankings
#86
jelmerderonde
closed
4 years ago
1
Datagrowth update
#85
fako
closed
5 years ago
0
Look at which fields are most relevant for Elastic Search
#84
fako
closed
4 years ago
1
Look into Google Custom Search possibilities
#83
fako
opened
5 years ago
0
Select papers that we want to buy/read in order to get a better grip on modern text enrichment strategies
#82
jelmerderonde
closed
4 years ago
1
/media is unprotected on the server (this contains all processed materials)
#81
jelmerderonde
closed
4 years ago
1
Gh79 corpera
#80
fako
closed
5 years ago
0
Given a domain, try to construct a vocabulary, using dbpedia, wikipedia, wikidata and/or similar sites.
#79
fako
closed
5 years ago
3
Use ConceptNet or similar tool by dbpedia to enrich query
#78
fako
closed
5 years ago
2
Previous
Next