issues
search
AusDTO
/
disco_layer
Code, outputs and Information relevant to the discovery layer.
1
stars
5
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
can we rename
#86
nokout
closed
9 years ago
2
are we using ES bulk updates when we should
#85
monkeypants
opened
9 years ago
0
separate DB and ES tasks into their own queues
#84
monkeypants
opened
9 years ago
0
high capacity MQ (~100M/month)
#83
monkeypants
closed
9 years ago
1
null "depth" field causing SearchFieldError in celery_haystack
#82
monkeypants
closed
9 years ago
0
slow queries in crawler.tasks
#81
monkeypants
closed
9 years ago
3
document build broken
#80
monkeypants
closed
9 years ago
1
72 content refactor
#79
monkeypants
closed
9 years ago
0
site classification app
#78
monkeypants
opened
9 years ago
1
syncing CHANGED resources (based on HASH mismatch) from crawler to me…
#77
monkeypants
closed
9 years ago
0
what resources should be deleted from the metadata/search index?
#76
monkeypants
opened
9 years ago
7
move sync_from_crawler to crawler.tasks (fixes 62)
#75
monkeypants
closed
9 years ago
0
celery_haystack throws annoying warning
#74
monkeypants
opened
9 years ago
0
annoying warning from celery in django1.8
#73
monkeypants
closed
9 years ago
1
refactor docs for public release
#72
monkeypants
closed
9 years ago
0
add hash to Resource, fixes #65
#71
monkeypants
closed
9 years ago
0
64 rename page to resource
#70
monkeypants
closed
9 years ago
0
61 wrap crawler db
#69
monkeypants
closed
9 years ago
0
instrumented ES reverse proxy
#68
monkeypants
opened
9 years ago
2
spool up a swarm of workers and process the information extraction backlog
#67
monkeypants
opened
9 years ago
2
new tests/celery task for syncing CHANGED resources (based on HASH mismatch)
#66
monkeypants
closed
9 years ago
0
add CONTENT_HASH attitbute to metadata.Resource
#65
monkeypants
closed
9 years ago
0
rename metadata.Page to metadata.Resource
#64
monkeypants
closed
9 years ago
0
rename spiderbucket to metadata
#63
monkeypants
closed
9 years ago
0
new tests/celery task for syncing NEW resources from crawler's DB to metadata.models.Page
#62
monkeypants
closed
9 years ago
1
wrap crawler's DB with new app/model
#61
monkeypants
closed
9 years ago
0
disco_service as a gateway to all the content
#60
monkeypants
opened
9 years ago
1
use REST api for service catalogue data
#59
monkeypants
opened
9 years ago
2
47 index services
#58
monkeypants
closed
9 years ago
0
adopt haystack-celery module
#57
monkeypants
closed
9 years ago
1
mysterious bug in govservices test_update_dimension
#56
monkeypants
closed
9 years ago
1
Fixed logging file extensions.
#55
nokout
closed
9 years ago
0
Add ability to flip the order of queue selection to better do multipl…
#54
nokout
closed
9 years ago
0
retry with www if url has null path
#53
nokout
closed
9 years ago
1
Added docker configuration files.
#52
nokout
closed
9 years ago
0
crawler: change docker user
#51
nokout
closed
9 years ago
1
Fix next fetch check
#50
nokout
closed
9 years ago
0
Fix next fetch check
#49
nokout
closed
9 years ago
0
make browsable version of the service catalogue
#48
monkeypants
opened
9 years ago
3
create haystack index configuration for servicecatalogue
#47
monkeypants
closed
9 years ago
0
use jenkins to maintain normalised service model in RDBMS
#46
monkeypants
opened
9 years ago
3
normalise service catalogue and sync to RDBMS
#45
monkeypants
closed
9 years ago
5
Svc alpha
#44
nokout
closed
9 years ago
0
Fix next fetch check
#43
nokout
closed
9 years ago
0
crawler: http://greenpower.gov.au/
#42
nokout
closed
9 years ago
1
crawler: increase runtime between restarts
#41
nokout
closed
9 years ago
2
Overloaded the queueURL method to work with a callback for checking i…
#40
nokout
closed
9 years ago
0
crawler: addIfMissing is attempting a duplicate insert
#39
nokout
closed
9 years ago
1
crawler: only apply max if > 0
#38
nokout
closed
9 years ago
0
crawler: database password not being passed
#37
nokout
closed
9 years ago
0
Next