issues
search
openaustralia
/
yinyo
A wonderfully simple API driven service to reliably execute many long running scrapers in a super scaleable way
https://yinyo.io
Apache License 2.0
6
stars
1
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
`kustomize build .` unable to parse kustomization.yaml
#58
jamezpolley
closed
5 years ago
2
Explicitly tell the reader to install dependencies
#57
jamezpolley
closed
5 years ago
1
Convert run.sh bash script to golang
#56
mlandauer
closed
5 years ago
0
Move exit code and usage to the finish event after "build" and "run"
#55
mlandauer
closed
5 years ago
2
Don't allow user to override herokuish environment variables
#54
mlandauer
closed
4 years ago
1
Improve isolation of containers by using lightweight VM
#53
mlandauer
opened
5 years ago
0
Make s3 store and bucket configurable
#52
mlandauer
closed
4 years ago
0
Give clay server the minimum k8s permissions
#51
mlandauer
closed
5 years ago
0
When incorrect json is provided when starting a run return a sensible error
#50
mlandauer
closed
4 years ago
1
Return an error if more than one `name_prefix` is used when creating a run
#49
mlandauer
closed
4 years ago
1
Trying to start a run that's already been started should error sensibly in the API
#48
mlandauer
opened
5 years ago
0
Run clay server as unprivileged user in container
#47
mlandauer
closed
5 years ago
0
Handle output file not getting generated by the scraper
#46
mlandauer
closed
4 years ago
1
If the build fails then it shouldn't try to run the scraper but it should record stats
#45
mlandauer
closed
5 years ago
0
Bundle events that happen close together in time into a single http request
#44
mlandauer
opened
5 years ago
0
This PR allows the user to give a callback URL for sending events to
#43
mlandauer
closed
5 years ago
0
Rename CLAY_RUN_TOKEN environment variable to CLAY_INTERNAL_RUN_TOKEN
#42
mlandauer
closed
5 years ago
1
Upgrade to Kubernetes 1.16
#41
mlandauer
closed
4 years ago
3
Reserve whole environment variable namespace "CLAY_INTERNAL_" for internal use
#40
mlandauer
closed
5 years ago
0
Make run prefix optional
#39
mlandauer
closed
5 years ago
0
Rename scraper_name to prefix
#38
mlandauer
closed
5 years ago
0
Add events for starting and finishing "build" and starting and finishing "run"
#37
mlandauer
closed
5 years ago
1
Alternative graphql api
#36
mlandauer
closed
5 years ago
2
Write one page markdown if intro page
#35
mlandauer
closed
5 years ago
2
Make the repo public
#34
mlandauer
closed
5 years ago
1
Add license
#33
mlandauer
closed
5 years ago
1
When morph.sh runs a scraper from a local directory write the database to the directory when it's done
#32
mlandauer
closed
5 years ago
0
Set resource limits on job (e.g. memory)
#31
mlandauer
closed
4 years ago
0
Articulate design principles
#30
mlandauer
closed
5 years ago
0
Make announcement
#29
mlandauer
opened
5 years ago
4
Static website for documentation
#28
mlandauer
closed
5 years ago
1
Swagger openapi specs/docs
#27
mlandauer
closed
4 years ago
1
If a scraper errors “normally” we should still get the output
#26
mlandauer
closed
4 years ago
0
Make morph scraper command inject default values for Gemfile etc just as morph does
#25
mlandauer
closed
5 years ago
1
Automatically clean out runs that are stopped and have been inactive for a while
#24
mlandauer
opened
5 years ago
1
Make incorrect JSON in server api call return correct http error code
#23
mlandauer
closed
4 years ago
1
Make morph command line work from local source code optionally
#22
mlandauer
closed
5 years ago
0
Make output file optional
#21
mlandauer
closed
4 years ago
0
Add authentication to "create run" endpoint
#20
mlandauer
opened
5 years ago
3
Optionally send events asynchronously back to the user
#19
mlandauer
closed
5 years ago
1
Allow user to pass custom environment variables
#18
mlandauer
closed
5 years ago
0
Return result code for scraper run
#17
mlandauer
closed
5 years ago
1
Return network use of scraper by using a proxy
#16
mlandauer
opened
5 years ago
1
Don't allow scrapers to talk to the outside world except through a proxy
#15
mlandauer
opened
5 years ago
0
Website for project
#14
mlandauer
closed
4 years ago
1
Give project a new name
#13
mlandauer
closed
4 years ago
0
Add measurement of resource usage
#12
mlandauer
closed
5 years ago
1
Trim extra output to get clay-system url
#11
jamezpolley
closed
5 years ago
2
`minikube service` output has an extra `* ` on the front
#10
jamezpolley
closed
5 years ago
3
`make build-in-docker` fails with `unknown error 526`
#9
jamezpolley
closed
5 years ago
6
Previous
Next