daviddengcn / gcse

Project for Go Search, a search engine for finding popular and relevant packages.
http://go-search.org/
BSD 2-Clause "Simplified" License
277 stars 45 forks source link

New packages are not crawled #31

Open daviddengcn opened 8 years ago

laktak commented 8 years ago

I've added github.com/laktak/hjson-go but it won't show up in http://go-search.org/search?q=hjson - is it because of this?

daviddengcn commented 8 years ago

Thanks for letting me know this, I'll check it soon.

On Tue, Aug 9, 2016 at 5:54 AM, Christian Zangl notifications@github.com wrote:

I've added github.com/laktak/hjson-go but it won't show up in http://go-search.org/search?q=hjson - is it because of this?

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub https://github.com/daviddengcn/gcse/issues/31#issuecomment-238543553, or mute the thread https://github.com/notifications/unsubscribe-auth/AAih8M7h5qJFNKi7Exx4C-x_mSLptrRKks5qeHiVgaJpZM4HcKLm .

laktak commented 8 years ago

fyi - the repo was moved to https://github.com/hjson/hjson-go. I submitted github.com/hjson/hjson-go again but it still won't show up.

sitepodmatt commented 7 years ago

This does seem to be an issue when repos move. It should remove when 404, or update when 301s, these scenarios dont seem to currently work.

daviddengcn commented 7 years ago

The current challenge is the access limitation from github API. A big refactor needs to be done to make less call to github api to fetch all the packages.