MiSecurity / x-patrol

github泄露扫描系统
1.15k stars 303 forks source link

代码扫描不全 #24

Closed xuyanhua closed 5 years ago

xuyanhua commented 5 years ago

你好,我不会go,没法看具体的逻辑,搭建起来测试了一下,发现通过github.com网站,扫描我要的关键词,如“zhichengcredit.com”能搜过出好多结果,但是用这个工具扫描的时候,只能扫出几条数据来,见下面的截图 image image

netxfly commented 5 years ago

目前的策略是只取最近60天的扫描结果,超过60天的记录不会记录入库,如下:

ctx := context.Background()
    listOpt := github.ListOptions{PerPage: 100}
    opt := &github.SearchOptions{Sort: "indexed", Order: "desc", TextMatch: true, ListOptions: listOpt}

    for {
        result, resp, err1 := c.Client.Search.Code(ctx, keyword, opt)

        t := make([]github.CodeResult, 0)
        for _, codeResult := range result.CodeResults {
            id := codeResult.Repository.GetID()
            repo, _, _ := c.Client.Repositories.GetByID(ctx, id)
            pushTime := repo.GetPushedAt().Time
            now := time.Now()
            if now.Sub(pushTime).Hours()/24 <= 60 {
                logger.Log.Infof("repo: %v, pushed Time: %v, keyword: %v", repo.GetFullName(), pushTime, keyword)
                t = append(t, codeResult)
            }
        }
xuyanhua commented 5 years ago

这个写死了不太好吧--,要是能拿个配置来就好了

netxfly commented 5 years ago

行,回头空了整上,分分钟的事。