search

src-d / identity-matching

source{d} extension to match Git signatures to real people.
GNU General Public License v3.0
17 stars 13 forks source link

v3.1.0 doesn't seem to finish after running on writeas org #85

Closed alexpdp7 closed 5 years ago

alexpdp7 commented 5 years ago 
+ match-identities --output identities --host gitbase --port 3306 --user root --password  --external github --api-url  --token fb49750df6df11bdeb8a8483cdd2475a15025e55 --max-identities 20 --months 12 --min-count 5
INFO[0000] Using cache for external matching             cachePath=cache-external.csv
INFO[0000] Dumping CachedMatcher cache                  
INFO[0000] looking for people in commits                
INFO[0000] signatures are not cached in cache-raw.csv, loading them from the database 
INFO[0000] writing the signatures cache to cache-raw.csv 
INFO[0000] found people                                  elapsed=259.214864ms people=1962
INFO[0000] reducing people                              
WARN[0002] unable to find users by commit for email: accounts@qzx.gr 
WARN[0002] no matches for person :michael demetriou||accounts@qzx.gr 
WARN[0003] no matches for person :michael demetriou||accounts@qzx.gr 
WARN[0003] no matches for person :michael demetriou||accounts@qzx.gr 
WARN[0003] no matches for person :michael demetriou||accounts@qzx.gr 
WARN[0004] unable to find users by commit for email: brad@koehn.com 
WARN[0004] no matches for person :brad koehn||brad@koehn.com 
WARN[0005] no matches for person :michael demetriou||accounts@qzx.gr 
WARN[0005] no matches for person :michael demetriou||accounts@qzx.gr 
WARN[0005] no matches for person :michael demetriou||accounts@qzx.gr 
WARN[0005] no matches for person :michael demetriou||accounts@qzx.gr 
WARN[0005] no matches for person :michael demetriou||accounts@qzx.gr 
WARN[0005] no matches for person :michael demetriou||accounts@qzx.gr 
WARN[0005] no matches for person :michael demetriou||accounts@qzx.gr 
WARN[0006] no matches for person :michael demetriou||accounts@qzx.gr 
WARN[0006] no matches for person :michael demetriou||accounts@qzx.gr 
WARN[0006] no matches for person :michael demetriou||accounts@qzx.gr 
WARN[0006] no matches for person :michael demetriou||accounts@qzx.gr 
WARN[0006] no matches for person :michael demetriou||accounts@qzx.gr 
WARN[0006] no matches for person :michael demetriou||accounts@qzx.gr 
WARN[0006] unable to find users by commit for email: ben@overmyer.co 
WARN[0006] no matches for person :ben overmyer||ben@overmyer.co 
INFO[0006] Dumping CachedMatcher cache
(dlv) grs -t
  Goroutine 1 - User: /usr/local/go/src/runtime/sema.go:71 sync.runtime_SemacquireMutex (0x4400f7)
     0  0x00000000004309e0 in runtime.gopark
         at /usr/local/go/src/runtime/proc.go:305
     1  0x0000000000440390 in runtime.goparkunlock
         at /usr/local/go/src/runtime/proc.go:310
     2  0x0000000000440390 in runtime.semacquire1
         at /usr/local/go/src/runtime/sema.go:144
     3  0x00000000004400f7 in sync.runtime_SemacquireMutex
         at /usr/local/go/src/runtime/sema.go:71
     4  0x000000000046804c in sync.(*Mutex).lockSlow
         at /usr/local/go/src/sync/mutex.go:138
     5  0x0000000000469667 in sync.(*Mutex).Lock
         at /usr/local/go/src/sync/mutex.go:81
     6  0x0000000000469667 in sync.(*RWMutex).Lock
         at /usr/local/go/src/sync/rwmutex.go:98
     7  0x0000000000702199 in github.com/src-d/identity-matching/external.(*safeUserCache).LoadFromDisk
         at /go/src/external/cache.go:162
     8  0x00000000007028f4 in github.com/src-d/identity-matching/external.safeUserCache.DumpOnDisk
         at /go/src/external/cache.go:201
     9  0x0000000000701b54 in github.com/src-d/identity-matching/external.CachedMatcher.DumpCache
         at /go/src/external/cache.go:77
    10  0x0000000000701b54 in github.com/src-d/identity-matching/external.(*CachedMatcher).MatchByCommit
         at /go/src/external/cache.go:124
    (truncated)
  Goroutine 2 - User: /usr/local/go/src/runtime/proc.go:305 runtime.gopark (0x4309e0)
    0  0x00000000004309e0 in runtime.gopark
        at /usr/local/go/src/runtime/proc.go:305
    1  0x0000000000430897 in runtime.goparkunlock
        at /usr/local/go/src/runtime/proc.go:310
    2  0x0000000000430897 in runtime.forcegchelper
        at /usr/local/go/src/runtime/proc.go:253
    3  0x000000000045b931 in runtime.goexit
        at /usr/local/go/src/runtime/asm_amd64.s:1357
  Goroutine 3 - User: /usr/local/go/src/runtime/proc.go:305 runtime.gopark (0x4309e0)
    0  0x00000000004309e0 in runtime.gopark
        at /usr/local/go/src/runtime/proc.go:305
    1  0x0000000000419893 in runtime.goparkunlock
        at /usr/local/go/src/runtime/proc.go:310
    2  0x0000000000419893 in runtime.runfinq
        at /usr/local/go/src/runtime/mfinal.go:175
    3  0x000000000045b931 in runtime.goexit
        at /usr/local/go/src/runtime/asm_amd64.s:1357
  Goroutine 4 - User: /usr/local/go/src/runtime/sigqueue.go:147 os/signal.signal_recv (0x44422c)
    0  0x000000000045d863 in runtime.futex
        at /usr/local/go/src/runtime/sys_linux_amd64.s:536
    1  0x000000000042c146 in runtime.futexsleep
        at /usr/local/go/src/runtime/os_linux.go:44
    2  0x000000000040c086 in runtime.notetsleep_internal
        at /usr/local/go/src/runtime/lock_futex.go:174
    3  0x000000000040c28c in runtime.notetsleepg
        at /usr/local/go/src/runtime/lock_futex.go:228
    4  0x000000000044422c in os/signal.signal_recv
        at /usr/local/go/src/runtime/sigqueue.go:147
    5  0x00000000004c5e82 in os/signal.loop
        at /usr/local/go/src/os/signal/signal_unix.go:23
    6  0x000000000045b931 in runtime.goexit
        at /usr/local/go/src/runtime/asm_amd64.s:1357
  Goroutine 5 - User: /usr/local/go/src/runtime/proc.go:305 runtime.gopark (0x4309e0)
    0  0x00000000004309e0 in runtime.gopark
        at /usr/local/go/src/runtime/proc.go:305
    1  0x000000000043f82b in runtime.selectgo
        at /usr/local/go/src/runtime/select.go:313
    2  0x0000000000458fb8 in runtime.ensureSigM.func1
        at /usr/local/go/src/runtime/signal_unix.go:549
    3  0x000000000045b931 in runtime.goexit
        at /usr/local/go/src/runtime/asm_amd64.s:1357
  Goroutine 6 - User: /usr/local/go/src/runtime/proc.go:305 runtime.gopark (0x4309e0)
    0  0x00000000004309e0 in runtime.gopark
        at /usr/local/go/src/runtime/proc.go:305
    1  0x000000000044c70b in runtime.goparkunlock
        at /usr/local/go/src/runtime/proc.go:310
    2  0x000000000044c70b in runtime.timerproc
        at /usr/local/go/src/runtime/time.go:303
    3  0x000000000045b931 in runtime.goexit
        at /usr/local/go/src/runtime/asm_amd64.s:1357
  Goroutine 18 - User: /usr/local/go/src/runtime/proc.go:305 runtime.gopark (0x4309e0)
    0  0x00000000004309e0 in runtime.gopark
        at /usr/local/go/src/runtime/proc.go:305
    1  0x00000000004237b1 in runtime.goparkunlock
        at /usr/local/go/src/runtime/proc.go:310
    2  0x00000000004237b1 in runtime.bgsweep
        at /usr/local/go/src/runtime/mgcsweep.go:89
    3  0x000000000045b931 in runtime.goexit
        at /usr/local/go/src/runtime/asm_amd64.s:1357
  Goroutine 19 - User: /usr/local/go/src/runtime/proc.go:305 runtime.gopark (0x4309e0)
    0  0x00000000004309e0 in runtime.gopark
        at /usr/local/go/src/runtime/proc.go:305
    1  0x0000000000423079 in runtime.goparkunlock
        at /usr/local/go/src/runtime/proc.go:310
    2  0x0000000000423079 in runtime.bgscavenge
        at /usr/local/go/src/runtime/mgcscavenge.go:332
    3  0x000000000045b931 in runtime.goexit
        at /usr/local/go/src/runtime/asm_amd64.s:1357
  Goroutine 20 - User: /go/src/cmd/match-identities/main.go:45 main.main.func1 (0x78e9d4)
    0  0x00000000004309e0 in runtime.gopark
        at /usr/local/go/src/runtime/proc.go:305
    1  0x0000000000407498 in runtime.goparkunlock
        at /usr/local/go/src/runtime/proc.go:310
    2  0x0000000000407498 in runtime.chanrecv
        at /usr/local/go/src/runtime/chan.go:524
    3  0x000000000040715b in runtime.chanrecv1
        at /usr/local/go/src/runtime/chan.go:406
    4  0x000000000078e9d4 in main.main.func1
        at /go/src/cmd/match-identities/main.go:45
    5  0x000000000045b931 in runtime.goexit
        at /usr/local/go/src/runtime/asm_amd64.s:1357
  Goroutine 21 - User: /usr/local/go/src/runtime/proc.go:305 runtime.gopark (0x4309e0)
    0  0x00000000004309e0 in runtime.gopark
        at /usr/local/go/src/runtime/proc.go:305
    1  0x000000000041d0ef in runtime.gcBgMarkWorker
        at /usr/local/go/src/runtime/mgc.go:1837
    2  0x000000000045b931 in runtime.goexit
        at /usr/local/go/src/runtime/asm_amd64.s:1357
  Goroutine 22 - User: /usr/local/go/src/runtime/proc.go:305 runtime.gopark (0x4309e0)
    0  0x00000000004309e0 in runtime.gopark
        at /usr/local/go/src/runtime/proc.go:305
    1  0x000000000041d0ef in runtime.gcBgMarkWorker
        at /usr/local/go/src/runtime/mgc.go:1837
    2  0x000000000045b931 in runtime.goexit
        at /usr/local/go/src/runtime/asm_amd64.s:1357
  Goroutine 23 - User: /usr/local/go/src/runtime/lock_futex.go:228 runtime.notetsleepg (0x40c274)
    0  0x000000000045d863 in runtime.futex
        at /usr/local/go/src/runtime/sys_linux_amd64.s:536
    1  0x000000000042c1c4 in runtime.futexsleep
        at /usr/local/go/src/runtime/os_linux.go:50
    2  0x000000000040c12e in runtime.notetsleep_internal
        at /usr/local/go/src/runtime/lock_futex.go:193
    3  0x000000000040c28c in runtime.notetsleepg
        at /usr/local/go/src/runtime/lock_futex.go:228
    4  0x000000000044c781 in runtime.timerproc
        at /usr/local/go/src/runtime/time.go:311
    5  0x000000000045b931 in runtime.goexit
        at /usr/local/go/src/runtime/asm_amd64.s:1357
  Goroutine 34 - User: /usr/local/go/src/runtime/proc.go:305 runtime.gopark (0x4309e0)
    0  0x00000000004309e0 in runtime.gopark
        at /usr/local/go/src/runtime/proc.go:305
    1  0x000000000041d0ef in runtime.gcBgMarkWorker
        at /usr/local/go/src/runtime/mgc.go:1837
    2  0x000000000045b931 in runtime.goexit
        at /usr/local/go/src/runtime/asm_amd64.s:1357
  Goroutine 35 - User: /usr/local/go/src/runtime/proc.go:305 runtime.gopark (0x4309e0)
    0  0x00000000004309e0 in runtime.gopark
        at /usr/local/go/src/runtime/proc.go:305
    1  0x000000000041d0ef in runtime.gcBgMarkWorker
        at /usr/local/go/src/runtime/mgc.go:1837
    2  0x000000000045b931 in runtime.goexit
        at /usr/local/go/src/runtime/asm_amd64.s:1357
  Goroutine 36 - User: /usr/local/go/src/runtime/proc.go:305 runtime.gopark (0x4309e0)
    0  0x00000000004309e0 in runtime.gopark
        at /usr/local/go/src/runtime/proc.go:305
    1  0x000000000044c70b in runtime.goparkunlock
        at /usr/local/go/src/runtime/proc.go:310
    2  0x000000000044c70b in runtime.timerproc
        at /usr/local/go/src/runtime/time.go:303
    3  0x000000000045b931 in runtime.goexit
        at /usr/local/go/src/runtime/asm_amd64.s:1357
  Goroutine 50 - User: /usr/local/go/src/runtime/lock_futex.go:228 runtime.notetsleepg (0x40c274)
    0  0x000000000045d863 in runtime.futex
        at /usr/local/go/src/runtime/sys_linux_amd64.s:536
    1  0x000000000042c1c4 in runtime.futexsleep
        at /usr/local/go/src/runtime/os_linux.go:50
    2  0x000000000040c12e in runtime.notetsleep_internal
        at /usr/local/go/src/runtime/lock_futex.go:193
    3  0x000000000040c28c in runtime.notetsleepg
        at /usr/local/go/src/runtime/lock_futex.go:228
    4  0x000000000044c781 in runtime.timerproc
        at /usr/local/go/src/runtime/time.go:311
    5  0x000000000045b931 in runtime.goexit
        at /usr/local/go/src/runtime/asm_amd64.s:1357
  Goroutine 51 - User: /usr/local/go/src/database/sql/sql.go:1052 database/sql.(*DB).connectionOpener (0x599bf8)
    0  0x00000000004309e0 in runtime.gopark
        at /usr/local/go/src/runtime/proc.go:305
    1  0x000000000043f82b in runtime.selectgo
        at /usr/local/go/src/runtime/select.go:313
    2  0x0000000000599bf8 in database/sql.(*DB).connectionOpener
        at /usr/local/go/src/database/sql/sql.go:1052
    3  0x000000000045b931 in runtime.goexit
        at /usr/local/go/src/runtime/asm_amd64.s:1357
  Goroutine 52 - User: /usr/local/go/src/database/sql/sql.go:1065 database/sql.(*DB).connectionResetter (0x599d2b)
    0  0x00000000004309e0 in runtime.gopark
        at /usr/local/go/src/runtime/proc.go:305
    1  0x000000000043f82b in runtime.selectgo
        at /usr/local/go/src/runtime/select.go:313
    2  0x0000000000599d2b in database/sql.(*DB).connectionResetter
        at /usr/local/go/src/database/sql/sql.go:1065
    3  0x000000000045b931 in runtime.goexit
        at /usr/local/go/src/runtime/asm_amd64.s:1357
[18 goroutines]
vmarkovtsev commented 5 years ago

Soy un programador terrible, no se como mutexes trabajan.

alexpdp7 commented 5 years ago

ни один программист не знает, как работают мьютексы

(Google Translate seemed to translate that well to Spanish, but I have no idea how the Russian translation will work. BTW, "trabajar" in Spain mostly has the "labor" meanings. You want "funcionar").

I'm a Go noob, but if you need help, ping me and I can take a second look.

vmarkovtsev commented 5 years ago

No worries, the fix is underway.

The Russian translation is actually perfect.

vmarkovtsev commented 5 years ago

As soon as DockerHub recovers I will merge the PR and make a new release.

vmarkovtsev commented 5 years ago

@alexpdp7 please try v3.1.1

alexpdp7 commented 5 years ago

updated https://github.com/src-d/sourced-demo/pull/144 , let's see what's Travis opinion...