Core Files Have Eaten Entire Quota

[diertani]

So.... the core files are very large. VERY large. And... annotald has had six segmentation errors so far this morning. (I used the command only once, but apparently it works for the entire session.) So the six very large core files have eaten my entire quota and now I literally can't do anything except list things and change directories.

I assume that you probably only need one core file to examine, Aaron? But I don't want to presume that, and even if I were to presume, I don't know which of these files would actually be most helpful for you, so I wouldn't know which ones to delete. Could you choose one of the gigantic files so I can delete the rest?

[diertani]

Just for the novelty, this is what happens if your disk quota dies while you're trying to run annotald. The Message at the bottom left corner gives you "Save FAILED!!!: server got an exception" (which is an error message I had never seen before), and the detritus in the terminal reads:

127.0.0.1 - - [03/Sep/2014:09:06:44] "GET / HTTP/1.1" 200 379 "" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1985.143 Safari/537.36"
127.0.0.1 - - [03/Sep/2014:09:06:46] "GET /diertani HTTP/1.1" 200 1049721 "http://localhost:1234/" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1985.143 Safari/537.36"
127.0.0.1 - - [03/Sep/2014:09:06:48] "POST /doLogEvent HTTP/1.1" 200 - "http://localhost:1234/diertani" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1985.143 Safari/537.36"
self.thefile is: darwin-1835.psd
dm-4: write failed, user block limit reached.
something went wrong: [Errno 122] Disk quota exceeded
Traceback (most recent call last):
  File "/home/diertani/.local/lib/python2.7/site-packages/annotald/treedrawing.py", line 157, in doSave
    util.writeTreesToFile(self.versionCookie, tosave, self.thefile)
  File "/home/diertani/.local/lib/python2.7/site-packages/annotald/util.py", line 278, in writeTreesToFile
    f.write("\n\n".join(trees))
  File "/usr/local/lib/python2.7/codecs.py", line 691, in write
    return self.writer.write(data)
  File "/usr/local/lib/python2.7/codecs.py", line 352, in write
    self.stream.write(data)
IOError: [Errno 122] Disk quota exceeded
127.0.0.1 - - [03/Sep/2014:09:06:51] "POST /doSave HTTP/1.1" 200 58 "http://localhost:1234/diertani" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1985.143 Safari/537.36"
self.thefile is: darwin-1835.psd
something went wrong: [Errno 122] Disk quota exceeded
Traceback (most recent call last):
  File "/home/diertani/.local/lib/python2.7/site-packages/annotald/treedrawing.py", line 157, in doSave
    util.writeTreesToFile(self.versionCookie, tosave, self.thefile)
  File "/home/diertani/.local/lib/python2.7/site-packages/annotald/util.py", line 278, in writeTreesToFile
    f.write("\n\n".join(trees))
  File "/usr/local/lib/python2.7/codecs.py", line 691, in write
    return self.writer.write(data)
  File "/usr/local/lib/python2.7/codecs.py", line 352, in write
    self.stream.write(data)
IOError: [Errno 122] Disk quota exceeded
127.0.0.1 - - [03/Sep/2014:09:06:58] "POST /doSave HTTP/1.1" 200 58 "http://localhost:1234/diertani" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1985.143 Safari/537.36"
127.0.0.1 - - [03/Sep/2014:09:07:19] "POST /doLogEvent HTTP/1.1" 200 - "http://localhost:1234/diertani" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1985.143 Safari/537.36"
Exit message received
Reformatting trees
...and rewriting indices sequentially
Please be patient, this may take some time
[03/Sep/2014:09:09:00] HTTP
Request Headers:
  Content-Length: 0
  REFERER: http://localhost:1234/diertani
  HOST: localhost:1234
  ORIGIN: http://localhost:1234
  CONNECTION: keep-alive
  Remote-Addr: 127.0.0.1
  ACCEPT: */*
  USER-AGENT: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1985.143 Safari/537.36
  X-REQUESTED-WITH: XMLHttpRequest
  ACCEPT-LANGUAGE: en-US,en;q=0.8
  ACCEPT-ENCODING: gzip,deflate,sdch
[03/Sep/2014:09:09:00] HTTP Traceback (most recent call last):
  File "/home/diertani/.local/lib/python2.7/site-packages/cherrypy/_cprequest.py", line 670, in respond
    response.body = self.handler()
  File "/home/diertani/.local/lib/python2.7/site-packages/cherrypy/lib/encoding.py", line 217, in __call__
    self.body = self.oldhandler(*args, **kwargs)
  File "/home/diertani/.local/lib/python2.7/site-packages/cherrypy/_cpdispatch.py", line 61, in __call__
    return self.callable(*self.args, **self.kwargs)
  File "/home/diertani/.local/lib/python2.7/site-packages/annotald/treedrawing.py", line 256, in doExit
    True, self.pythonOptions['rewriteIndices'])
  File "/home/diertani/.local/lib/python2.7/site-packages/annotald/util.py", line 278, in writeTreesToFile
    f.write("\n\n".join(trees))
  File "/usr/local/lib/python2.7/codecs.py", line 691, in write
    return self.writer.write(data)
  File "/usr/local/lib/python2.7/codecs.py", line 352, in write
    self.stream.write(data)
IOError: [Errno 122] Disk quota exceeded

127.0.0.1 - - [03/Sep/2014:09:09:00] "POST /doExit HTTP/1.1" 500 1833 "http://localhost:1234/diertani" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1985.143 Safari/537.36"
127.0.0.1 - - [03/Sep/2014:09:09:06] "POST /doLogEvent HTTP/1.1" 200 - "http://localhost:1234/diertani" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1985.143 Safari/537.36"

Then it completely freezes, and you have to whack keys on the keyboard to get it to return the prompt.

[aecay]

You can just leave one or two core files. I'll look at them this afternoon, so soon you'll be able to delete them all. Logging out and then back in should stop them from being generated any more.

Sent from my Android device with K-9 Mail. Please excuse my brevity.

[diertani]

I deleted all but the smallest, but my quota is still exceeded. I tried logging out and back in just in case it needed a new session to reset, but that didn't work. What did I do wrong?

[aecay]

Hmm. The remaining core dump file is only 8.6 MB, which is not that large. You can remove the annotaldLog.shelve file, which is 81MB (and any others in other directories you have worked in). Leave annotaldLog.txt files alone please.

I also need you to run chmod go+r core.9855 so I can access the core dump file.

What is the output of the quota command? Babel has a new 300GB hard disk for storing the corpus on, so quite arguably your quota ought to be raised.

[diertani]

I ran the chmod.

It... won't let me run the quota command. It just stalls when I try. We just raised my quota less than a month ago, so there ought to have been space for the remaining core dump file -- and there was space for five of the six core dump files, apparently, so I don't think removing the shelve file is likely to help. Possibly I use the wrong remove command and the dead files are still there in a dim and gloomy afterlife? I've emailed manager@babel.

[aecay]

OK, well I've discovered why that core file was so short: it was truncated when you hit your quota. I'll need an untruncated one in order to debug. Since the error has been happening a lot, it should be easy to get one once the quota issue is sorted. You can delete core.9855 now.

It's very odd that you don't go back below your quota after deleting the core files. And it's odd that you can't run the quota command (a behavior that I can also replicate under my account). Something odd seems to be going on with babel. Hopefully we will get a reply from tech support soon.

[beatrice57]

ariel, are you still the .Zap version of rm?

On Sep 3, 2014, at 11:39 AM, diertani notifications@github.com wrote:

I ran the chmod.

It... won't let me run the quota command. It just stalls when I try. We just raised my quota less than a month ago, so there ought to have been space for the remaining core dump file -- and there was space for five of the six core dump files, apparently, so I don't think removing the shelve file is likely to help. Possibly I use the wrong remove command and the dead files are still there in a dim and gloomy afterlife? I've emailed manager@babel.

— Reply to this email directly or view it on GitHub.

[diertani]

I have commented out that line.