Makefile colorization doesn't work properly under some circumstances

[GoogleCodeExporter]

Colorization is made by processing the logs using SED and it doesn't pick
up all cases. Here's an easy example where the overfull hbox goes silently
through the makefile (it appears in the logs though!). In my opinion it is
very annoying since some are colorized and some are not, so one cannot
trust the Makefile.

\documentclass[11pt]{book}
\usepackage{amssymb}
\begin{document}
\begin{itemize}
\item $\sum$
\item
AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
\end{itemize}
\end{document}

Original issue reported on code.google.com by fdemes...@gmail.com on 13 Nov 2009 at 3:00

[GoogleCodeExporter]

Nice :).  I assume that this came up in a more <cough> legitimate use case?  I 
have 
honestly never had this complaint before now :)

Original comment by shiblon on 15 Nov 2009 at 4:02

[GoogleCodeExporter]

Aha.  I see the problem - the first Overfull hbox doesn't show up because 
there's no 
blank line before it.  Weird.  I'll look into it.

Original comment by shiblon on 15 Nov 2009 at 4:07

• Changed state: Accepted

[GoogleCodeExporter]

Check out r7ffb211d1d70 and let me know if that fixes it.

Original comment by shiblon on 15 Nov 2009 at 4:30

• Changed state: Fixed

[GoogleCodeExporter]

It does not surprise me that you didn't get this before because one naturally 
assumes
the makefile handles it by himself: why look for accounting bugs if you hired an
accountant? :) 

The thing is that I was looking at my thesis (totally legit use, I swear!) and 
I saw
an incredible overfull hbox abuse which I decided to investigate. I actually 
have a
lot of those in my thesis, including the twin bug with underfull boxes (so 
please
mirror the fix!). I'm sorry I tried to fix it but my usage of sed is way too 
novice
to understand your crazy coloring tricks.

Original comment by fdemes...@gmail.com on 15 Nov 2009 at 4:32

[GoogleCodeExporter]

The revision at r7ffb211d1d70 ought to fix this for all kinds of errors, 
overfull, 
underfull, etc.  If it doesn't, I'd love to see your log file output for the 
thesis that has the 
issues, and I can make it work (I think!).

Original comment by shiblon on 15 Nov 2009 at 4:37

[GoogleCodeExporter]

Well, actually it solves my minimal bug example, but none of the bugs in my 
thesis.

Let me give you an excerpt of my log right now, i'll be cooking another minimal
example in the meanwhile.
=========================================
File: figs/overview4.eps Graphic file (type eps)
<figs/overview4.eps> [4] [5]
Overfull \hbox (234.70412pt too wide) in paragraph at lines 655--699
 [][][]
 []

Original comment by fdemes...@gmail.com on 15 Nov 2009 at 4:43

[GoogleCodeExporter]

Ok, here's one that isn't processed properly, even by the latest revision 
(2.1.37).
By the way, you bumped the version number in the changelog but not in the actual
version number.

\documentclass[11pt]{book}
\begin{document}
\begin{itemize}
\item It's on the next page!
\end{itemize}
\newpage
\begin{itemize}
\item 
AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
\
AAAAAAAAAAAAAAAAAAAA
\end{itemize}
\end{document}

Original comment by fdemes...@gmail.com on 15 Nov 2009 at 5:01

[GoogleCodeExporter]

Quite right - I sat down and thought more carefully about what sed is doing 
(it's tricky!) 
and came up with what I believe is a much more robust solution.  Please try out 
r81d1e32c4ccf and let me know how it works for you.

Original comment by shiblon on 17 Nov 2009 at 6:06

[GoogleCodeExporter]

Ok, it's much better now since it seems to pick all the overfull and underfull 
hboxes
now BUT it adds a lot of uncolored garbage in front of the colorized output. 
You can
already see an extra bracket (not colorized) in my previous example, and I 
added some
stuff in front of my AAA...AAA below, just to produce more uncolorized stuff 
(extra
"] [2]") but it can get quite worse.

I just uploaded what happens when I make so you can see the extend of the 
problem:
http://tinyurl.com/colorblindlatex
It's uncolored sorry, but you have to imagine that it gets the right color 
every time
it sees an underfull or an overfull and keeps the color until the next blank 
line
appears.

=======================================================
\documentclass[11pt]{book}
\begin{document}
\begin{itemize}
\item It's on the next page!
\end{itemize}
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
bump a page! bump a page! bump a page! bump a page! bump a page! bump a page! 
bump a
page! bump a page! bump a page!
\begin{itemize}
\item 
AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
\
AAAAAAAAAAAAAAAAAAAA
\end{itemize}
\end{document}

Original comment by fdemes...@gmail.com on 17 Nov 2009 at 8:00

[GoogleCodeExporter]

Thanks for your patience.  Can you try rbf88fdf9a43b for me?

Original comment by shiblon on 17 Nov 2009 at 8:11

• Changed state: Started

[GoogleCodeExporter]

And... it works! :D

Great! Thanks for YOUR patience!

Original comment by fdemes...@gmail.com on 17 Nov 2009 at 11:09

[GoogleCodeExporter]

Excellent - I added your test case to my various test files, if that's all 
right.  I'm now 
uploading version 2.1.37 with the fix.

Thanks again for all your help.

Original comment by shiblon on 18 Nov 2009 at 1:02

• Changed state: Verified

[GoogleCodeExporter]

Issue 39 has been merged into this issue.

Original comment by shiblon on 19 Nov 2009 at 7:01