This project has been expanded into a book! It covers many more topics in much greater detail. You can now pre-order Building a Debugger.
A mini x86 linux debugger for teaching purposes
See my Writing a linux debugger blog post series for a tutorial on how to write something like this.