everything is loaded up in ram, maybe you lack of memory and your system is swapping.
Article lookup is not very efficient (many loops over all posts)
The problem is that some parts of the site (such as tag list, menus etc…) should be dynamic but they are not.
One optimization may be the use of jquery to load menus tags and so. This a roadmap for V2.
Why