Our development team has 14 small applications deployed to Tomcat 5.5 currently (moving to 6.0 shortly). I say small because the number of users for each app is low. I'm wondering what performance metrics and indicators I should be looking at to decide when it is time to introduce an additional application server.
Aside from memory usage and CPU utilization, what should I look out for? How do I know when it's time to scale up or out?