"Non-web-based" is a little tricky given what we're talking about, but you may want to check out the Selenium plugin for Firefox:
http://seleniumhq.org/. It's an automated web-testing tool which can definitely do what you're looking for; we use it for the web-based portions of our products.