Hi, So I visited the irc channel and talked with arty and others.
arty's "munger.zip" is a good start, and is what I was looking for. It's currently a unixen set of python scripts that use libvncclient. It can be made to recognise on screen things by searching for exact matches (no jpeg distortion). arty tells me that he's using qemu -vnc and thus I believe doesn't need to run any testing software on the test machine. Of course I believe it'll work across the network too which is useful for when one needs to work with real hardware (although I haven't checked yet).
Someone pointed me again at CodeWeaver's cxtest automated testing suite. It's nice, but it requires that some software run on the test machine. It's tests are targeted towards XWindows (X11), but I'm told it might be able to be used on a Windows test machine as it's software uses wine to run.
Drew Daniels Resume: http://www.boxheap.net/ddaniels/resume.html