I had challenges in getting VirtualDub to work on my mediasignage player. At first, I was trying to use an HDMI cable. DON'T GO THERE! An audio signal is sent with the HDMI output and can cause the audio to not work properly.
Here is what I needed to do. Good luck!
Ok, so here is what I had to do.
1) I used the AverMedia USB capture device recommended by mediaSignage
2) I got a 6ft Value S-Video+Audio to 3 RCA Cbl cable from Cables to go at Amazon for the video and audio that hooks up to my AV equipment.
http://www.amazon.ca/gp/product/B0002JFNQU/ref=ord_cart_shr?ie=UTF8&m=A3DWYIK6Y9EEQB3) used a VGA cable to connect the player to the PC
4) I needed to cut down the screw stops on the video cable to give it more reach. I just used an exacto knife to do this. Otherwise, I was not able to get the cable to screw into the VGA adapter on the player.
5) Used the audio pc jack on the tv for the audio
6) virtualdub is NOT using the command line that the player is sending it. I had to change a setting so that it remembered the default display. In capture mode, I set my device settings to be overlay Video->Overlay and the filter to Video->Preview Acceleration->Progressive-Both Fields. I then needed to save these settings for my device. Device->Device Settings->Save current display mode as default. There may have been another option for the svideo. If I did not do this, the player would invoke VirtualDub just fine, but the picture quality was horrible. If you tried the command line out from the player, it would work just fine from a command prompt, but not inside the player. Thus, I needed to tweak the default device settings. I'd like to think this issue with the player will be fixed sometime, but until then, I hope this helps! It helped me!