Will there be a problem if I connect the VOIP adapter to my cable modem instead of my wireless router?

I have a wireless router, and also a cable modem. Is it okay to connect the VOIP adapter to the cable modem and have an Ethernet cable go to the wireless router (which is connected to the computer)? I really don’t want to connect the VOIP adapter to my wireless router…will that create any problems or decrease service quality? Please briefly explain why. Thank you!

Related posts:

1. How can i bridge my wireless connection at my hotel on my laptop to a VOIP adapter via ethernet cable?
2. Have a comcast cable modem and want to have VOIP?
3. What is the best hardware combination (router, modem, voip adapter)?
4. How do I set up a wireless router with voip?
5. How do I use my Tivo with voip (wireless) without installing a router?