A firewall blocks in and outbound ports. Windows Advanced Firewall already does this.
If you want more fine-grained control, look to your router. I use a Netgate pfSense rackmount appliance. You can do the same with an OpenSense or pfSense router running on a toaster.
Be glad to help if you have questions!