Is it illegal to have a gf while married?

Many countries and US states do consider adultery (any sex outside your marriage) illegal. But not all. If you are in the military, you may have additional restrictions and punishments. It is illegal to marry your girlfriend while you are still married to your wife (this is polygamy, or plural marriage).