NMEA GPS + AIS, cant use both

I have ran across an interesting issue, basically my AIS receiver has a gps built into it, when I set serial4 to AIS it works, when I set the serial to GPS and set gps2 to NMEA, the GPS works as GPS2,

The problem is that it cant do both from the same port, it either works as gps or it works as AIS.

any way around this other than connecting it to 2 serial ports?