Yes. Make sure this output is set to AUTO, or in this case OFF, since you have no alarms configured here yet.
The other place that the Apex keeps alarm settings is on the Inputs page.
Each input (temp, salinity, power, etc.) has its own page showing alarm settings, which you can adjust or turn off.
It can be a bit confusing, that the Apex has two different methods for enabling alarms.