Do I have to turn my water fountain off at night or when I am away?

Water fountain pumps are meant to run 24/7.  It is harder on the pump if it is turned on and off continuously.  You should not need to turn your fountain off as long as there is enough water in the fountain for the allotted time.