I also have a very reliable........................thermostat in my house set to 26. lol
Surely the water in the tank will be the same temp as the air around it
I don't think that's true actually, although, it perhaps depends on circumstances to be fair.
Presumably you have a heater in your tank? If you had a decent thermometer I'd suggest you could switch it off the heater and monitor the temp carefully, but with a strip, you can't monitor it carefully really I think.
It's been rather a long time since I did all this stuff, but, I think the tank would only necessarily have the same temperature of the air around it if there was no evaporation (which there will be), poor insulation (not sure of the glass qualifies, it's certainly not good insulation) and the specific heat capacity of water was the said as air (but it isn't, it's about 4 times greater).
Thus this means (I think) your tank, without a heater, would cool relative to the room temperature as it evaporates, and the heat transfere from air to water to make up for this would be very slow because a given volume of air has much less heat energy than a given volume of water of the same temperature, thus to raise a cupic cm of water by 1 degree, a cubic cm of air would have to cool by 4 degrees.
Anyone with better and/or more recent science knowledge is welcome to confirm or dispute me ;-)