Oil on the suface could cause th pH to drop if left for a long time as too much can inpair gas exchanges which will cause a build of of co2 and lower oxygen levels, co2 acidifies water over time if the KH of the water is low. To remove oil from the waters surface float a sheet of kitchen towel on the water to soak it up.