Zeus was the greatest of the Olympian gods (even Apollo dared not oppose him directly). Associated with light, the sky, and thunder, he was also responsible for maintaining order and justice in the world (though he was often side tracked, according to Homer, by his numerous affairs and constant battles with his wife Hera).
"Jove" is the poetic form of the Roman god, Jupiter, who later becomes associated with the Greek god, Zeus. Zeus, therefore, would be more historically accurate here and the translators use of the name "Jove" is not accurate.
He was said to preside on Mount Olympus.