I have been looking for the difference too. So far, I have found that the windows live gallery will let you sync photos between two pc's (if you sign into live gallery on two computers), and there seem to be several publishing (to online albums) and make (like making videos, blog posts, etc) that don't appear in the non-live gallery.
Hope that helps,
sciman
Hope that helps,
sciman