to muse - to be absorbed in thought, to be deep in thought
to amuse - someone - to entertain them, usually with something funny
.
Chalk and cheese really.
Rather like asking what's the difference between "up" & "a carrot" :)
Enjoy.
PS "A muse" (noun) is someone musical, traditionally an assistant to aid creativity, usually in music, but could be other areas.