I would say "Just on Thursdays".
"Once a week" is superfluous since Thursdays only happen once a week. If I wanted to insert "once a week", I would say "Just once a week - Thursdays", skipping the prepositions entirely. However, all of your suggestions and also the comments are good alternatives.