If I understand your question you know the Russian translations of "shut up", but you are also alluding to the expression of incredulity that often comes with "shut up" in some contexts. You called it "a complement". So, you're trying to avoid this, and convey the main meaning of the expression, i.e. to make someone stop talking.
The good news is that Russian translations such as "заткнись" or "(за)молчи" do not have additional meanings. Заткнись is rather aggressive and/or rude, замолчи or молчи are less aggressive, but still are direct and demanding.
There are many other equivalents such us those in other answers, of course. All of them are of different level of rudeness and aggression, which is difficult to gauge for a beginner Russian speaker. That's why I would try not directly asking someone to shut up in Russian while still learning the basics.