I think, in many peoples minds, rye beer = rye bread flavor. Caraway is likely the missing link to make rye beer taste like rye bread. Now, how much caraway to use? I don’t know. I’d start low, unless you absolutely love the stuff. Spices can easily dominate a beer in an unpleasant way.