Soldiers on horseback annoyed when liberal advanced Christian symbol (12)

I haven't cracked this one yet — but the brilliant team at Fifteensquared have:

CAVA L RY (soldiers on horseback) with the letter L (Liberal) advanced in the word to form CA L VARY ) + CROSS (annoyed)