You can use an addon--such as S'rendarr--but that's also available through the options menu without addons.

Settings > Combat > *scroll to the bottom*

Try the addon Action Duration Reminder. I quite like it, given it shows a countdown for each temporary effect, plus when the effect's timer expires, a message shows on the screen notifying you it's expired. Really useful in the heat of battle.