Skyrim isn't easy if you play it on Legendary from the start. You'll need to consider how you attack and it'll take longer to kill opponents therefore making it harder. I played it on Legendary and while I was doing the Dragonstone quest, I got 2 hit by a Restless Draugr.

Edit: I just realized that conversation was more than 10 days ago.