"I did all of it for you," Cas may have said, and maybe so, but there is also a part of it that is equating Dean with a second chance, with what he couldn't be for Anael, with his own guilt.
YES. SO MUCH YES.

And also it's only through interaction with Dean, I think, that Cas learns to feel guilty about not having been more for Anael.