Not knowing your tolerance for recoil, I would break those calibers that you mentioned into two groups. The .357 to 45 Colt in the first group and the .454 and up in the second. The first group represents what I would consider reasonable recoil for most handgun shooters. But I would drop the .357 from this list as being a little on the light side for deer in most cases. The .41 magnum to 45 Colt being excellent choices for deer within their intended ranges. If you are not an experienced handgun shooter, I'd recommend that you stay away from the second group, at least for now. On the other hand, if you are one of the rare individuals who can handle those big bruisers, as the legendary handgun hunter, Elmer Keith, used to say, "There's no such thin as too big!" Good luck and great hunting.