Follows the video core PR. fmt doesn't require casts for enum classes anymore, so we can remove quite a few casts.