Removing a previously granted permission

Once a user has granted permission to a permission category, there doesn’t seem to be any way to deny it later apart from going into your phones settings and manually turning off the permission there. Is there any way to do this instead through the app?