What that means, who knows? But possible that he has certain obligations while serving in his role that go beyond the basic charges. E.g., duty to uphold appropriate appearance of the Crown, which is called into question by associating on sex island.
Could also be entirely performative.