From what I can summarize if we go by 2023 only.
- Fought Kaido rogue, without political backup. Won, turned the world upside down.
- The Navy is angry at Kallavan, while others view him as a legend.
- Escaped to another island where a tragic plot is unfolding
- Meanwhile, his marine crew gets locked down in Navy HQ
- Kallavan eventually returns to HQ and gets his tribunal. His crew is stationed worldwide while he's exiled to SWORD—either that or demoted.
- In SWORD he's hunting down Katakuri and the other remnants of big mom crew.
TLDR
The world keeps knocking him down despite his achievements and loyalty to the navy.