The FBI does operate overseas: https://www.fbi.gov/about/leadership-and-structure/internati...

Here's an article on using the FBI as more or less another branch of special forces: https://www.washingtonpost.com/world/national-security/insid...

I seem to remember Brandon Webb's book "the red circle" where he relates FBI agents were attached to seal teams to do forensics in theater after operations.