The Baldwin County Sheriff's Office removed a deputy from an FBI task force after learning he may have mishandled evidence from federal cases.