The Hutts weren't a threat because they did their own thing. The Empire left them alone because the Hutts had no reason to do anything--in fact, the regime probably helped their business.