Brendan Fraser didn't speak to Dwayne Johnson on 'Mummy' set