MongoDB (if that's what you are using?) has a few more dependancies however it actually uses Any::Moose and so could you Mouse instead of Moose: http://deps.cpantesters.org/?module=MongoDB&perl=5.16.0&...
Were you using cpanminus to install your modules? Because its much faster than default cpan command.
I just tested using cpanminus (cpanm) on a vanilla perl install and installing Moose & MongoDB modules took 4 minutes here.
Here's a summary:
Install perl-5.16.0 via perlbrew - under 15 mins
Install cpanminus - 5 secs
cpanm Moose - 2 mins 5 secs (installed 22 distros)
cpanm MongoDB - 1 min 52 secs (installed another 20 distros)