Even by the standards of 2000 years ago, Caesar was at best controversial (in the view of many Romans at the time, he essentially destroyed the country) and most of the emperors were widely loathed (note that it was a position with an extremely low life expectancy; they tended to be assassinated).
