The main reason is that most homicides are not the fancy middle class pre meditated murder type of crime as seen on TV but are often related to other criminal activities and with low evidence. This means that any witnesses are likely going to be within that world of not speaking to the police and any evidence in a gang killing for example, will be of low quality.
But it also matters what we mean by "solved" too.