> Am I the only person here who finds it completely insane?
Your are sane, the situation is batshit.
Your priority is to get your data into one place, and one format. But that will take time and money, so you need to make a business case for change.
Your first point you need to hammer home is that its expensive to explore your data, because it's all over the place.
Second you need to come up with a rough number of hours that are wasted a month by each member of staff (and consultant) The fact that you have consultants means that your company is burning money, finding allies in your managers is a good shout. They will be constantly asked to justify the cost.
Third, and bonus points for this, come up with a use case for a current project that can't be done until the data is in the same place, format and is sane and normalised.
Don't worry about pipelines, thats a technical issue, what you are facing is a cultural problem.
Your are sane, the situation is batshit.
Your priority is to get your data into one place, and one format. But that will take time and money, so you need to make a business case for change.
Your first point you need to hammer home is that its expensive to explore your data, because it's all over the place.
Second you need to come up with a rough number of hours that are wasted a month by each member of staff (and consultant) The fact that you have consultants means that your company is burning money, finding allies in your managers is a good shout. They will be constantly asked to justify the cost.
Third, and bonus points for this, come up with a use case for a current project that can't be done until the data is in the same place, format and is sane and normalised.
Don't worry about pipelines, thats a technical issue, what you are facing is a cultural problem.