- use active learning to expand the training set, and
- revise your model training procedure to account for the sampling bias this introduces in the training set.
Does anyone else feel so ?
With what would you disagree?
Data is not fuel, let alone a fossil fuel. It doesn't provide energy and doesn't get used up.
Training a model with data reduces entropy in the model. Isn't a local increase in energy a decrease in entropy?
> ... and doesn't get used up.
With respect to the model, that data was useful before training and not useful after training. Its entropy lowering potential is decreased.