Active Learning: Query datapoints from output space

I am trying to apply active learning to a model to improve its performance. however the oracle, cannot label the samples based on the input space's features, instead, it uses the output sample(label) to do the experiment and get the data point. I am wondering if it would be possible to make the query strategy ask for points by the label and query its corresponding input values?