"Saliency map" of perceptron?

I am using keras currently, and I want to see which inputs the model is looking at. It would be like a saliency map, but my model is a simple two-layered perceptron for classification, so the input and ouput vectors are one dimensional. There is any library to do it easily? I don't quite understand the full programming of saliency maps.