Perturbation-to-Readout Prediction With Directional Logic