I’m trying to extract past key, value pair using attention_layers and hidden_state for a particular layer

I manipulated the hidden state values obtained from the llama-2 model after feeding it a certain input, let’s call it Input_1. Now, I want to examine the output (causal output) it produces from this. My hypothesis is that it should correspond to a different input, let’s call it Input_2, which would yield a distinct output from the initial input.