hi, I have worked on keras sequential model, I can add LSTM model in between input LSTM layer and Dense layer you have (just before output dense layer) or replace it with LSTM layer. I can also evaluate score and use it for saving states (why are you resetting states every time in nb_epoch loop?). If you are interested, let me know. Sourabh