How to Concatenate two ConvLSTM2D/LSTMs corresponding to two bands with return sequence True while data for the two bands are at different epochs?
Let me first try to explain the complicated scenario. In astronomy, we have data in multiple filters or bands at different time epochs. I am trying to classify time series of images using ConvLSTM2D, but my question applies to LSTM as well, if you replace the 2D image by 1D data and the convolution part in ConvLSTM2D by matmul (Dense) operations.