Relative Content

Tag Archive for deep-learningpytorchrecurrent-neural-networktransformer-modelencoder

Regression Head for bi-GRU + Transformer Encoder for time series regre

I’m working on a deep learning model that involves a bidirectional GRU (bi-GRU) followed by an Encoder Transformer. My input time series has the shape (batch_size, seq_len, num_features), where num_features is 3. The bi-GRU processes this input, and its output is fed into the Encoder Transformer.