전력 사용량 예측을 위한 새로운 트랜스포머 기반 모델 (A Novel Transformer-Based Model for Power Consumption Prediction)

서지정보

· 발행기관 : 대한전기학회
· 수록지 정보 : 전기학회논문지 / 73권 / 12호 / 2333 ~ 2340페이지
· 저자명 : 김광현, 오하령, 성영락

초록

Recently, Transformer has demonstrated excellent performance by effectively addressing the long-term dependency issues of traditional time series prediction models. However, Transformer also has limitations, such as a lack of ability to learn the sequential characteristics of time series data and the need for significant computational resources due to their complex structure. This paper proposes an EMformer model based on the Transformer architecture to overcome these limitations and improve prediction accuracy.
EMformer reduces computational costs by replacing the decoder with an MLP and enhances sequential feature extraction by replacing the feed-forward neural network in the encoder with depthwise separable convolution. The model's performance is evaluated using power consumption dataset and compared with other time series prediction models. The results show that EMformer improve performance by up to 57.3% in MAPE and 30.75% in RMSE compared to other models.

영어초록

Recently, Transformer has demonstrated excellent performance by effectively addressing the long-term dependency issues of traditional time series prediction models. However, Transformer also has limitations, such as a lack of ability to learn the sequential characteristics of time series data and the need for significant computational resources due to their complex structure. This paper proposes an EMformer model based on the Transformer architecture to overcome these limitations and improve prediction accuracy.
EMformer reduces computational costs by replacing the decoder with an MLP and enhances sequential feature extraction by replacing the feed-forward neural network in the encoder with depthwise separable convolution. The model's performance is evaluated using power consumption dataset and compared with other time series prediction models. The results show that EMformer improve performance by up to 57.3% in MAPE and 30.75% in RMSE compared to other models.

참고자료

· 없음