TY - GEN
T1 - A Deep Residual Shrinkage Neural Network-based Deep Reinforcement Learning Strategy in Financial Portfolio Management
AU - Sun, Ruoyu
AU - Jiang, Zhengyong
AU - Su, Jionglong
N1 - Publisher Copyright:
© 2021 IEEE.
PY - 2021/3/5
Y1 - 2021/3/5
N2 - Reinforcement Learning algorithms are widely applied in many fields, such as price index prediction, image recognition, and natural language processing. This paper introduces a novel algorithm based on the classical Deep Reinforcement Learning algorithm and Deep Residual Shrinkage Neural Network for portfolio management. In this algorithm, the Ensemble of Identical Independent Evaluators framework put forward by Jiang et al. is adopted in the policy function. Following this, we adopt the Deep Residual Shrinkage Neural Network to function as the identical independent evaluator to optimize the algorithm. We use the cryptocurrency market in this research to assess the efficacy of our strategy with eight traditional portfolio management strategies as well as Jiang et al.'s reinforcement learning strategy. In our experiments, the Accumulated Yield is used to reflect the profit of the algorithm. Despite having a high commission rate of 0.25% in back-Tests, results show that our algorithm can achieve 44.5%, 105.4%, and 148.8% returns in three different 50-days back-Tests, which is five times more than the profit of other non-reinforcement learning strategies and Jiang et al.'s strategy. Furthermore, the Sharpe ratio demonstrates that the extra reward per unit risk of the our strategy is still better than other traditional portfolio management strategies and Jiang et al.'s strategy by at least 50% in different time horizons.
AB - Reinforcement Learning algorithms are widely applied in many fields, such as price index prediction, image recognition, and natural language processing. This paper introduces a novel algorithm based on the classical Deep Reinforcement Learning algorithm and Deep Residual Shrinkage Neural Network for portfolio management. In this algorithm, the Ensemble of Identical Independent Evaluators framework put forward by Jiang et al. is adopted in the policy function. Following this, we adopt the Deep Residual Shrinkage Neural Network to function as the identical independent evaluator to optimize the algorithm. We use the cryptocurrency market in this research to assess the efficacy of our strategy with eight traditional portfolio management strategies as well as Jiang et al.'s reinforcement learning strategy. In our experiments, the Accumulated Yield is used to reflect the profit of the algorithm. Despite having a high commission rate of 0.25% in back-Tests, results show that our algorithm can achieve 44.5%, 105.4%, and 148.8% returns in three different 50-days back-Tests, which is five times more than the profit of other non-reinforcement learning strategies and Jiang et al.'s strategy. Furthermore, the Sharpe ratio demonstrates that the extra reward per unit risk of the our strategy is still better than other traditional portfolio management strategies and Jiang et al.'s strategy by at least 50% in different time horizons.
KW - algorithmic trading
KW - cryptocurrency
KW - deep reinforcement learning
KW - portfolio management
KW - residual network
KW - residual shrinkage network
UR - http://www.scopus.com/inward/record.url?scp=85105323141&partnerID=8YFLogxK
U2 - 10.1109/ICBDA51983.2021.9403210
DO - 10.1109/ICBDA51983.2021.9403210
M3 - Conference Proceeding
AN - SCOPUS:85105323141
T3 - 2021 IEEE 6th International Conference on Big Data Analytics, ICBDA 2021
SP - 76
EP - 86
BT - 2021 IEEE 6th International Conference on Big Data Analytics, ICBDA 2021
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 6th IEEE International Conference on Big Data Analytics, ICBDA 2021
Y2 - 5 March 2021 through 8 March 2021
ER -