TY - GEN
T1 - An efficient method for extracting web news content
AU - Sun, Jian
AU - Tang, Luyang
AU - Liao, Dan
AU - Chang, Victor
N1 - Publisher Copyright:
© 2017 IEEE.
PY - 2017/7/2
Y1 - 2017/7/2
N2 - Web news extraction is a very important step in the process of Web intelligent information processing. It is the basis of research and application of network public opinion monitoring, heterogeneous Web data source integration and information retrieval. Therefore, the research and design of Web news content information extraction method has important research and application value. Using the idea of web information extraction based on statistics and web structure, this paper improves an existing webpage text extraction algorithm named ERBDF and designs a web news text extraction algorithm based on statistics and DOM tree structure (EETD). Finally, two algorithms are tested and compared in the accuracy and speed of text extraction and the results show that EETD has a better overall performance.
AB - Web news extraction is a very important step in the process of Web intelligent information processing. It is the basis of research and application of network public opinion monitoring, heterogeneous Web data source integration and information retrieval. Therefore, the research and design of Web news content information extraction method has important research and application value. Using the idea of web information extraction based on statistics and web structure, this paper improves an existing webpage text extraction algorithm named ERBDF and designs a web news text extraction algorithm based on statistics and DOM tree structure (EETD). Finally, two algorithms are tested and compared in the accuracy and speed of text extraction and the results show that EETD has a better overall performance.
KW - DOM Tree Structure
KW - Information Extraction
KW - Statistical Methods
KW - Web News
UR - http://www.scopus.com/inward/record.url?scp=85047858446&partnerID=8YFLogxK
U2 - 10.1109/ICEngTechnol.2017.8308202
DO - 10.1109/ICEngTechnol.2017.8308202
M3 - Conference Proceeding
AN - SCOPUS:85047858446
T3 - Proceedings of 2017 International Conference on Engineering and Technology, ICET 2017
SP - 1
EP - 5
BT - Proceedings of 2017 International Conference on Engineering and Technology, ICET 2017
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2017 International Conference on Engineering and Technology, ICET 2017
Y2 - 21 August 2017 through 23 August 2017
ER -