Optimization of Distributed Crawler under HadoopXiaochen Zhang and Ming XianMATEC Web of Conferences, 22 (2015) 02029DOI: https://doi.org/10.1051/matecconf/20152202029