webgatherdesignandimplementation-免費閱讀
【正文】 在“天網(wǎng)”系統(tǒng)對外提供服務期間，廣泛采納用戶的意見和建議，不斷地改進其服務質量，到目前為止訪問量已突破 800萬人次。 ? 身無彩鳳雙飛翼，心有靈犀一點通 WebGather: in Dec. 1, 2020 ? million scale ? Index million web pages ? More than 200,000 web pages everyday ? Ten day to update all data ? three PCs ? collect all the web pages in China ? keep pace with the rapid growth of Chinese web information WebGather: Design goals for a distributed webcrawling system for WebGather 238 X 40,000 = 9,520,000 WebGather : architecture Client log database User behavior Gather Database Indexer Retrieve Database Client Retriever
教學課件相關推薦
鄂ICP備17016276號-1