【正文】 for on the very morning after their own arrival at Lambton, these visitors came. They had been walking about the place with some of their new friends, and were just returned to the inn to dress themselves for dining with the same family, when the sound of a carriage drew them to a window, and they saw a gentleman and lady in a curricle, driving up the street. Elizabeth, immediately recognising the livery, guessed wha t it meant, and im parted no small degree of surprise to her relations by acquainting them with the honour which she expected. Her uncle and aunt were all amazement。 Sure, theyˇ re horses.〃 They talked, sitting their gaunt horses in the dark. Zurito said nothing. He had the only steady horse of the lot. He had tried him, wheeling him in the corrals, and he responded to the b it and the spurs. He had ta ken the bandage off his right eye and cut the strings where they had tied his ears tight shut at the base. He was a good, solid horse, solid on his legs. That was all he needed. He intended to ride him all through the corrida. He had already, since he had mounted, sitting in the halfdark in the big, quilted saddle, waiting for the paseo, piced through the whole corrida in his mind. The other picadors went on talking on both sides of him. He did not hear them. The tw o matadors stood together in front of their three peones, their capes furled over their left arms in the same fashion. Manuel was thinki ng about the three lads in back of him. They were all three Madrile?os, like Hernandez, boys about nieen. One of them, a gypsy, serious, aloof, and darkfaced, he liked the look of. He turned. 168。 Itˇ s a wonder Retana wouldnˇ t give us enough light to see the horses by,〃 one picador said. 168。特別是老師做大事的風(fēng)范和氣度，尤其 讓我欽佩。 致謝 當(dāng)這篇論文最終完成的時(shí)候，我要向給予過我熱情幫助和悉心指導(dǎo)的老師和師兄們致以真誠(chéng)的謝意。 本軟件只是對(duì)搜索引擎功能的基本實(shí)現(xiàn)，在技術(shù)方面還存在許多不足之處。 /**/ } } 五、系統(tǒng)測(cè)試 搜索測(cè)試以默認(rèn)開始網(wǎng)頁作為起始頁面，輸入搜索字符串： 百度 ，如下圖所示： 點(diǎn)擊搜索，開始執(zhí)行。 Thread search=new Thread(crawler)。 } // 主函數(shù) public static void main(String[] args) { if(!=3){ (Usage:java SearchCrawler startUrl maxUrl searchString)。///測(cè)試是否取出連接 // } (links)。 //(test message!)。amp。 // } // 增加已處理的 URL 到 crawledList (url)。 } } // Get URL at bottom of the list. String url = ().next()。 return errorList。 (Invalid Max URLs value.)。 } //執(zhí)行實(shí)際的搜索操作 public ArrayList String crawl(String startUrl, int maxUrls, String searchString,boolean limithost,boolean caseSensitive ) { (searchString=+searchString)。 String bb=(aa,aa+()+10)。 // (bb)。 i ()。 } //Pattern p = ([\\s]+)。 linkList=()。 if (index != 1) { return (0, index + 3) + (index + 7)。 // (line)。 } private String downloadPage(URL pageUrl) { try { // Open connection to URL for reading. BufferedReader reader = new BufferedReader(new InputStreamReader(()))。 i ()。 } catch (Exception e) { return true。//去掉注釋 } disallowPath = ()。 while ((line = ()) != null) { if ((Disallow:) == 0) {//是否包含 Disallow: String disallowPath =(Disallow:.length())。 try { URL robotsFileUrl =new URL( + host + /)。//獲取給出 RUL 的主機(jī) //(主機(jī) =+host)。 try { verifiedUrl = new URL(url)。 //輸出設(shè)定 } public ArrayList String getResult(){ return result。//是否在限制的主機(jī)內(nèi)搜索 //PrintWriter out 。//開始搜索的起點(diǎn) int maxUrl。 public class myspider implements Runnable{ private HashMap String,ArrayList String disallowListCache = new HashMap String,ArrayList String()。 import .*。 (4)公共網(wǎng)關(guān)接口CGI(Conlmon Gateway Interface)。 (2)HTML(HyperText Markup Language)語言。因而其實(shí)現(xiàn)時(shí)要考慮很多相關(guān)技術(shù)。雖然 robot 和spider 功能很強(qiáng)，但如果有一組 URL 地址沒有被組 ~bURL 所鏈接到，那 么 robot 和 spider 就找不到它們。但并不是所有的檢索服務(wù)器都采用 robot 只有那些自動(dòng)在網(wǎng)上漫游并形成自己的數(shù)據(jù)庫的那些才是。 (url)。 i++) { if (((i))) break。 } else { return (i, i2)。 i2 = (39。 int i2。 if ((i) != 39。 String lower_case = ()。 } /** 由 base標(biāo)記中分離 url. */ void extractBase(String b) { String b2 = extract(b, href)。 addURL( href)。 } else if ((frame)) { analyzeFrame(())。 } } } } public void analyze(String param) { StringTokenizer st = new StringTokenizer(param)。) { state = 0。 case 39。39。 //(循環(huán)讀取解析 )。 URL base = null。 import 。 import 。 import 。 搜索字符串的匹配 對(duì)于要搜索的字符串，必須在抓取的網(wǎng)頁中進(jìn)行匹配檢查，如果存在于該網(wǎng)頁中，則把地址添加到輸出隊(duì)列中。 (4)完成隊(duì)列 (LaunchURL)。當(dāng)一個(gè) URL 被處理過后，它將被移送到錯(cuò)誤隊(duì)列或者是完成隊(duì)列。在這個(gè)隊(duì)列中， URL 等待被移動(dòng) Spider 程序處理。通過構(gòu)造網(wǎng)頁標(biāo)記樹的方法可反映網(wǎng)頁的結(jié)構(gòu)特點(diǎn)， 下 圖是一個(gè)簡(jiǎn)單的動(dòng)態(tài)網(wǎng)頁標(biāo)記樹 h t m lh e a d b o d yt a b l et i t l el i n k 1 l i n k 2 網(wǎng)頁的處理隊(duì)列 頁面處理隊(duì)列中保存的是頁面的 URL，它實(shí)際上是由等待隊(duì)列、處理隊(duì)列、錯(cuò)誤隊(duì)列、完成隊(duì)列組成。網(wǎng)頁信息的載體是網(wǎng)頁文本，用超文本標(biāo)記語言編寫。 (/html)。i++){ te=(i+1)。 (body bgcolor=\c0c0c0\)。 (html)。 // ()。 PrintWriter out = ()。 ArrayList String myresult。 public class MyServlet extends HttpServlet { private static final String CONTENT_TYPE = text/html。 import .*。 四、系統(tǒng)詳細(xì)設(shè)計(jì) 搜索引擎界面設(shè)計(jì) 界面設(shè)計(jì)實(shí)現(xiàn) 設(shè)計(jì)界面如下： 設(shè)計(jì)代碼分析 html head title簡(jiǎn)易搜索引擎 /title meta equiv=ContentType content=text/html。 四是安全性， servlet 在服務(wù)器端運(yùn)行，因此，安全性由 web 服務(wù)器提供能保 障， servlet也能夠利用 java Security Manager 提供的安全性功能。 Servlet 的原理圖描述如下： 服 務(wù) 器瀏 覽 器s e r v l e t 使用 servlet 有幾個(gè)優(yōu)點(diǎn)： 一是有效性， servlet 的初始化代碼僅在 web 服務(wù)器第一次加載時(shí)候執(zhí)行一次，一旦加載了 servlet，在處理一個(gè)新的請(qǐng)求的時(shí)候，只須調(diào)用一個(gè)新的服務(wù)方法。 是可擴(kuò)展的。和一般的 Java 類不同之處只是在于 Servlet 可以處理 Http 請(qǐng)求。用于響應(yīng)客戶端的請(qǐng)求。由于 Jbuilder 是用純 Java語言編寫的，其代碼不含任 何專屬代碼和標(biāo)記，它支持最新的 Java 標(biāo)準(zhǔn)。 3） Jbuilder 支持各種應(yīng)用服務(wù)器。 JBuiId