【正文】 ? The published literature reveals that this analysis is now being performed by many different people – system, reference, collection development, technical services, and administrative librarians. ? 最近研究發(fā)表文獻指出這類的評估作業(yè)亦有許多不同的人員在進行，這包括系統(tǒng)、參考人員、資料發(fā)展分析、技術(shù)服務(wù)人員及圖書館管理人員。 ? Also, online systems typically generate hundreds of statistical reports about the system functions on a regular (usually monthly) basis. Often, information about system resources usage needs to be carefully analyzed and translated to a different format in order to be usable for library managers. System vendors have moved increasing to report generation modules that can be customized by libraries in order to avoid this pitfall. ? 線上系統(tǒng)可以產(chǎn)生上百份有關(guān)系統(tǒng)功能的統(tǒng)計報表 (周報表、月報表或季報表 )。 ? Limitations of Evaluation ? Although the reasons for performance evaluation are pelling, much of the work done in systems evaluation within libraries is the exception rather than the rule. This situation can be monly observed for a number of reasons. Sometimes system resource usage is neither the concern nor the domain of the library, but rather of the campus or city administrative puting center. In situations where the management of the puting facilities is separated from the management of the library, it is more difficult to establish a cohesive picture of the factors that affect the system’s performance, much less to correct these situations when performance problems arise. ? 雖然績效評估的原因是迫不得已，大多數(shù)圖書館的系統(tǒng)評估均非日常例行性工作。 ? 1:亦可以以線上群組聊天方式收集群組意見，進行網(wǎng)路虛擬社群相關(guān)主題研究。 ? The published literature includes several studies in which online questionnaires were applied to record user attitudes and preferences for system features. The advantage of online questionnaires is the ability to collect critical incident data about session immediately following the session. ? 應(yīng)用線上問卷可以記錄使用者對系統(tǒng)特性的態(tài)度及偏好研究，同時可以對使用者在搜尋的連線狀態(tài)下收集到重要事件的資料。 ? A number of studies have analyzed the results of video and/or audio taping of the speech and actions of users during search sessions. The technique has been used to examine whether the cognitive, affective, or attitudinal behavior of users affects their performance and the outes of searching. Methods likes protocol analysis, which employ a predetermined framework for analyzing user ments (asking a user to ―thinkaloud‖ while searching, then recording the resulting behavior and ments), can be used to classify and evaluate the relative effect of user decisionmaking and behavior on the success or failure of searching. ? 有些研究利用錄影帶或錄音帶的方式將使用者在搜尋的連線過程中所做的動作及關(guān)鍵字 (併字 )予以記錄並分析。然而這類技術(shù)並不完全有缺陷，重要的是所觀察事件現(xiàn)象的一致性程度如何，且觀察時段區(qū)間如何，而這些均是決定所收集到資訊的可靠性。 如果知道何種型態(tài)的 help mand是使用者最常發(fā)送的動作，則能清楚對新系統(tǒng)或新增功能找出其問題所在，而這些問題剛好是在系統(tǒng)設(shè)計時未曾被考量但卻需予以修正。 ? Another problem is that of cost. A prehensive monitoring module can add a significant overhead to the cost of operating the system. ? 另一個問題是成本考量，持續(xù)的觀察對系統(tǒng)的運作是不個明顯的負擔(dān)。 ? Many TLA studies gather information on how frequently system features are used: choice of search type, use of help screens, how many hits users are willing to review, how often a search results in zero hits, the number and type of error messages that users receive, and so on. ? 多數(shù) TLA研究在於收集系統(tǒng)特性、使用的頻率、搜尋型態(tài)的選擇、 help螢?zāi)灰约肮δ艿氖褂?、使用者重覆點選的hits數(shù)、使用者看到錯誤訊息的數(shù)量。 ? Data thus collected can be useful in revealing how specific system features are exploited and in identifying features that appear to be giving users significant problems. At least three types of approach are applicable: review of transaction logs, direct observation of users operating at terminals, and video and/or audio taping of user performance. ? 特定的系統(tǒng)特質(zhì)可以依據(jù)使用者所提供的重大問題予以發(fā)掘。非強制性觀察法是以使用者實際使用系統(tǒng)的過程收集資料，而使用者可能在不知情的情況下鍵入動作，均被記錄下來並以觀察。資料存取算是否會影響系統(tǒng)回應(yīng)時間，而確地規(guī)劃是相當困難，因為它包含大量效率相關(guān)因素的預(yù)測與其相