James A Personal Mobile Universal Speech Interface for Electronic Devices
➤ Gửi thông báo lỗi ⚠️ Báo cáo tài liệu vi phạmNội dung chi tiết: James A Personal Mobile Universal Speech Interface for Electronic Devices
James A Personal Mobile Universal Speech Interface for Electronic Devices
James: A Personal Mobile Universal Speech Interface for Electronic DevicesThomas K Harris37560Master of Science proposal Carnegie Mellon University Sc James A Personal Mobile Universal Speech Interface for Electronic Deviceschool of Computer ScienceJAMES 2James: A Personal Mobile Universal speech Interface for Electronic DevicesAbstractI propose to implement and study a personal mobile universal speech interface for human-device interaction, which I call James. James communicates with devices through a defined communic James A Personal Mobile Universal Speech Interface for Electronic Devicesation protocol, which allows it to be separated from the devices that it controls. This separation allows a mobile user to carry James as their personJames A Personal Mobile Universal Speech Interface for Electronic Devices
al speech interface around with them, using James to interact universally with any device adapted to communicate in the language. My colleagues and I James: A Personal Mobile Universal Speech Interface for Electronic DevicesThomas K Harris37560Master of Science proposal Carnegie Mellon University Sc James A Personal Mobile Universal Speech Interface for Electronic Devicesrimitives. These primitives have been incorporated in a working prototype of James. I propose to measure the quality of the proposed interface. It is my belief that this investigation will demonstrate that a high quality and low cost human-device interface can be built that IS largely device agnosti James A Personal Mobile Universal Speech Interface for Electronic Devicesc. This would begin to validate our interaction primitives, and provide a base-line for future study in this area.IntroductionScope. In the context ofJames A Personal Mobile Universal Speech Interface for Electronic Devices
this thesis, an electronic device is defined in to be an entity with electronic control that serves a general purpose and a relatively coherent set oJames: A Personal Mobile Universal Speech Interface for Electronic DevicesThomas K Harris37560Master of Science proposal Carnegie Mellon University Sc James A Personal Mobile Universal Speech Interface for Electronic Devicesrmal household devices and consumer electronics such as cell phones, dishwashers, televisions, and lights; office equipment such as copy machines and fax machines; and industrial machines such as looms and cranes. This definition also includes devices that could be implemented purely in software suc James A Personal Mobile Universal Speech Interface for Electronic Devicesh as a chess game or a media player, as long as the mam interaction of the device is to receive commands and respond to simple state information requeJames A Personal Mobile Universal Speech Interface for Electronic Devices
sts. Because this proposal employs devices that are generally common, and also because the need for the device motivates its use. I make theJAMES 3assJames: A Personal Mobile Universal Speech Interface for Electronic DevicesThomas K Harris37560Master of Science proposal Carnegie Mellon University Sc James A Personal Mobile Universal Speech Interface for Electronic Devicesed Work. I have drawn upon the interaction language from the Universal Speech Interface (USI) project [1], and, with Roni Rosenfeld, have augmented the language from its original purpose of information access to that of electronic device control. Because James uses interaction primitives that are on James A Personal Mobile Universal Speech Interface for Electronic Devicesly slightly different from the interaction primitives of existing USI applications, it can be described as an augmented Universal speech Interface. JaJames A Personal Mobile Universal Speech Interface for Electronic Devices
mes inherits its device specification and device communication protocols from the Personal Universal Controller (PUC) project [2]. James is. in all reJames: A Personal Mobile Universal Speech Interface for Electronic DevicesThomas K Harris37560Master of Science proposal Carnegie Mellon University Sc James A Personal Mobile Universal Speech Interface for Electronic Devicesmented. These devices were demonstrated at the August, 2002, Pittsburgh Digital Greenhouse (PDG) [3] Technical Advisory Board Meeting, at the 4th International Conference on Multimodal Interfaces (ICMI) [4]. and the IS1"1 Annual Symposium on User Interface Software and Technology (UIST) [5], Two pap James A Personal Mobile Universal Speech Interface for Electronic Devicesers have been published that describing the work [2][6].Related Work. Three systems have directly influenced the design of James [1][2] [7], and severJames A Personal Mobile Universal Speech Interface for Electronic Devices
al other systems elucidate alternative yet similar solutions for humandevice speech interfaces [8][9][10].Janies is continuing work of the Universal SJames: A Personal Mobile Universal Speech Interface for Electronic DevicesThomas K Harris37560Master of Science proposal Carnegie Mellon University Sc James A Personal Mobile Universal Speech Interface for Electronic Devicesempt to address the problems of the other two speech interface paradigms: Natural Language Interfaces (NLI), and Interactive Voice Response (IVR). The IVR systems offered menu-tree navigation, allowing for rapid development of robust systems, at the cost of flexibility and efficiency, while the NLI James A Personal Mobile Universal Speech Interface for Electronic Devicessystems offered flexible and efficient systems at the severe cost of effort and reliability. It was surmised that an artificial language might be deveJames A Personal Mobile Universal Speech Interface for Electronic Devices
loped that would be both flexible and efficient, while also allowing applications to be robust and easily developed. Since the language would be develJames: A Personal Mobile Universal Speech Interface for Electronic DevicesThomas K Harris37560Master of Science proposal Carnegie Mellon University Sc James A Personal Mobile Universal Speech Interface for Electronic Deviceses particular to speech, such as error correction and list navigation, and that once these were learned by a user, they could be applied universally to all USI applications. These ideas resulted in a position paper and manifesto [11][12]. and later to some working information access applications [1] James A Personal Mobile Universal Speech Interface for Electronic Devices.In an effort to make the production of USI applications easier, the USI project embarked on a study to determine if a toolkit could be built to helpJames A Personal Mobile Universal Speech Interface for Electronic Devices
generate USI-compliant information-access speech interfaces. Remarkably, it was found was that not only could such a toolkit be built, but assuming onJames: A Personal Mobile Universal Speech Interface for Electronic DevicesThomas K Harris37560Master of Science proposal Carnegie Mellon University Sc James A Personal Mobile Universal Speech Interface for Electronic Devicesrom which one could enter the declarative parameters, and USI information access applications were built automatically from the information entered into the web page [7]. This result inspired the notion that declarative, automatic speech interfaces were also possible in the electronic device control James A Personal Mobile Universal Speech Interface for Electronic Devices domain.James is a Personal Universal Controller [2). The PUC project had engineered a system in which a declarative description of an electronic deviJames A Personal Mobile Universal Speech Interface for Electronic Devices
ce, and an established communication protocol came together to enable them to automatically generate and use graphical user interfaces on handheld comJames: A Personal Mobile Universal Speech Interface for Electronic DevicesThomas K Harris37560Master of Science proposal Carnegie Mellon University Sc James A Personal Mobile Universal Speech Interface for Electronic Devicesnt, in the same manner as their handheld computers. It would download device specifications from the adapted devices and create a user interface, except in this case the interface would be a spoken interface.The XWeb project [8] addresses many of the same issues as the PUC project, and also includes James A Personal Mobile Universal Speech Interface for Electronic Devices a speech-based client. The XWeb project subscribes to the speech interaction paradigm of the USI manifesto (12), and as such uses an artificial subseJames A Personal Mobile Universal Speech Interface for Electronic Devices
t language for device control. Much like Janies, the interaction offers tree traversal, list management, orientation, and help. They report that usersJames: A Personal Mobile Universal Speech Interface for Electronic DevicesThomas K Harris37560Master of Science proposal Carnegie Mellon University Sc James A Personal Mobile Universal Speech Interface for Electronic Devicesthe underlying tree structure in order to use the devices. Whereas the XWeb speech client uses explicit commands for moving focus,JAMES 5and only offers child, parent, and sibling motion around the interaction tree. James allows users to change focus to any node from and other node, and uses a sophi James A Personal Mobile Universal Speech Interface for Electronic Devicessticated disambiguation strategy to accommodate this. Details on the disambiguation strategies are provided in Appendix B.Researchers at Hewlett PackaJames A Personal Mobile Universal Speech Interface for Electronic Devices
rd [9] have applied some aspects of the USI paradigm to the acoustic domain, designing a system whereby the most acoustically distinguishable words arJames: A Personal Mobile Universal Speech Interface for Electronic DevicesThomas K Harris37560Master of Science proposal Carnegie Mellon University Sc James A Personal Mobile Universal Speech Interface for Electronic Devicest learn exact and unrelated words to control devices. They concede that this approach required a great deal of linguistic accommodations from the user, and may only appeal to technophiles. I also believe that, with this approach, there is little to be gained. I have demonstrated in some previous stu James A Personal Mobile Universal Speech Interface for Electronic Devicesdies that language models for USI applications can be built with word perplexities less than 3 bits per word, which can make for very robust speech reJames A Personal Mobile Universal Speech Interface for Electronic Devices
cognition with modern ASR systems.Sidner [10] has tested the learnability and usability of an artificial subset language for controlling a digital vidJames: A Personal Mobile Universal Speech Interface for Electronic DevicesThomas K Harris37560Master of Science proposal Carnegie Mellon University Sc James A Personal Mobile Universal Speech Interface for Electronic Devicesh groups back to test for retention of the command language. She found that although there were limits to what the users could remember, they were almost all able to perform the assigned tasks successfully. Sidner's system was much simpler than James, and would not allow a person to generalize their James A Personal Mobile Universal Speech Interface for Electronic Devices interaction to a new device. Regardless, this is an encouraging study for James, and for other USI-like interfaces.Method & DesignArchitecture. The SJames A Personal Mobile Universal Speech Interface for Electronic Devices
ystem Architecture is rendered in Figure 1. The Controller manages all of James' subunits, starts them, shuts them down when necessary, directs theirGọi ngay
Chat zalo
Facebook