 |
Description  |
|
|
FIELD OF THE INVENTION
The present invention pertains to the field of browser software for browsing the World Wide Web. More particularly, the present invention relates to audio functions in a Web browser.
BACKGROUND OF THE INVENTION
The number of homes and businesses using personal computers has increased substantially in recent years, and along with this increase has come an explosion in the use of the Internet, and particularly the World-Wide Web ("the Web"). The Web is a
collection of formatted hypertext pages located on numerous computers around the world that are logically connected by the Internet. Although "the Web" has in the past been a source of primarily scientific and technical information, it is now a valuable
resource for information relating to almost any subject, including business, entertainment, travel, and education, to name just a few. Advances in network technology, and especially in software such as "Web browsers" (software applications which provide
a user interface to the Web), have made the Web accessible to a large segment of the population. However, despite the growth in the development and use of the Web, many people are still unable to take advantage of this important resource.
Access to the Web has been limited to people who have access to a personal computer. Yet some people cannot afford the cost of even a relatively inexpensive personal computer, while others are unable or unwilling to learn the basic computer
skills that are required to access the Web. Furthermore, Web browsers in the prior art generally do not provide the degree of user-friendliness desired by some people who lack computer experience, and many computer novices do not have the patience to
learn how to use the software. Some people, for example, dislike an interface which requires them to identify hypertext objects and use the point-and-click technique to browse through Web pages.
Most people, however, feel quite comfortable using a remote control to operate a television set. Therefore, it would be desirable to allow a person to access the World-Wide Web without the use of a personal computer. In particular, it would be
desirable for a person to be able to access and navigate through Web pages using an ordinary television set and a remote control. It would further be desirable to have a user interface by which a person can use a remote control to navigate between
hypertext objects on a Web page with minimal effort or thought, so that a person feels more as if he or she is simply changing television channels rather than utilizing a complex computer network.
Another problem associated with Web browsers is that they tend to provide minimal audio functionality. Audio files linked to Web pages are becoming increasingly more common. Although some Web browsers may provide capability to download and play
audio files, they generally do not provide capability to manipulate audio data to any significant extent. In addition, Web browser user interfaces generally are not set up to facilitate audio functionality.
SUMMARY OF THE INVETION
A method is provided of processing audio information in a client processing system that is capable of being coupled to a server processing system over a network and is capable of being coupled to an audio output device. In the method, a first
audio sequence is output via the audio output device based on a first audio file stored in the client processing system. A second audio file, which represents a second audio sequence that is to be output following output of the first audio sequence, is
downloaded into the client processing system from the network while the first audio sequence is being output. The second audio file is transmitted from the server processing system to the client processing system over the network.
Another aspect of the present invention is a method of providing a user interface for controlling audio functions of a client processing system. The client processing system is coupled to a server processing system over a network and to a
display device. In the method, audio information is downloaded from the network, and an audio control panel is displayed on the display device. The audio control panel includes a number of images, each of which is for activating one of a number of
audio functions for manipulating the downloaded audio information.
Other features of the present invention will be apparent from the accompanying drawings and from the detailed description which follows.
BRIEF DESCRIPTION OF THE DRAWINGS
The present invention is illustrated by way of example and not limitation in the figures of the accompanying drawings, in which like references indicate similar elements and in which:
FIG. 1A illustrates several WebTV client systems connected to a WebTV server system.
FIG. 1B illustrates a WebTV client system.
FIG. 1C is a block diagram of an electronics unit of a WebTV client system.
FIG. 2A illustrates the functional relationship between hardware and software in the client processing system of FIG. 1.
FIG. 2B is a block diagram of the Web browser application software of FIG. 2B.
FIG. 3 illustrates a remote control for controlling the Web browser.
FIGS. 4A and 4B illustrate a displayed Web page containing a number of hypertext anchors.
FIG. 5 is a flow diagram illustrating a procedure for receiving and processing of an HTML document according to the present invention.
FIG. 6 illustrates several hypertext anchors as displayed on a display device.
FIGS. 7A and 7B are flow diagrams illustrating the procedure of movement of a selection between two hypertext anchors in the downward direction using the remote control of FIG. 3.
FIGS. 7C and 7D are flow diagrams illustrating the procedure of movement of a selection between two hypertext anchors in the upward direction using the remote control of FIG. 3.
FIG. 8A illustrates an Options panel overlaid on a displayed Web page.
FIG. 8B illustrates an Options panel with an Audio panel overlaid on a displayed Web page.
FIG. 9 is a flow diagram illustrating a routine for displaying an Options panel.
FIG. 10 is a flow diagram illustrating a routine for enabling or disabling display of an Audio panel.
FIGS. 11A and 11B are flow diagrams illustrating routines for downloading and playing background music in a client system.
DETAILED DESCRIPTION
A method and apparatus for providing a user interface to control audio functions in a Web browser are described. In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough
understanding of the present invention. It will be evident, however, to one skilled in the art that the present invention may be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram
form in order to facilitate description.
In one embodiment, steps according to the present invention are embodied in machine-executable software instructions, and the present invention is carried out in a processing system by a processor executing the instructions, as will be described
in greater detail below. In other embodiments, hardwired circuitry may be used in place of, or in combination with, software instructions to implement the present invention.
The present invention relates to a system in which a set-top box is connected to a television and to one or more servers over the Internet. The set-top box includes a processing system that executes browser software to enable a user to browse
through World-Wide Web pages displayed on the television using a remote control device. As will be described below, the browser provides a user interface that includes an audio panel for controlling audio functions related to audio files downloaded from
the Web. In addition, the Web browser provides a continuous stream of background music to the user during Web browsing by downloading audio files from a server while other audio is being played to the user.
In one embodiment, the present invention is included in a system known as WebTV.TM. (WebTV), which uses a standard television set as a display device for browsing the Web and which connects to a conventional network, such as the Internet, using
standard telephone, ISDN, or similar communication lines. In accordance with the present invention, a user of a WebTV client system can utilize WebTV network services provided by one or more remote WebTV servers. The WebTV network services are used in
conjunction with software running in a WebTV client system to browse the Web, send electronic mail, and to make use of the Internet in various other ways. The WebTV servers function as proxies by retrieving, from a remote server, Web pages or other data
requested by a WebTV client system and then transmitting the requested information to the WebTV client system.
I. System Overview
FIG. 1A illustrates a configuration of a WebTV network according to one embodiment. A number of WebTV clients 1 are coupled to a modem pool 2 via direct-dial, bi-directional data connections 29, which may be telephone (POTS, i.e., "plain old
telephone service"), ISDN (Integrated Services Digital Network), or any other similar type of connection. The modem pool 2 is coupled typically through a router, such as that conventionally known in the art, to a number of remote servers 4 via a
conventional network infrastructure 3, such as the Internet. The WebTV system also includes a WebTV server 5, which specifically supports the WebTV clients 1. That is, the server 5 provides the WebTV services to the WebTV clients 1. Each of the
clients 1 can connect to the server 5 either through direct telephone or ISDN connection or through the Internet 3 via the modem pool 2. Note that the modem pool 2 is a conventional modem pool, such as those found today throughout the world providing
access to the Internet and private networks. Modem pool 2 may be provided by a local Internet Service Provider (ISP).
The WebTV server 5 generally includes one or more conventional computer systems. The server 5 may actually comprise multiple physical and logical devices connected in a distributed architecture.
FIG. 1B illustrates a WebTV client system 1 according to one embodiment. The client system 1 includes an electronics unit 10 (hereinafter referred to as "the WebTV box 10" or "the box 10"), an ordinary television set 12, and a hand-held remote
control 11. In an alternative embodiment of the present invention, the WebTV box 10 is built into the television set 12 as an integral unit. The box 10 includes hardware and software for providing the user with a graphical user interface, by which the
user can access the WebTV network services, browse the Web, send e-mail, and otherwise access the Internet.
The client system 1 uses the television set 12 as a display device and an audio output device. The box 10 is coupled to the television set 12 by a link 6. The link 6 includes an audio channel for generating sound from the television's speaker
and an RF (radio frequency), S-video, composite video, or other equivalent form of video channel. The communication link 29 between the box 10 and the server 5 is either a telephone (POTS) connection 29a or an ISDN connection 29b. The box 10 receives
AC (alternating current) power through an AC power line 7.
Remote control 11 is operated by the user in order to control the client system 1 to browse the Web, send e-mail, and perform other Internet-related functions. The box 10 receives commands from remote control 11 via an infrared (IR)
communication link. In alternative embodiments, the link between the remote control 11 and the box 10 may be RF or any equivalent mode of transmission.
The box 10 includes application software which, when executed by a processor in the box 10, provides the user with a graphical user interface by which the user can access the WebTV network services and browse the Web. The application software is
automatically executed upon application of power to the box 10.
FIG. 1C shows the internal components of the box 10. Operation of the client system 1 is controlled by a CPU 21, which is coupled to an Application-Specific Integrated Circuit (ASIC) 20. The CPU 21 executes software designed to implement
features of the present invention. ASIC 20 contains circuitry which is used to implement certain functions of the WebTV system. ASIC 20 is coupled to an audio digital-to-analog converter 25 which provides audio output to television 12. In addition,
ASIC 20 is coupled to a video encoder 26 which provides video output to television set 12. An IR interface 24 detects IR signals transmitted by remote control 11 and, in response, provides corresponding electrical signals to ASIC 20. A standard
telephone modem 27 and an ISDN modem 30 are coupled to ASIC 20 to provide connections 29a and 29b, respectively, to the modem pool 2 and, via the Internet 3, to the remote servers 4. Note that, while the illustrated embodiment includes both a telephone
modem 27 and an ISDN modem 30, either one of these devices will suffice to practice the present invention. Further, in various other embodiments, the telephone modem 27 and the ISDN modem 30 each may be replaced by or supplemented with other
communications devices, such as a cable television modem. In addition, in other embodiments, communication with the server 5 might be made via a token ring or Ethernet connection. Note that the box 10 also may include a cable television modem (not
shown).
Also coupled to ASIC 20 is mask Read-Only Memory (ROM) 22a, a flash memory 22b, and a Random Access Memory (RAM) 23. Mask ROM 22a (which is so named because it is non-programmable) provides storage of certain program instructions and data, as
will be described below. Flash memory 22b is a conventional flash memory device that can be written to (programmed) and erased electronically. Flash memory 22b provides storage of the browser software as well as data. In one embodiment, a mass storage
device 28 is included in the box 10 and coupled to ASIC 20. The mass storage device 28 may be used to input software or data to the client or to download software of data received over network connection 29. The mass storage device 28 includes any
suitable medium for storing machine-executable instructions, such as magnetic disks, optical disks, and the like.
As mentioned above, the WebTV box 10 includes application software including a Web browser. Referring now to FIG. 2A, the above-mentioned application software 31 operates in conjunction with operating system (OS) software 32. The OS software 32
includes various device drivers and otherwise provides an interface between the application software 31 and the system hardware components 40 (i.e., the elements illustrated in FIG. 1C).
In one embodiment, the application software 31 and the OS software 32 are stored in flash memory 22b. It will be recognized, however, that some or all of either the application software 31 or the OS software 32 or both can be stored in any other
suitable storage medium, such as mask ROM 22a or mass storage device 28, in various embodiments.
As mentioned above, steps according to the present invention are embodied in machine-executable instructions according to one embodiment. For example, in one embodiment the present invention is carried out by the CPU 21 executing sequences of
instructions contained in mask ROM 22a, flash memory 22b, or RAM 23, or a combination of these devices. More specifically, execution of the sequences of instructions causes the CPU 21 to perform the steps of the present invention. These steps will be
described below. Instructions for carrying out the present invention may be loaded into memory from a persistent store, such as mass storage device 28, and/or from one or more other computer systems over a network, such as the WebTV server 5 or a remote
server 4. For example, such a server system may transmit a sequence of instructions to the client system 1 in response to a message transmitted to the server system over the Internet 3 by the client system 1. As the client system 1 receives the
instructions via a network connection, such as modem 27a, the client system 1 stores the instructions in a memory. The client system 1 may store the instructions for later execution or execute the instructions as they arrive over the network connection.
In some embodiments, the downloaded instructions may be directly supported by the CPU 21. Consequently, execution of the instructions may be performed directly by the CPU 21. In other embodiments, the instructions may not be directly executable
by the CPU 21. Under these circumstances, the instructions may be executed by causing the CPU 21 to execute an interpreter that interprets the instructions, or by causing the CPU 21 to execute instructions which convert the received instructions into
instructions that can be directly executed by the CPU 21.
Certain embodiments and aspects of the present invention may be also carried out in the WebTV server 5, instead of (or in addition to) being carried out in the WebTV client system 1. For example, a CPU of the server 5 may execute instructions
stored in memory to perform steps in accordance with the present invention.
In various embodiments, hardwired circuitry may be used in place of, or in combination with, software instructions to implement the present invention. Thus, the present invention is not limited to any specific combination of hardware circuitry
and software, nor to any particular source for the instructions executed by a computer system.
The Web browser functions of the present invention are implemented by application software 31. FIG. 2B illustrates the functional relationships between the various components of application software 31. Application software 31 includes a
communications manager 50, an HTML (Hypertext Mark-up Language) parser 51, a graphics engine 52, a layout engine 53, an input system 54, a user interface 56, a selection handler 55, and a streams manager 57. The client system receives Web pages over
network connection 29 in the form of HTML documents. Streams manager 57 controls and coordinates movement of data throughout the system.
Each HTML document is initially input to communications manager 50. Communications manager 50 performs functions necessary to receive an HTML document, over the network connection 29 including handling high-level communications protocols, such
as HITP (Hypertext Transport Protocol), TCP/IP (Transmission Control Protocol/Internet Protocol), etc. A received HTML document is provided by communications manager 50 to HTML parser 51. HTML parser 51 converts HIML page descriptions to a displayable
format for the client system.
As is well known, an HTML document may contain text and/or refer to images and other media types. Further, an HTML document may include one or more "hypertext anchors," which are displayable objects that provide a link to another Web page.
Hypertext anchors are also sometimes referred to as "hot links" or "hot spots." Each hypertext anchor is associated with a particular URL (Uniform Resource Locator) or other logical address representing the location of the Web page to which the anchor
provides a link. The URL may or may not be stored within the client system, as will be discussed below. A hypertext anchor may be a word or a phrase of text, an image, or a part of an image. The hypertext anchors and other objects which are to be
displayed on a screen are defined in the HTML document by a number of "tags" which specify information relating to the displayable object and its attributes (e.g., whether the object is a hypertext anchor, an image map, an image map containing hypertext
anchors, etc.). Accordingly, HTML parser 51 separates tags from text within each HTML document under the control of the streams manager 57.
HTML parser 51 also generates a list of "displayables" (displayable objects) from the received HTML document. In addition, the HTML parser 51 generates a sorted list of "selectables" (selectable objects, i.e., displayable objects which are
hypertext anchors). The method of generating this sorted list is discussed below in greater detail. The data structure containing the list of displayables is provided by HTML parser 51 to layout engine 53, which places the displayable objects on the
screen of the television set 12. Image information, such as JPEG or GIF image information, are provided by HTML parser 51 to layout engine 53 via a graphics engine 52, which is responsible for measuring and drawing images.
In the course of browsing through a displayed Web page or between different Web pages, a user activates buttons on remote control 11, which, in response, transmits IR signals that are received by the box 10. Input system 54 records these inputs
and provides them to selection handler 55 and user interface 56. In addition, input system 54 can handle input queuing and processing of inputs from various other input devices, such as a standard or IR keyboard. Selection handler 55 receives commands
provided by the user for moving a selection (of a hypertext anchor) around on the screen (i.e., moving a selection from one hypertext anchor to another). The selection handler 55 determines, in response to the user inputs, which of the hypertext anchors
in a Web page should be a current selection and provides a selection indication to the user of the current selection through the display of television set 12. Other aspects of the Web browser which are visible to the user are provided by user interface
56 based on signals received from input system 54.
FIG. 3 illustrates remote control 11 in greater detail. In the preferred embodiment, remote control 11 is similar to, and has the general appearance of, a common, hand-held remote control that is used to control a television set. In fact,
remote control 11 may include controls for performing any or all of the user-controlled functions of television set 12. In an alternative embodiment, remote control 11 may be a wired hand-held controller or a wired or wireless (e.g., IR) keyboard or any
other similar device. Remote control 11 includes Options button 7, Scroll Up button 8, Scroll Down button 9, direction buttons 15-18, Enter button 19, Home button 35, Back button 36, and Recent button 37. Direction buttons 15-18 include left button 15,
right button 16, up button 17, and down button 18.
The functions of the controls on remote control 11 will be described below in detail. However, a summary of certain ones of these functions is helpful at this point. Home button 35 causes the client system 1 to directly access and display the
Home page of the WebTV network services. Back button 3 allows the user to retrace his steps by revisiting previously-visited Web pages in reverse chronological order. Recent button 37 is used to access a display indicating the most recent Web sites
(pages) the user has visited. From this display, the user will be allowed to directly revisit any of those sites. Scroll Up button 8 and Scroll Down button 9 are used to scroll the screen up or down, respectively, to display a previously undisplayed
portion of a Web page. Direction buttons 15-18 allow the user to specify a direction of movement in order to select a new hypertext anchor. When Enter button 19 is pressed, remote control 11 sends a command to the box 10 to activate the hypertext link
corresponding to the currently selected hypertext anchor. That is, in response to Enter button 19 being pressed, the uniform resource locator (URL) or other logical address of the currently selected hypertext object is transmitted by the box 10 over the
network connection 29 (except in the case of certain image maps, as will be described below) in order to access the corresponding Web page.
II. Hotlink Navigation
FIG. 4A illustrates an example of a Web page 100 which may be displayed by television 12 using the client system. Web page 100 is a sample home page for a fictitious company, Company XYZ. Web page 100 includes a number of hypertext anchors
101-115, each of which provides a link to another Web page that is not currently displayed. In Web page 100, hypertext anchors 101, 102, 109, 110, 111, and 115 are image maps. Hypertext anchors 101 and 102 are included within image map 116, which is
not a hypertext anchor. Hypertext anchor 101 is the logo for Company XYZ. Logo anchor 101 may provide a link, for example, to another Web page which provides a history of company XYZ. Hypertext anchor 115 may provide a link, for example, to an audio
stream which generates the jingle (theme song) of Company XYZ, and which can be output to the user through the speaker of television 12. The remainder of the Web page 100 contains informational text about Company XYZ grouped under the headings: "Product
Information," "Company News," "Personnel Profiles," "Sales Offices," and "Job Opportunities." Hypertext anchors 103-108 and 112-114 are key words or phrases within the text.
The application software 31 provides means for the user to navigate between the hypertext anchors displayed on a Web page, such as Web page 100, using the remote control 11. In particular, application software 31, in response to user inputs from
remote control 11, moves a selection from one hypertext object to another in a discrete movement. At a given point in time, only one displayed hypertext object is selected and is displayed as a current selection. In FIG. 4A, for example, hypertext
anchor 101 is selected and is indicated as the current selection by highlighting 118. Once a hypertext anchor is selected, the user can activate its link to another Web page by pressing "Enter" button 19. To change the current selection, the user
specifies a direction in which he wishes to "move" the selection by pressing any of direction buttons 15-18 on remote control 11. In response to one of these inputs, the application software 31 determines which of the other hypertext objects in the HTML
document, if any, to select and display as the new current selection. In prior systems, the user is required to move a pixel-accurate cursor over the screen in continuous movements and to determine when the cursor coincides with a hypertext anchor. In
contrast, the present invention determines the location of all hypertext objects and selects a new hypertext anchor based on the inputs received from remote control 11. The user is not required to locate hypertext objects.
Assume now that the user wishes to change the current selection, hypertext anchor 101, to a new hypertext anchor--anchor 104, for example. The present invention allows the user to do this by pressing one of direction buttons 15-19 on remote
control 11. FIG. 4B illustrates the Web page 100 as displayed with the anchor 104 as the current selection, as indicated by highlighting 118. Using remote control 11, the user may move the current selection successively through all of the displayed
hypertext anchors and may also access and select hypertext anchors in the current HTML document which are not currently displayed by scrolling the document.
FIG. 5 illustrates a routine for setting up a data structure performed by the application software 31 in order to permit the functions just described. Initially, an HTML document is received via the network connection 29 (step 501). Next, the
HTML document is parsed into text and tags (step 502). From the parsed HTML document, a list is generated of the displayables in the current HTML document (step 503). Displayables may include either text or images. Methods of identifying displayables
in an HTML document are well known and need not be discussed herein. From the list of displayables, a sorted list of selectables (e.g., hypertext anchors) is generated (step 504).
The list of selectables is sorted as it is generated according to an insertion sort routine. The selectables are sorted according to their positioning on the Web page, as it is to be displayed. More specifically, the list of selectables is
formed according to the direction of reading or writing in the English language (i.e., left to right, top to bottom). Sorting is performed first according to vertical position, and then according to horizontal position. Accordingly, a selectable would
be inserted into the selectable list at a position before any selectables which it appears higher than on the Web page; a selectable would also be inserted into the selectable list at a position before any selectables that it appears to the left of on
the Web page but have the same vertical position.
In performing the insertion sort to generate the list of selectables, the determination of vertical positioning requires a determination of whether a given selectable falls "above" or "below" an existing entry in a selectable list. This
determination can be complicated by the fact that there is often overlap in the vertical direction between two selectables. In FIGS. 4A and 4B, for example, there is vertical overlap between anchors 109 and 110. The present invention resolves this
difficulty in the following way: If there is overlap between a given selectable and another selectable, then the given selectable is considered to be "below" the other selectable if the overlap between the two selectables is less than one-half of the
height of the smaller of the two selectables and the top of the given selectable is below the top of the other selectable. If the overlap is not less than one-half of the height of the smaller of the two selectables or if the top of the given selectable
is not below the top of the other selectable, then the given selectable is not considered to be "below" the other selectable. This same criterion is applied to determine when a given selectable can be considered "above" another selectable. Further,
this method of defining the conditions "above" and "below" is also used in moving the current selection in response to a user input, as will be discussed below.
Referring now to FIGS. 4A and 4B for example, the sorted list of selectables generated from Web page 100 would have the following order (listed by reference numeral): 101, 102, 104, 103, 105, 106, 107, 108, 109, 110, 112, 111, 113, 114, 115. It
should be appreciated that in the actual implementation, the sorted list of selectables may actually constitute a list of pointers to entries in the list of displayables. Note that in reading Web page 100 from top to bottom (in English), a person would
encounter anchor 104 before encountering anchor 103, since anchor 104 is in a line of text that is above the line of text including anchor 103. Consequently, anchor 104 appears before anchor 103 in the sorted list of selectables. Note further that
anchor 112 appears before anchor 111 in the sorted list of selectables; this is so because there is overlap in the vertical direction between these two anchors, and the amount of overlap includes the entire height of anchor 112. Consequently, anchors
111 and 112 are considered to have the same vertical rank on Web page 100. However, since anchor 112 appears to the left of anchor 111, anchor 112 is inserted into the sorted list before anchor 111.
The method of moving a selection between hypertext anchors using remote control 11 will now be described with reference to FIGS. 6, 7A, and 7B. As mentioned above, a user may move the current selection left or right by one hypertext anchor by
pressing left button 15 or right button 16, respectively. In response to receiving an IR signal corresponding to either button 15 or button 16, the software 31 of the present invention (specifically, selection handler 55) simply moves one position
through the sorted list to determine the new current selection. That is, if left button 15 was pressed, the new current selection will be one position higher in the sorted list from the current selection, whereas, if right button 16 was pressed, the new
current selection will be one position lower in the sorted list from the current selection. In response to any of direction buttons 15-18 being pressed, a new current selection will be determined and the highlighting 118 will be moved to indicate the
new current selection. The screen may be scrolled to display the current selection, as discussed below. As mentioned above, the user may activate the hypertext link of the current selection by pressing "Enter" button 19.
Movement of the current selection in response to down button 18 being pressed will now be described with reference to FIG. 7A. When down button 18 is pressed, each entry (selectable) that appears in the sorted list after the current selection is
examined according to the following routine to determine whether it is a Best Guess. The Best Guess is a selectable which is, at least temporarily, considered to be the most likely selectable to be the new current selection based on the last user input. As each entry in the list is tested, whichever entry is currently considered to be the Best Guess may then be replaced by the selectable being tested if the selectable being tested is determined to be a better choice. Once the end of the list is
reached, the selectable that is designated as the Best Guess will be taken to be the new current selection. Accordingly, highlighting 118 will be moved to indicate the new current selection to the user.
In response to the down button 18 being pressed, the application software 31 initially determines which selectable in the sorted list of sel | | |
