US 7091926 B2
The present invention allows a user to arbitrarily position display screens so that a larger field of view can be presented by a computer system that senses the screen positions and provides appropriate display information. This is in contrast to the typical use of display screens where a single display screen is used and the position of the display screen is assumed to be directly in front of a user's viewpoint. For example, two screens can be placed side-by-side so that their viewing surfaces together form a rectangular plane. This can be useful for viewing movies or other presentations that benefit from a larger horizontal viewing field. More complex arrangements of multiple screens can be set up for more immersive presentations such as virtual reality, simulations, computer games, etc. A mounting bracket for holding screen in a fixed orientation with respect to each other is described. A preferred embodiment of the bracket includes a visual indicator for determining the angle of a screen with respect to another.
1. A method for generating display information, the method comprising the following steps performed by one or more digital processors:
determining three-dimensional positions in space of multiple disconnected display screens; and
generating display information for the display screens by using the determined three-dimensional positions so that different portions of a single scene are displayed upon multiple disconnected display screens at the same time to provide a coherent view of the scene from at least one viewpoint.
2. The method of
using the first digital processor to receive signals from the user input device to obtain information to, at least in part, describe a three-dimensional position of a display screen.
3. The method of
4. The method of
accepting signals from the user input device to allow a human user to specify a display screen's position information.
5. The method of
sensing a three-dimensional orientation of a display screen; and
wherein generating display information includes
using the sensed three-dimensional orientation to display at least a portion of the single scene to provide a coherent view.
6. The method of
detecting three points of a particular display screen; and
using the detected three points to determine a three-dimensional orientation of the particular display screen.
7. The method of
8. The method of
9. The method of
10. The method of
11. The method of
12. The method of
using a presentation program to receive user input to determine a display screen characteristic.
13. A method for using multiple display screens in a presentation, the method comprising
first sensing three-dimensional positions of a plurality of disconnected display screens at a first time;
providing the first sensed three-dimensional positions to a digital processor for rendering views for the plurality of display screens in accordance with the first sensed three-dimensional positions;
sensing three-dimensional positions of the plurality of disconnected display screens at a second time; and
providing the second sensed three-dimensional positions to a digital processor for rendering views for the plurality of disconnected display screens in accordance with the second sensed three-dimensional positions.
14. The method of
determining a three-dimensional position of a display screen by accepting input from a human user.
15. The method of
automatically sensing the three-dimensional position of a display screen.
16. A method for using multiple disconnected display screens in a computer generated presentation, the method comprising:
indicating to a human user preferred three-dimensional positions for two or more display screens;
rendering views for the two or more display screens in accordance with the preferred three-dimensional positions; and
accepting signals from a user input device to modify a preferred three-dimensional position of at least one of the two or more display screens.
Typical display screens occupy a relatively small part of a viewer's, or user's, field of view. A standard computer monitor, television screen, liquid crystal, flat panel, thin-film transistor, or other type of display device might measure 14 to 29 inches diagonal. This requires a user to be relatively close to the display in order for the display to fill up a larger portion of the user's field of view.
Larger displays are possible. For example, a projection display can occupy a much larger area. However, such devices are often expensive and inconvenient. For example, a projector might have to be located at some distance from the screen, or other surface, in order to create a sufficiently large display. Another problem with projection type of displays is that they, in effect, “blow up” a high resolution into a coarser resolution. For example, if a 1024×768 display is projected to create a large image, the image is still at the 1024×768 resolution. The picture elements, or pixels, and spaces between pixels are made larger by projecting. Thus, the pixel density is decreased. This is why projected displays are usually viewed from a larger distance than the display screens mentioned above. A longer viewing distance means that the coarser resolution is not as noticeable.
Another approach is a so-called “wall of video”. This approach uses multiple display screens usually arranged in a rectangle, or wall. Portions of an image to be displayed are divided among the separate display screens in the wall so that a much larger display can be obtained. Note that this approach maintains the display density since each screen is still displaying at its native density. For example, if three screens are used in a row, and each screen has a 1024×768 density, then although three times as much area is covered by the combination of three display screens, there are also three times as many pixels in the composite display.
A problem with the wall of video approach is that it is inflexible and expensive. The system must be designed from the outset so that an image source can appropriately generate separate video signals to each of the screens. Typically, a computer is used to divide a single input image into separate images for the sections of the wall of video. For example, if a wall of video uses 9 screens in a 3×3 arrangement, then the computer system is designed to divide an original image into an equal 3×3 grid. Each section of the grid is sent to the associated display screen. The arrangement is hardwired and is typically designed on a customized, per installation, basis. Setting up such a display requires planning of the area to be covered, size and number of screens to use, multiple display output hardware devices, custom software to divide the input images, etc.
Once a wall of video system is set up it is not easily changed. This makes it difficult to adapt the display to different applications. For example, viewing a movie may require that the screens be arranged in a 4:3 aspect ratio for best viewing. Presenting documents or tables of information might best be achieved if an overall display is taller than it is wide. Playing computer games that simulate immersion into a simulated environment warrant a display area that wraps around a user and that can potentially cover large spherical sections around the user.
Thus, it is desirable to provide a multi-screen display system that improves upon one or more of the shortcomings of the prior art.
The present invention allows a user to arbitrarily position display screens so that a larger field of view can be presented by a computer system that senses the screen positions and provides appropriate display information. This is in contrast to the typical use of display screens where a single display screen is used and the position of the display screen is assumed to be directly in front of a user's viewpoint. For example, two screens can be placed side-by-side so that their viewing surfaces together form a rectangular plane. This can be useful for viewing movies or other presentations that benefit from a larger horizontal viewing field. More complex arrangements of multiple screens can be set up for more immersive presentations such as virtual reality, simulations, computer games, etc.
A mounting bracket for holding screen in a fixed orientation with respect to each other is described. A preferred embodiment of the bracket includes a visual indicator for determining the angle of a screen with respect to another.
In one embodiment the invention provides a method for generating display information including determining the positions of multiple display screens and generating display information for the display screens by using the determined positions so that different portions of a single scene are displayed upon multiple display screens at the same time to provide a coherent view of the scene from at least one viewpoint.
In another embodiment the invention provides a method for using multiple display screens in a presentation, comprising first sensing the positions of a plurality of display screens at a first time; providing the first sensed positions to a digital processor for rendering views for the plurality of display screens in accordance with the first sensed positions; sensing the positions of the plurality of display screens at a second time; and providing the second sensed positions to a digital processor for rendering views for the plurality of display screens in accordance with the second sensed positions.
In another embodiment the invention provides a method for using multiple display screens in a computer-generated presentation, comprising indicating to a human user preferred positions for two or more display screens; and rendering views for the two or more display screens in accordance with the preferred positions.
In another embodiment the invention provides a bracket for joining two or more display screens, the bracket comprising a first slot for receiving a first display screen; and a second slot coupled to the first slot for receiving a second display screen.
The present invention allows a user to arbitrarily position display screens so that a larger field of view can be presented by a computer system that senses the screen positions and provides appropriate display information. This is in contrast to the typical use of display screens where a single display screen is used and the position of the display screen is assumed to be directly in front of a user's viewpoint. For example, two screens can be placed side-by-side so that their viewing surfaces together form a rectangular plane. This can be useful for viewing movies or other presentations that benefit from a larger horizontal viewing field. More complex arrangements of multiple screens can be set up for more presentations such as virtual reality simulations, computer games, etc.
Screens such as 112 may include obscured screen areas such as at 114 if screens overlap. Obscured areas can be calculated by a program or programs that are used to calculate, render, generate or otherwise present a visual scene, or presentation, on the multiple display screens. In other words, since presentation software is informed of the positions of the display screens, the software can determine that the area at 114 of display screen 112 can not be seen by a user at 102. In this case the software can omit calculation for, and transfer of, viewing information to screen 112.
For example, if a user specifies display positions (not including border positions) then the border positions can be inferred as the spaces between the display screens. In this case no special accommodating of the borders is required. The presentation software merely counts the border areas as “blank space” that does not have screen coverage. If specifications are made for the positions of screens and borders as a unit, as where monitor screens are indicated coarsely by stating adjacencies of units and sizes of screens, then border sizes can be obtained or assumed in varying ways. One way is to have a database of display screen types and provide for detection of display screen types and matching to the database which provides corresponding border sizes. Or a typical border of, e.g., 1.5 inches can be assumed. Or a user can indicate the presence of borders to the presentation software.
Note that screens can be placed arbitrarily and anywhere. Display screen 116 has been placed somewhat far behind and above the other display screens. In such a case, there may be a large amount of “blank space” or blank area between the screens. In a preferred embodiment, the presentation software (e.g., a graphics program for rendering a scene) only generates the portion of the scene that is appropriate for each display screen area based on the display screen's position and user viewpoint. The number, type, size or other characteristics of the display screens can vary from those discussed herein.
As used in this application, “coherent” presentation of visual information includes presentation on two or more display devices where there is a perceived aesthetic consistency, or relationship, of the visual information on the different display devices. For example, a single scene that is rendered across the multiple display devices at the same time fits this description. Another example, is movement from one screen to another consistent with a simulation, depiction or portrayal of natural, or physical, movement. An example of natural movement is a person walking, car moving, falling object, exploding object, ballistic path, etc.
Screen positions can be predetermined, designated, or sensed. Sensing can include using remote sensing devices such as acoustic, radio-frequency, infrared, etc. For example, a user can indicate three points of a screen's perimeter by placing an infrared emitter on each of the points. A computer system is informed of each point by, e.g., a user keypress at or near the time of emitter placing. Once three points, such as three corners of a display screen, are known, the three-dimensional position of the screen, along with the screen dimensions, can be determined.
Three dimensional sensing can be by any means as is known in the art. For example, laser scanning, coordinate measuring machines, etc. can be used along with triangulation techniques to identify positions. Another approach is to use global positioning system (GPS) sensing. Other alternatives include angulation using phased antenna arrays, imaging using one or multiple cameras and scene analysis, etc.
Another type of sensing is mechanical sensing. This can use a movable arm located at a known point where the end of the arm is touched (or moved near) to one or more points of a screen. Joints or hinges can be affixed at places where screens are adjacent. Such joints can measure the angles made by the planes of the adjacent screens so that positions of secondary screens relative to a main screen can be determined. This is usually sufficient to determine accurate positions of the secondary screens. Sizes of the screens can be manually input by the user so that presentation software can compute only the views, and viewport sizes, necessary to create information to be displayed on each of the screens. Such sensing joints can be made strong enough to hold and support multiple screens. An example of such a joint is described, below.
One useful way to determine positions of screens is simply to ask a user to input the positions. This manual position designating includes having a user make measurements of distances and angles which are then entered into a computer system that calculates the screen positions from the measurements. The user measurements can be rough approximations and screen positions can still be determined with enough accuracy to create a coherent multi-screen display.
Screen positions can be calibrated. One form of calibration allows a user to move models of screens on a computer display. Each screen model corresponds to an actual screen that the user is viewing. The model positions are used to generate views for the screens as the user is moving a model. When the user sees matching views of a scene, test pattern, reference object, etc., among screens that include the model screen being moved, then calibration is achieved. The user indicates to a computer system that the current model position results in a view that is coherent with another screen (e.g., the main screen) and the computer system can then use the information to generate further views for the screen corresponding to the model.
Screen positions can be predetermined. For example, a presentation program may have default, or optimal, screen placements determined by a program, or presentation, author. In this case, the user is directed to place the screens in a predetermined orientation. It is possible that an automated system can move the screens without user intervention. For example, screens can be on pivoting platforms, moveable robotic arms, etc.
Each bracket has three U-shaped slots for holding an edge of a screen. The slots can be tilted, or movably positioned, so that the screens can form different angles in accordance with a user's preference for a specific set of screen orientations. In a preferred embodiment a general configuration is maintained where main screen 260 has left and right screens 262 and 264; along with top screen 268. Details of the brackets are discussed in more detail, below.
Each screen has a stand. In
An alternative arrangement for screens is shown in
Note that the screens of
Slots include two sides, or arms, and a bottom. In a preferred embodiment, a slot's arms are not necessarily the same length. For example, slot 310 has a front arm that is longer than the back arm. This is because the top screen that fits into slot 310 will need more support at its front face due to gravity. Other bracket arrangements can have arms of any configuration, length, size, shape, coloration or other attributes or properties.
Although the invention has been discussed primarily with respect to computer (or digital processor) presentations, aspects of the invention can be applied to other forms of presentation. For example, optical presentations can be coordinated by sensing the positions of screens according to the invention. Slides, film or other media can be projected onto rear-projection display screens according to the detected screen orientations to achieve a desired result, or goal. The images can be designed to portray a scene. A tray of slide photographs can be selected according to whether the display screen is in an overhead, lateral, or ground position. For an overhead position, e.g., a blue sky, clouds, bird, etc. image is selected for display. Similarly, a horizon, person, grass, roadway, etc., image can be displayed according to position.
Even more basic types of presentations can be employed. For example, where the goal is to illuminate an object with certain colors, intensity, or shading of light, the display screens may be used merely as sources of white or tinted illumination. Thus, the screen positions can be sensed and compared to a desired lighting model that is provided to a computer, or other system. The system can sense the positions and provide each screen with information to create illumination to obtain the desired result. Such an approach is useful, for example, in photography, film or moviemaking where typical lighting sources include key, fill and background lighting. Parameters such as color balance, light temperature, etc. can be used to specify the model for lighting. Sophisticated, controllable, light sources can be substituted for the display screens. Light sources can include incandescent, fluorescent, tungsten, daylight reflectors, plasma screen, electron tubes, LCD, TFT, micromirror or other devices. A “presentation program” can be any type of hardware or software that generates images for viewing on multiple screens.
Naturally, any combination, position or orientation (e.g., rotated, angled, slanted, etc.) of display screens is possible. Also, any type of display device (or light source) can be used including cathode ray tubes (CRTs), flat-panel displays (e.g., liquid crystal displays (LCDs), thin-film transistors (TFTs), etc.), plasma, electrofluorescent, projection, glass, silvered screens, etc. Any shape and size of display can be used including any size of standard rectangular displays, circular, curved, convex, concave, three dimensional (i.e., non-planar), etc.
The presentation program need not display the same resolution on all of the screens. In fact, it is more advantageous to detect where a user is viewing so that the focus point can be rendered in higher resolution while screen areas that the user is not looking at directly can be rendered in lower resolution (or not at all). This approach reduces the processing resources needed by the presentation program and reduces bandwidth needed to transfer viewing information to the screens.
The user's viewing direction or viewpoint can be detected by position sensing, as described above. The user can wear an emitting indicator that assists in automatically detecting the viewing position. For example, the TrackIR™ system from NaturalPoint™ can be used. If it is known, for example, that the user is looking at the main screen then the top and side screens can be rendered in lower resolution. Or regions on the screens, as opposed to the entirety of the screens, can be rendered differently. A rear screen or other screen, or screen portion, not currently visible need not be rendered at all.
Although a specific type of bracket is described, variations can be obtained that are within the scope of the invention. For example, a bracket might use “V-shaped” rather than U-shaped slots. Clamps can be used instead of the slots. A bracket that does not use the rectangular slots of the preferred embodiment can be employed. Different ways of hinging, or movably connecting the slots together can be employed. Instead of two brackets, a single bracket can be formed by joining the brackets along one or more axes. For example, the brackets can be joined horizontally along the adjacency of the main and top screens. It is possible separate brackets can be used so that, instead of three slots joined together, only two slots are joined. In this case, the bracket may be positioned at different areas of the screens. For example, a bracket can be used at the midpoint of each screen adjacency so that, e.g., the main and top screens are held together, the left and main screens, and the right and main screens are each held by a separate bracket.
Many variations of brackets are possible. In general, it is not necessary to have the angle measuring indicator of the preferred embodiment. Brackets need not be moveable but can be manufactured with slots in a fixed, unmoveable position. Or a bracket can allow only a few positions, rather than the continuous positioning that is possible with the brackets discussed, herein.
Thus, the scope of the invention is to be determined solely by the appended claims.