text:
US20120280898A1 - Method, apparatus and computer program product for controlling information detail in a multi-device environment - Google Patents
Method, apparatus and computer program product for controlling information detail in a multi-device environment Download PDF
US20120280898A1 US13/099,631 US201113099631A US2012280898A1 US 20120280898 A1 US20120280898 A1 US 20120280898A1 US 201113099631 A US201113099631 A US 201113099631A US 2012280898 A1 US2012280898 A1 US 2012280898A1
Andrés Lucero
Tero Jokela
Juha Arrasvuori
Nokia Oyj
2011-05-03 Application filed by Nokia Oyj filed Critical Nokia Oyj
2011-05-03 Priority to US13/099,631 priority Critical patent/US20120280898A1/en
2011-07-06 Assigned to NOKIA CORPORATION reassignment NOKIA CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HOLOPAINEN, JUSSI, JOKELA, TERO, LUCERO, ANDRES, ARRASVUORI, JUHA
2020-01-17 Application status is Abandoned legal-status Critical
238000004590 computer program Methods 0 claims description title 37
230000001276 controlling effects Effects 0 abstract description title 11
230000004044 response Effects 0 abstract claims description 34
238000003860 storage Methods 0 claims description 9
238000004891 communication Methods 0 description 18
239000000203 mixtures Substances 0 description 11
238000005304 joining Methods 0 description 7
238000004091 panning Methods 0 description 5
230000001702 transmitter Effects 0 description 3
230000003028 elevating Effects 0 description 2
230000000284 resting Effects 0 description 2
238000004422 calculation algorithm Methods 0 description 1
238000010295 mobile communication Methods 0 description 1
238000010079 rubber tapping Methods 0 description 1
G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
G06F3/14—Digital output to display device; Cooperation and interconnection of the display device with other functional units
G06F3/1423—Digital output to display device; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
G06F3/1446—Digital output to display device; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display display composed of modules, e.g. video walls
G06F3/147—Digital output to display device; Cooperation and interconnection of the display device with other functional units using display panels
G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
G09G2340/00—Aspects of display data processing
G09G2340/04—Changes in size, position or resolution of an image
G09G2340/045—Zooming at least part of an image, i.e. enlarging it or shrinking it
G09G2356/00—Detection of the display position w.r.t. other display screens
G09G2370/00—Aspects of data communication
G09G2370/16—Use of wireless transmission of display information
A method is provided for controlling information detail in a multi-device environment. In particular, example methods may provide for operating a device in a multi-device environment, directing the presentation, on a display of the device, of a first image, detecting a motion of the device, directing a change of the image presented on the display of the device from the first image to a second image in response to detecting the motion of the device. The first image presented on the device is related to images displayed on other devices in the multi-device environment. The second image may be a scaled version of the first image and the second image may be scaled based on at least one property of the motion. Each device in the multi-device environment may be directed to display a portion of a complete image, where the first image is a portion of the complete image.
FIELD OF INVENTION
Example embodiments of the present invention relate generally to displays and user interfaces of mobile devices and, in particular, to controlling the level of information detail displayed on the display of a device when used in a multi-device environment.
The modern communications era has brought about a tremendous expansion of wireline and wireless networks. Computer networks, television networks, and telephone networks are experiencing an unprecedented technological expansion, fueled by consumer demand. Wireless and mobile networking technologies have addressed consumer demands while providing more flexibility and immediacy of information transfer.
Mobile devices, such as cellular telephones, have become smaller and lighter while also becoming more capable of performing tasks that far exceed a traditional voice call. Mobile devices are increasingly becoming small, portable computing devices that are capable of running a variety of applications and providing a user with a display on which they may watch video, view web pages, play interactive games, or read text. Devices are often small enough to fit into a pocket to achieve desired portability of these devices; however, as the capabilities of the devices increases, the displays of such devices are used to display large amounts of information and view objects which have traditionally been displayed on larger, less portable displays. It may be desirable to provide a method of enhancing the displayed information of a single device in a multi-device environment in response to a user input.
In general, exemplary embodiments of the present invention provide an improved method of enhancing a user interface with a mobile device by joining the displays of multiple devices together to function together with one another and controlling information detail in a multi-device environment. In particular, the method of example embodiments provides for directing a presentation of a first image by a processor on a display of a device configured to operate in a multi-device environment, detecting a motion of the device, directing a change of an image presented on the display of the device from the first image to a second image in response to detecting the motion of the device. Where the first image presented on the device is related to images presented on other devices in the multi-device environment. The second image may be a scaled version of the first image and the method may further include scaling the second image based on at least one property of the motion. Each device in the multi-device environment may be directed to present a portion of a complete image, and the first image may be a portion of the complete image. The method may further entail directing at least one other device in the multi-device environment to change an image presented on the display of the at least one other device in response to the detected motion of the device. The motion of the device may include moving the device from a first location and the method may further include again directing presentation of the first image on the device in response to detection that the device being returned to the first location. The second image may be an expanded view of the first image including information not present in the first image.
According to another embodiment of the present invention, an apparatus is provided. The apparatus may include at least one processor and at least one memory including computer program code, the at least one processor and the at least one memory including computer program code. The at least one memory and the computer program code may be configured to, with the at least one processor, cause the apparatus to at least direct presentation of a first image on a display of a device configured to operate in a multi-device environment, detect a motion of the device, and direct a change of an image presented on the display of the device from the first image to a second image in response to detecting the motion of the device. The first image presented on the device may be related to images presented on other devices in the multi-device environment. The second image may be a scaled version of the first image and the computer program code may be further configured to cause the apparatus to scale the second image based on at least one property of the motion. The memory and the computer program code may be configured to, with the at least one processor, cause the apparatus to present a portion of a complete image, and the first image is a portion of the complete image. The at least one memory and the computer program code may be configured to, with the at least one processor, cause the apparatus to direct at least one other device in the multi-device environment to change an image presented on the display of the at least one other device in response the detected motion of the device. The motion of the device may include moving the device from a first location and the apparatus may be further caused to again direct presentation of the first image on the device in response to detection that the device has returned to the first location. The second image may be an expanded view of the first image presenting information not present in the first image.
A further embodiment of the invention may include a computer program product including at least one computer-readable storage medium having computer-executable program code instructions stored therein, the computer-executable program code instructions may include program code instructions for directing the presentation of a first image on a display of a device configured to operate in a multi-device environment, program code instructions for detecting a motion of the device, and program code instructions for directing a change of an image presented on the display of the device from the first image to a second image in response to detecting the motion of the device. The first image presented on the device may be related to images presented on other devices in the multi-device environment. The second image may be a scaled version of the first image and the computer program product may further include program code instructions for scaling the second image based on at least one property of the motion. The computer program product may further include program code instructions to cause each device in the multi-device environment to present a portion of a complete image, and the first image may be a portion of a complete image. The computer program product may further include program code instructions for causing at least one other device in the multi-device environment to change an image presented on the display of said at least one other device in response to the detected motion of the device. The motion of the device may include moving the device from a first location and the computer program product may further include program code instructions for again directing presentation of the first image on the device in response to the device being returned to the first location.
Another example embodiment of the present invention may provide a means for directing presentation of a first image on a display of a device configured to operate in a multi-device environment, means for detecting a motion of the device, and means for directing a change of the image presented on the display of the device from the first image to a second image in response to detecting the motion of the device. The first image presented on the device may be related to images presented on other devices in the multi-device environment. The second image may be a scaled version of the first image and the apparatus may include means for scaling the second image based on at least one property of the motion. The apparatus may further include means for presenting a portion of a complete image, where the first image is a portion of the complete image. The apparatus may include means for directing at least one other device in the multi-device environment to change an image presented on the display of the at least one other device in response the detected motion of the device. The motion of the device may include moving the device from a first location and the apparatus may include means again directing presentation of the first image on the device in response to detection that the device has returned to the first location. The second image may be an expanded view of the first image presenting information not present in the first image.
In general, further example embodiments of the present invention may provide a simple and intuitive method for combining the displays of multiple devices in a multi-device environment and for indicating the spatial arrangement of the devices relative to one another. The method may include detecting a touch, receiving an indication of a touch on another device in a multi-device environment, obtaining an order of devices in the multi-device environment, and providing for operation according to the order of devices. The method may further include obtaining a location relative to another device in the multi-device environment in response to receiving an indication of a touch on said device. The method may also include providing for display of a portion of an image based upon the location relative to another device. Receiving an indication of a touch on another device in a multi-device environment may include receiving a request to join said device in the multi-device environment.
According to another embodiment of the present invention, an apparatus is provided. The apparatus may include at least one processor and at least one memory including computer program code, the at least one processor and the at least one memory including computer program code. The at least one memory and the computer program code may be configured to, with the at least one processor, cause the apparatus to at least detect a touch, receive an indication of a touch on another device in a multi-device environment, obtain an order of devices in the multi-device environment, and provide for operation according to the order of devices. The apparatus may further be caused to obtain a location relative to another device in the multi-device environment in response to receiving an indication of a touch on said device and provide for display of a portion of an image based upon the location relative to another device. Receiving an indication of a touch on another device in the multi-device environment may include receiving a request to join the device in the multi-device environment.
A further embodiment of the invention may include a computer program product including at least one computer-readable storage medium having computer-executable program code instructions stored therein, the computer-executable program code instructions may include program code instructions for detecting a touch, program code instructions for receiving an indication of a touch on another device in a multi-device environment, program code instructions for obtaining an order of devices in the multi-device environment, and program code instructions for providing for operation according to the order of devices. The computer program product may further include program code instructions for obtaining a location relative to another device in the multi-device environment in response to receiving an indication of a touch on the device and program code instructions for providing for display of a portion of an image based upon the location relative to another device. The program code instructions for receiving an indication of a touch on another device in a multi-device environment may include program code instructions for receiving a request to join the device in the multi-device environment.
Another example embodiment of the present invention may provide an apparatus including means for detecting a touch, means for receiving an indication of a touch on another device in a multi-device environment, means for obtaining an order of devices in the multi-device environment, and means for providing for operation according to the order of devices. The apparatus may further include means for obtaining a location relative to another device in the multi-device environment in response to receiving an indication of a touch on the device and means for providing for display of a portion of an image based upon the location relative to another device. Receiving an indication of a touch on another device in a multi-device environment may include receiving a request to join the device in the multi-device environment.
BRIEF DESCRIPTION OF THE DRAWING(S)
Having thus described the invention in general terms, reference will now be made to the accompanying drawings, which are not necessarily drawn to scale, and wherein:
FIG. 1 illustrates an communication system in accordance with an example embodiment of the present invention;
FIG. 2 is a schematic block diagram of a mobile device according to an example embodiment of the present invention;
FIG. 3 illustrates an example embodiment of an image presented in a multi-device environment;
FIG. 4 depicts an example embodiment of mobile terminal controlling information detail in a multi-device environment;
FIG. 5 depicts another example embodiment of mobile terminal controlling information detail in a multi-device environment;
FIG. 6 depicts another example embodiment of an image presented in a multi-device environment;
FIG. 7 depicts an another example embodiment of mobile terminal controlling information detail in a multi-device environment;
FIG. 9 depicts another example embodiment of a mobile terminal controlling information detail in a multi-device environment;
FIG. 10 illustrates an example embodiment of a mind map presented in a multi-device environment;
FIG. 11 depicts an example embodiment of a mobile terminal controlling the information detail of a mind map in a multi-device environment as an example of hierarchical data objects that may be expanded and collapsed;
FIG. 12 illustrates an example embodiment of a touch gesture for combining the displays of multiple mobile terminals in a multi-device environment according to the present invention;
FIG. 13 illustrates another example embodiment of a touch gesture for combining the displays of mobile terminals in a multi-device environment according to the present invention;
FIG. 14 is a flowchart of a method of controlling information detail in a multi-device environment according to an example embodiment of the present invention; and
FIG. 15 is a flowchart of a method of combining the displays of multiple mobile terminals in a multi-device environment according to an example embodiment of the present invention.
Some example embodiments of the present invention will now be described more fully hereinafter with reference to the accompanying drawings, in which some, but not all embodiments of the invention are shown. Indeed, various embodiments of the invention may be embodied in many different forms and should not be construed as limited to the example embodiments set forth herein; rather, these example embodiments are provided so that this disclosure will satisfy applicable legal requirements. Like reference numerals refer to like elements throughout. As used herein, the terms "data," "content," "information" and similar terms may be used interchangeably to refer to data capable of being transmitted, received and/or stored in accordance with embodiments of the present invention.
Additionally, as used herein, the term 'circuitry' refers to (a) hardware-only circuit implementations (e.g., implementations in analog circuitry and/or digital circuitry); (b) combinations of circuits and computer program product(s) comprising software and/or firmware instructions stored on one or more computer readable memories that work together to cause an apparatus to perform one or more functions described herein; and (c) circuits, such as, for example, a microprocessor(s) or a portion of a microprocessor(s), that require software or firmware for operation even if the software or firmware is not physically present. This definition of 'circuitry' applies to all uses of this term herein, including in any claims. As a further example, as used herein, the term 'circuitry' also includes an implementation comprising one or more processors and/or portion(s) thereof and accompanying software and/or firmware. As another example, the term 'circuitry' as used herein also includes, for example, a baseband integrated circuit or applications processor integrated circuit for a mobile phone or a similar integrated circuit in a server, a cellular network device, other network device, and/or other computing device.
A session may be supported by a network 30 as shown in FIG. 1 that may include a collection of various different nodes, devices or functions that may be in communication with each other via corresponding wired and/or wireless interfaces or in ad-hoc networks such as those functioning over Bluetooth®. As such, FIG. 1 should be understood to be an example of a broad view of certain elements of a system that may incorporate example embodiments of the present invention and not an all inclusive or detailed view of the system or the network 30. Although not necessary, in some example embodiments, the network 30 may be capable of supporting communication in accordance with any one or more of a number of first-generation (1G), second-generation (2.G), 2.5G, third-generation (3G), 3.5G, 3.9G, fourth-generation (4G) mobile communication protocols and/or the like.
One or more communication terminals such as the mobile terminal 10 and the second mobile terminal 20 may be in communication with each other via the network 30 and each may include an antenna or antennas for transmitting signals to and for receiving signals from a base site, which could be, for example a base station that is part of one or more cellular or mobile networks or an access point that may be coupled to a data network, such as a local area network (LAN), a metropolitan area network (MAN), and/or a wide area network (WAN), such as the Internet. In turn, other devices (e.g., personal computers, server computers or the like) may be coupled to the mobile terminal 10 and the second mobile terminal 20 via the network 30. By directly or indirectly connecting the mobile terminal 10 and the second mobile terminal 20 and other devices to the network 30, the mobile terminal 10 and the second mobile terminal 20 may be enabled to communicate with the other devices or each other, for example, according to numerous communication protocols including Hypertext Transfer Protocol (HTTP) and/or the like, to thereby carry out various communication or other functions of the mobile terminal 10 and the second mobile terminal 20, respectively.
In example embodiments, either of the mobile terminals may be mobile or fixed communication devices. Thus, for example, the mobile terminal 10 and the second mobile terminal 20 could be, or be substituted by, any of personal computers (PCs), personal digital assistants (PDAs), wireless telephones, desktop computer, laptop computer, mobile computers, cameras, video recorders, audio/video players, positioning devices, game devices, television devices, radio devices, or various other devices or combinations thereof.
Although the mobile terminal 10 may be configured in various manners, one example of a mobile terminal that could benefit from embodiments of the invention is depicted in the block diagram of FIG. 2. While several embodiments of the mobile terminal may be illustrated and hereinafter described for purposes of example, other types of mobile terminals, such as portable digital assistants (PDAs), pagers, mobile televisions, gaming devices, all types of computers (e.g., laptops or mobile computers), cameras, audio/video players, radio, global positioning system (GPS) devices, or any combination of the aforementioned, and other types of communication devices, may employ embodiments of the present invention. As described, the mobile terminal may include various means for performing one or more functions in accordance with embodiments of the present invention, including those more particularly shown and described herein. It should be understood, however, that a mobile terminal may include alternative means for performing one or more like functions, without departing from the spirit and scope of the present invention.
The mobile terminal (e.g., mobile terminal 10) may, in some embodiments, be a computing device configured to employ an example embodiment of the present invention. However, in some embodiments, the mobile terminal may be embodied as a chip or chip set. In other words, the mobile terminal may comprise one or more physical packages (e.g., chips) including materials, components and/or wires on a structural assembly (e.g., a baseboard). The structural assembly may provide physical strength, conservation of size, and/or limitation of electrical interaction for component circuitry included thereon. The mobile terminal may therefore, in some cases, be configured to implement an embodiment of the present invention on a single chip or as a single "system on a chip." As such, in some cases, a chip or chipset may constitute means for performing one or more operations for providing the functionalities described herein.
The mobile terminal 10 illustrated in FIG. 2 may include an antenna 32 (or multiple antennas) in operable communication with a transmitter 34 and a receiver 36. The mobile terminal may further include an apparatus, such as a processor 40, that provides signals to and receives signals from the transmitter and receiver, respectively. The signals may include signaling information in accordance with the air interface standard of the applicable cellular system, and/or may also include data corresponding to user speech, received data and/or user generated data. In this regard, the mobile terminal may be capable of operating with one or more air interface standards, communication protocols, modulation types, and access types. By way of illustration, the mobile terminal may be capable of operating in accordance with any of a number of first, second, third and/or fourth-generation communication protocols or the like. For example, the mobile terminal may be capable of operating in accordance with second-generation (2G) wireless communication protocols IS-136, GSM and IS-95, or with third-generation (3G) wireless communication protocols, such as UMTS, CDMA2000, wideband CDMA (WCDMA) and time division-synchronous CDMA (TD-SCDMA), with 3.9G wireless communication protocols such as E-UTRAN (evolved—UMTS terrestrial radio access network), with fourth-generation (4G) wireless communication protocols or the like.
It is understood that the apparatus, such as the processor 40, may include circuitry implementing, among others, audio and logic functions of the mobile terminal 10. The processor may be embodied in a number of different ways. For example, the processor may be embodied as various processing means such as a coprocessor, a microprocessor, a controller, a digital signal processor (DSP), a processing element with or without an accompanying DSP, or various other processing circuitry including integrated circuits such as, for example, an ASIC (application specific integrated circuit), an FPGA (field programmable gate array), a microcontroller unit (MCU), a hardware accelerator, a special-purpose computer chip, or the like), a hardware accelerator, and/or the like.
In an example embodiment, the processor 40 may be configured to execute instructions stored in the memory device 60 or otherwise accessible to the processor 40. Alternatively or additionally, the processor 40 may be configured to execute hard coded functionality. As such, whether configured by hardware or software methods, or by a combination thereof, the processor 40 may represent an entity (e.g., physically embodied in circuitry) capable of performing operations according to an embodiment of the present invention while configured accordingly. Thus, for example, when the processor 40 is embodied as an ASIC, FPGA or the like, the processor 40 may be specifically configured hardware for conducting the operations described herein. Alternatively, as another example, when the processor 40 is embodied as an executor of software instructions, the instructions may specifically configure the processor 40 to perform the algorithms and/or operations described herein when the instructions are executed. However, in some cases, the processor 40 may be a processor of a specific device (e.g., a mobile terminal or network device) adapted for employing an embodiment of the present invention by further configuration of the processor 40 by instructions for performing the algorithms and/or operations described herein. The processor 40 may include, among other things, a clock, an arithmetic logic unit (ALU) and logic gates configured to support operation of the processor 40.
The mobile terminal 10 may also comprise a user interface including an output device such as an earphone or speaker 44, a ringer 42, a microphone 46, a display 48, and a user input interface, which may be coupled to the processor 40. The user input interface, which allows the mobile terminal to receive data, may include any of a number of devices allowing the mobile terminal to receive data, such as a keypad 50, a touch sensitive display (not shown) or other input device. In embodiments including the keypad, the keypad may include numeric (0-9) and related keys (#, *), and other hard and soft keys used for operating the mobile terminal 10. Alternatively, the keypad may include a conventional QWERTY keypad arrangement. The keypad may also include various soft keys with associated functions. In addition, or alternatively, the mobile terminal may include an interface device such as a joystick or other user input interface. The mobile terminal may further include a battery 54, such as a vibrating battery pack, for powering various circuits that are used to operate the mobile terminal, as well as optionally providing mechanical vibration as a detectable output. The mobile terminal 10 may also include a sensor 49, such as an accelerometer, motion sensor/detector, temperature sensor, or other environmental sensor to provide input to the processor indicative of a condition or stimulus of the mobile terminal 10.
The mobile terminal 10 may further include a user identity module (UIM) 58, which may generically be referred to as a smart card. The UIM may be a memory device having a processor built in. The UIM may include, for example, a subscriber identity module (SIM), a universal integrated circuit card (UICC), a universal subscriber identity module (USIM), a removable user identity module (R-UIM), or any other smart card. The UIM may store information elements related to a mobile subscriber. In addition to the UIM, the mobile terminal may be equipped with memory. For example, the mobile terminal may include volatile memory 60, such as volatile Random Access Memory (RAM) including a cache area for the temporary storage of data. The mobile terminal may also include other non-volatile memory 62, which may be embedded and/or may be removable. The non-volatile memory may additionally or alternatively comprise an electrically erasable programmable read only memory (EEPROM), flash memory or the like. The memories may store any of a number of pieces of information, and data, used by the mobile terminal to implement the functions of the mobile terminal. For example, the memories may include an identifier, such as an international mobile equipment identification (IMEI) code, capable of uniquely identifying the mobile terminal. Furthermore, the memories may store instructions for determining cell id information. Specifically, the memories may store an application program for execution by the processor 40, which determines an identity of the current cell, i.e., cell id identity or cell id information, with which the mobile terminal is in communication.
In general, example embodiments of the present invention provide a method for controlling information detail depicted on the display of a device, such as a mobile terminal 10. In particular, embodiments may control information detail depicted on the display of a mobile terminal relative to at least one other mobile terminal when the mobile terminal is operating in a multi-device environment. For example a first mobile terminal may be operating in a near-field network with at least one other mobile terminal, through a protocol such as Bluetooth™, and the mobile terminals may be operating in a symbiotic manner in which the displays of the mobile terminals are joined together to create a larger display capable of presenting a greater amount of detail of an image, document, or other object presented across the displays of the mobile terminals. While the term "image" is used herein to describe what is presented on the display of a mobile terminal, it is to be understood that the term image is not limited to media files or images in the conventional sense, but rather the presentation of any object of data, media, or otherwise which may be presented on the display of a mobile terminal.
An example application for which embodiments of the present invention may be implemented includes a virtual mind map as presented on a first mobile terminal placed, for example, on a table top surface. A second mobile terminal may be placed adjacent to the first mobile terminal and a join-event may occur to join the two devices in a multi-device environment. The join event may include a touch gesture between the two mobile terminals or a menu-driven pairing operation operable on either or both mobile terminals. Mobile terminals that have previously been joined in a multi-device environment may require only to be placed directly adjacent one another to initiate the join event. The user(s) may indicate through a gesture or a menu prompt by either terminal that a join event is to occur or to simply confirm the join event. Once joined, the two mobile terminals may function cooperatively (or independently) in dependence of the application executed on one or both of the mobile terminals. For example, in the case of a virtual mind map, the second terminal may present a portion of the virtual mind map that was previously off-screen of the first mobile terminal as the second mobile terminal may function to expand the display area of the first mobile terminal.
A multi-device near-field network may provide a multi-device environment in which multiple mobile terminals may be used cooperatively to enhance a user experience. Mobile terminals may be "joined" to the network through a number of possible manners, such as through motion gestures of adjacent mobile terminals, or through a manual connection procedure in which a user synchronizes or pairs a mobile terminal with another mobile terminal. The motion gesture for joining the devices may consist of a sequence of primitive discrete gestures like taps on each device, or it may be a continuous gesture (e.g. of circular shape) that spans across the displays of the devices. In one embodiment of the present invention, the order of the devices in the group may be defined through the order each device is joined to the group through the motion gesture. For example, the device that is tapped first or is the starting point for a continuous joining gesture, becomes the first or "dominant" device in the group. In yet another embodiment, the devices are able to track each others' relative position (e.g. the devices form a circle), the joining gesture may be started by a user (e.g. by tapping on three adjacent devices in clockwise direction) and the rest of the devices and their order in the group may be determined automatically (e.g. adding each adjacent device to the group following the clockwise order). Once joined, two or more mobile terminals may cooperatively perform actions or execute programs to enhance a user experience. The methods of cooperation may differ depending upon the application or functions being performed by the mobile terminals. The applications may utilize the order of the devices in the group to determine which information to present or to relay between the users. Such applications that consider the order of the devices in a group include various games, educational applications, expert review systems like medical applications, enterprise applications like auditing, and so forth.
One example of cooperation may include a media viewing application in which the displays of at least two mobile terminals are virtually joined to create a larger display as illustrated in FIG. 3 which depicts four mobile terminals situated on a substantially co-planar surface. One mobile terminal 310 with a display 312 that includes a resolution of 640 pixels by 360 pixels may be virtually joined with the displays (322, 332, 342) of three other mobile terminals (320, 330, 340) to create a display with an effective size of 1280 pixels by 720 pixels. Each of the four mobile terminals (310, 320, 330, 340) presents on the display a portion of a single image or media file, thereby increasing the information detail visible to a user. The mobile terminals 310-340 may be configured to recognize their location relative to the other mobile terminals through the near-field communication or by sensors, such as sensor 49 of FIG. 2, disposed about the periphery of the mobile terminal. The first mobile terminal 310 may recognize that it is in a multi-device environment with three other mobile terminals, and their relative locations are configured with one at each corner. The first mobile terminal 310 may further recognize through one or more sensors that the first mobile terminal 310 is disposed in the top, left corner, thus the image presented on the display 312 of the first mobile terminal 310 may be the top left corner of the image. Such a multi-device environment may be expanded to include any number of mobile terminals, with each additional mobile terminal offering a larger viewable area to be presented.
While FIG. 3 illustrates an image as viewed by the joined mobile terminals of a multi-device environment, the multiple mobile terminals may be capable of cooperating to perform other functions. For example, the mobile terminals 310-340 may cooperate to present a spreadsheet whereby the spreadsheet is rendered larger and more readable when presented across the virtual display created by the joined mobile terminals. Further, the displays of each mobile terminal may provide different functions within an application or different images from an application. One such example may include wherein one or more mobile terminals are presenting an overview of a map while another mobile terminal is presenting the legend of said map.
Example embodiments of the present invention are described herein with reference to a mobile terminal comprising a touch-sensitive display (e.g., a touchscreen); however, embodiments of the present invention may be configured to be operable on various types of mobile terminals with single or multi-touch displays, displays with separate touch-pad user-interfaces, or other display types.
Embodiments of the present invention may comprise at least two fundamental operations. A first operation includes a mobile terminal being joined with at least one other mobile terminal to form a multi-device environment. The multi-device environment may be supported, for example, by a near-field communications protocol such as Bluetooth™. Once joined, the mobile terminals of the multi-device environment may be configured to control the level of information detail depicted on each of the mobile terminals in the multi-device environment. The second operation includes enabling functionality of at least one of the mobile terminals to control the information detail of at least one of the mobile terminals in the multi-device environment. A first mobile terminal of the mobile terminals of the multi-device environment may control the information detail level for the first mobile terminal and the first mobile terminal may also control the information detail level of each of the remaining mobile terminals in the multi-device environment.
An example embodiment of the present invention is illustrated in FIG. 4 which depicts the multi-device environment of FIG. 3 with the first mobile terminal 310 operable to control the information detail level depicted on the display 312 of the first mobile terminal 310. As illustrated, the first mobile terminal 310 has been elevated or raised off of the substantially coplanar surface on which the remaining mobile terminals 320, 330, and 340 are situated, along arrow 410 (e.g., in the direction perpendicular to the plane of the figure). The motion of the first mobile terminal 310 may be recognized by an accelerometer (such as sensor 49) or other sensor. Optionally, the multi-device environment may be able to detect and determine the location of each mobile terminal relative to one another through various sensors or radio-frequency locating. In response to the motion of the first mobile terminal 310 "up" from the substantially coplanar surface (or the locational change as determined by the multi-device environment), the presented image may be altered accordingly. In the illustrated embodiment, the image presented on the display 312 of the first mobile terminal 310 is "zoomed in" or the scale of the image is changed (e.g. magnified) in response to the motion detected. The level of zoom or magnification (e.g., 1.5 times the original size or ten times the original size) may be dependent upon a dynamic property of the motion of the first mobile terminal 310, such as the speed at which the motion occurred or the degree to which the first mobile terminal 310 was elevated away from the substantially coplanar surface on which the other mobile terminals 320, 330, 340 are situated. For example, a rapid motion may cause a large factor of zoom (e.g., five times original size) whereas a slow motion may cause a smaller factor of zoom (e.g., two times the original size). The level of position change may also influence the zoom-factor. For example, raising the first mobile terminal 310 six inches from the surface may result in a zoom factor of two times the original size whereas raising the mobile terminal 310 twenty inches from the surface may result in a zoom factor of ten times the original size. Returning the first mobile terminal 310 to the substantially coplanar surface may restore the image to the originally scaled size, or a zoom factor of one.
Another example embodiment of the present invention is illustrated in FIG. 5 which depicts the multi-device environment of FIG. 4, with the first mobile terminal 310 operable to control the information detail level depicted on the display of the first mobile terminal 310. The illustrated example depicts the functionality illustrated in FIG. 4 of the first mobile terminal depicting a zoomed-in portion of the image on the display 312 of the first mobile terminal 310; however, in the embodiment of FIG. 5, the first mobile terminal has further been moved laterally relative to the other mobile terminals 320, 330, 340. The lateral motion of the mobile terminal along arrows 510, 520 may be determined by the mobile terminal 310 in the same manner that the initial motion along arrow 410 was detected. An accelerometer such as sensor 49 may determine the motion and translate the motion into an electrical signal used by the processor to interpret the motion, or the multi-device environment may determine the location change of the first mobile terminal 310 relative to the other mobile terminals 320, 330, 340. The motion along arrows 510 and 520 may be interpreted as a panning motion to pan around the image depicted on the displays 312, 322, 332, 342 of the mobile terminals 310, 320, 330, 340. In the illustrated embodiment of FIG. 5, the image presented on the display 312 of the first mobile terminal 310 may include a portion of the image not previously presented on the first mobile terminal 310. The depicted image includes at least a portion of the image previously depicted on the display 332 of another mobile terminal 330. In the depicted embodiments of FIGS. 4 and 5, the images presented on the displays 322, 332, and 342 of the respective mobile terminals 320, 330, and 340 remain unchanged in response to the motion of the first mobile terminal 310; however, the images of the mobile terminals that are not being moved may be responsive to the motion of the first mobile terminal 310 as described further below. Returning the first mobile terminal 310 to the original location relative to the other mobile terminals 320, 330, and 340, may restore the image to the originally presented image as depicted in FIG. 3.
FIG. 6 illustrates an example embodiment of a multi-device environment including three mobile terminals 710, 720, 730, arranged side-by-side on a substantially coplanar surface. The displays 712, 722, 732 of the mobile terminals each present a portion of an image. The image is rendered across all three displays 712, 722, and 732 creating a larger display than available on a single mobile terminal. FIG. 7 depicts the third mobile terminal 730 as raised from the substantially coplanar surface along arrow 750, in a direction substantially perpendicular to the figure. While the image presented on the display 732 of the third mobile terminal 730 becomes a zoomed-in version of the original image, the mobile terminals 710, 720 remaining on the substantially coplanar surface are changed to reflect the removal of the third mobile terminal 730 from the surface. In the illustrated embodiment, the image is redistributed across the mobile terminals 710, 720 remaining on the surface. Thus, the mobile terminals 710, 720, while not having been moved, reflect a change in the presented image in response to the third mobile terminal 730 being moved.
FIG. 8 illustrates another example embodiment of the present invention with a mobile terminal 810 operational in a multi-device environment consisting of the first mobile terminal 810 and four other mobile terminals 820 arranged in a tiled pattern. In the depicted embodiment, the first mobile terminal 810 shows on the display 812 the same image that is depicted on the four combined displays 822 of the other mobile terminals 820. In the illustrated embodiment, the first mobile terminal 810 may be resting on the same surface as the other mobile terminals 820, or optionally, the first mobile terminal 810 may be held by a user. FIG. 9 illustrates the first mobile terminal as moved in an upward direction either by a user raising the mobile terminal from the surface or simply elevating the first mobile terminal 810 from a previous location. The image presented on the display 812 of the first mobile terminal 810 may remain unchanged while the image presented across the joined displays of the other mobile terminals 820 in the multi-device environment may be responsive to the motion of the first mobile terminal 810 and may be cause to present a zoomed-in version of the previously presented image. Optionally, the first mobile terminal 810 may present the same zoomed-in image as presented across the joined displays 822 of the other mobile terminals 820. Further, the first mobile terminal may detect motion in a lateral plane, such as along arrows 830 and 840 which may effect a panning motion to pan around the image presented across the joined displays 822 of the other mobile terminals 820. The panning motion may or may not result in a panning of the image presented on the display 812 of the first mobile terminal 810. Optionally, an area 815 may be illustrated within the image presented on display 812 indicating the area of the original image which is currently presented across the displays 822 of the other mobile terminals 820.
FIG. 10 illustrates a further implementation of example embodiments of the present invention in which a data object may be expanded in response to a user input motion to a mobile terminal. In the illustrated embodiment, three mobile terminals 910, 920, and 930 each present a data object on their respective displays 912, 922, 932. The data objects may contain more information than may be depicted on the displays of the mobile terminals such that interaction may be necessary to view all of the information available for any particular data object. FIG. 11 illustrates the third mobile terminal 930 in an elevated position relative to the other mobile terminals 910, 920. The motion of elevating the mobile terminal as detected by a sensor, such as an accelerometer, or the location determined by the multi-device environment, may cause the third mobile terminal 930 to present greater detail regarding the data object which had previously been shown on the display 932. This greater detail may be referred to as "semantic zoom" or "logical zoom" wherein the scale of the object may or may not be altered as with the scaled zooming of an image, but the level of detail shown may be increased. Such expanded detail may be useful in applications such as mind maps, presentation slides, text documents (e.g., in "outline view" in Microsoft Word®, games, and other applications that contain hierarchical data objects that may be expanded and collapsed. The image presented on the display 932 of the raised mobile terminal 930 of FIG. 11 shows an expanded view with more detail than that of the image presented on the display 932 of the mobile terminal 930 resting on the surface with the other mobile terminals 910, 920.
Example embodiments of the present invention may include a dominant mobile terminal which controls the images presented on each of the mobile terminals in the multi-device environment. The dominant mobile terminal may be determined at the time the multi-device environment is created. For example, when the multi-device environment is created through contact of the mobile terminals or through the pairing of mobile terminals, the first mobile terminal to initiate a join event with another mobile terminal may be considered the "dominant" mobile terminal and may then be the mobile terminal used to control the information detail depicted on the displays of each of the other mobile terminals. Alternatively, the dominant mobile terminal may be whichever mobile terminal in a multi-device environment experiences a stimulus that causes a change in the images presented on the displays of the other mobile terminals, such as any mobile terminal which is moved from its location within the multi-device environment. In an example embodiment where more than one mobile terminal is moved relative to the other mobile terminals in a multi-device environment, the first mobile terminal moved may remain the dominant mobile terminal or, optionally, the most recently moved mobile terminal may become the dominant mobile terminal. Each of these methods for determining the dominant mobile terminal in a multi-device environment may be user configurable by the mobile terminals in such a multi-device environment or the mobile terminals within a multi-device environment may be governed by a set of rules generated for a multi-device environment based upon the application used in the multi-device environment. For example, an image display application, when used in a multi-device environment, may include few, simple rules for determining the dominant mobile terminal, while a multi-device environment operating a spreadsheet program may have more complex rules requiring a single dominant mobile terminal to properly perform the spreadsheet application in the multi-device environment.
The joining of mobile terminals in a multi-device environment can be accomplished in a number of possible ways. Example embodiments of joining devices may include where mobile terminals are physically "bumped" together, where the "bump" is detected by, for example, microphones or accelerometers. Other methods for joining mobile terminals may include a pinch gesture across the displays of multiple mobile terminals. Further example embodiments may detect mobile terminals to be joined by RFID readers and tags, or infrared transmitters and receivers attached to the edges of a mobile terminal, for example. Optionally, more generic position tracking technologies may be used such as, for example ultrasound or radio technologies.
Determining the spatial arrangement of multiple mobile terminals in a multi-device environment may be accomplished via interpretation of a gesture or a touch of the display of a mobile terminal. For example, a continuous circle gesture performed across the displays of multiple mobile terminals may indicate the physical arrangement of the mobile terminals relative to one another and may further indicate the "dominant" mobile terminal based upon the starting location of the gesture. The motion of the gesture may connect the displays of the mobile terminal in the multi-device environment, set the physical arrangement of the mobile terminals relative to one another, and set the order of the mobile terminals in applications requiring turn-based access to content items (e.g., providing a hierarchy).
FIG. 12 depicts an example embodiment of a multi-device environment in which a finger 610 has made a circular gesture along arrow 620 across the displays of four mobile terminals. The illustrated gesture began at mobile terminal 611 and continued across the displays of mobile terminal 612 and 613 before ending at 614. In the illustrated embodiment, the device location and order of the mobile terminals may have been indicated by the gesture.
FIG. 13 illustrates another example embodiment of a multi-device environment in which a finger 640 has indicated an order of the mobile terminals by touching, in order, mobile terminals 631, 632, 633, 634, 635, and 636. The mobile terminals of FIG. 13 may include the ability to determine their locations relative to one another such that the touch of the mobile terminals serves to set the order of the devices rather than to determine physical location. Based upon the touch gestures of mobile terminals 631-636, mobile terminals 637 and 638 may recognize the clockwise circular motion and determine their order in the multi-device environment without requiring a touch gesture.
While the above example embodiments have been described with respect to a multi-device environment, further example embodiments of the present invention may be used with a single mobile terminal. For example, a mobile terminal may be on a surface or held by a user presenting an image on the display of the mobile terminal. In response to the mobile terminal being moved, for example, in an upward direction, the image presented on the mobile terminal may become zoomed-in. Further, the panning operation described above with respect to FIG. 5 may be operable when in the display of the mobile terminal is presenting the zoomed-in version of the image. Such an example may function in the same way as the first mobile terminal in the example described with respect to FIGS. 3-5; however, no additional mobile terminals may be necessary.
FIGS. 14 and 15 are flowcharts of systems, methods and program products according to example embodiments of the invention. The flowchart operations may be performed by a mobile terminal, such as shown in FIG. 2, as operating over a communications network such as that shown in FIG. 1. It will be understood that each block of the flowcharts, and combinations of blocks in the flowcharts, may be implemented by various means, such as hardware, firmware, processor, circuitry and/or other device associated with execution of software including one or more computer program instructions. For example, one or more of the procedures described above may be embodied by computer program instructions. In this regard, the computer program instructions which embody the procedures described above may be stored by a memory device of an apparatus employing an embodiment of the present invention and executed by a processor in the apparatus. As will be appreciated, any such computer program instructions may be loaded onto a computer or other programmable apparatus (e.g., hardware), such as depicted in FIG. 2, to produce a machine, such that the resulting computer or other programmable apparatus embody means for implementing the functions specified in the flowchart block(s). These computer program instructions may also be stored in a computer-readable memory that may direct a computer or other programmable apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture the execution of which implements the function specified in the flowchart block(s). The computer program instructions may also be loaded onto a computer or other programmable apparatus to cause a series of operations to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide operations for implementing the functions specified in the flowchart block(s).
Accordingly, blocks of the flowchart support combinations of means for performing the specified functions, combinations of operations for performing the specified functions and program instruction means for performing the specified functions. It will also be understood that one or more blocks of the flowchart, and combinations of blocks in the flowcharts, can be implemented by special purpose hardware-based computer systems which perform the specified functions, or combinations of special purpose hardware and computer instructions.
An example embodiment of a method of the present invention in which a device may control information detail in a multi-device environment is depicted in the flowchart of FIG. 14. A processor may direct presentation of a first image on a display of a device configured to operate in a multi-device environment at 1210. A motion of the device may be detected at 1220 by, for example, a sensor such as an accelerometer. A change of an image presented on the display may be directed from the first image to a second image in response to the detection of motion of the device at 1230. The first image displayed on the device may be related to images displayed on other devices in the multi-device environment.
Another example embodiment of a method of the present invention in which a simple and intuitive method for combining the displays of multiple mobile terminals in a multi-device environment, and for indicating the spatial arrangement of the mobile terminals relative to one another, is depicted in the flowchart of FIG. 15. A touch may be detected at 1310. The touch may be a drag, a tap, or a combination thereof. An indication of a touch from another device in a multi-device environment may be received at 1320. An order of devices in the multi-device environment may be received at 1330 indicating the order and number of devices in the multi-device environment. Operation according to the order of devices may commence at 1340. The order of devices may be relevant for the operation of certain programs or applications, or for determining the dominant device when performing specific operations.
In an example embodiment, an apparatus for performing the methods of FIGS. 14 and 15 above may comprise a processor (e.g., the processor 40) configured to perform some or each of the operations (1210-1230 and/or 1310-1340) described above. The processor may, for example, be configured to perform the operations (1210-1230 and/or 1310-1340) by performing hardware implemented logical functions, executing stored instructions, or executing algorithms for performing each of the operations. Alternatively, the apparatus may comprise means for performing each of the operations described above. In this regard, according to an example embodiment, examples of means for performing operations 1210-1230 and/or 1310-1340 may comprise, for example, the processor 40 and/or a device or circuit for executing instructions or executing an algorithm for processing information as described above.
As described above and as will be appreciated by one skilled in the art, embodiments of the present invention may be configured as a system, method or electronic device. Accordingly, embodiments of the present invention may be comprised of various means including entirely of hardware or any combination of software and hardware. Furthermore, embodiments of the present invention may take the form of a computer program product on a computer-readable storage medium having computer-readable program instructions (e.g., computer software) embodied in the storage medium. Any suitable computer-readable storage medium may be utilized including hard disks, CD-ROMs, optical storage devices, or magnetic storage devices.
Many modifications and other embodiments of the inventions set forth herein will come to mind to one skilled in the art to which these inventions pertain having the benefit of the teachings presented in the foregoing descriptions and the associated drawings. Therefore, it is to be understood that the inventions are not to be limited to the specific embodiments disclosed and that modifications and other embodiments are intended to be included within the scope of the appended claims. Although specific terms are employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.
directing a presentation of a first image by a processor on a display of a device configured to operate in a multi-device environment;
detecting a motion of the device; and
directing a change of an image presented on the display of the device from the first image to a second image in response to detecting the motion of the device;
wherein the first image displayed on the device is related to images displayed on other devices in the multi-device environment.
2. A method according to claim 1, wherein the second image is a scaled version of the first image.
3. A method according to claim 2, further comprising scaling the second image based on at least one property of the motion.
4. A method according to claim 1, wherein each device in the multi-device environment is directed to present a portion of a complete image, and wherein the first image is a portion of the complete image.
5. A method according to claim 1, further comprising directing at least one other device in the multi-device environment to change an image presented on the display of said at least one other device in response to the detected motion of the device.
6. A method according to claim 1, wherein the motion of the device includes moving the device from a first location and wherein the method further comprises again directing presentation of the first image on the device in response to detection that the device has returned to the first location.
7. A method according to claim 1, wherein the second image is an expanded view of the first image including information not present in the first image.
8. An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to at least perform:
direct presentation of a first image on a display of a device configured to operate in a multi-device environment;
detect a motion of the device; and
direct a change of an image presented on the display of the device from the first image to a second image in response to detecting the motion of the device;
9. An apparatus according to claim 8, wherein the second image is a scaled version of the first image.
10. An apparatus according to claim 9, wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to scale the second image is based on at least one property of the motion.
11. An apparatus according to claim 8, wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to present a portion of a complete image, and wherein the first image is a portion of the complete image.
12. An apparatus according to claim 8, wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to direct at least one other device in the multi-device environment to change an image presented on the display of said at least one other device in response to the detected motion of the device.
13. An apparatus according to claim 8, wherein the motion of the device includes moving the device from a first location and wherein the apparatus is further caused to again direct presentation of the first image on the device in response to detection that the device has returned to the first location.
14. An apparatus according to claim 8, wherein the second image is an expanded view of the first image displaying information not present in the first image.
15. A computer program product comprising at least one computer-readable storage medium having computer-executable program code instructions stored therein, the computer-executable program code instructions comprising:
program code instructions for directing presentation of a first image on a display of a device configured to operate in a multi-device environment;
program code instructions for detecting a motion of the device;
program code instructions for directing a change of an image presented on the display of the device from the first image to a second image in response to detecting the motion of the device;
16. A computer program product according to claim 15, wherein the second image is a scaled version of the first image.
17. A computer program product according to claim 16, further comprising program code instructions for scaling the second image based at least on one property of the motion.
18. A computer program product according to claim 15, further comprising program code instructions to cause each device in the multi-device environment to present a portion of a complete image, and wherein the first image is a portion of the complete image.
19. A computer program product according to claim 15, further comprising program code instructions for causing at least one other device in the multi-device environment to change an image presented on the display of said at least one other device in response to the detected motion of the device.
20. A computer program product according to claim 15, wherein the motion of the device includes moving the device from a first location and wherein the computer program product further comprises program code instructions for again directing presentation of the first image on the device in response to the device being returned to the first location.
US13/099,631 2011-05-03 2011-05-03 Method, apparatus and computer program product for controlling information detail in a multi-device environment Abandoned US20120280898A1 (en)
US13/099,631 US20120280898A1 (en) 2011-05-03 2011-05-03 Method, apparatus and computer program product for controlling information detail in a multi-device environment
PCT/FI2012/050420 WO2012150380A1 (en) 2011-05-03 2012-04-30 Method, apparatus and computer program product for controlling information detail in a multi-device environment
US13/099,631 Abandoned US20120280898A1 (en) 2011-05-03 2011-05-03 Method, apparatus and computer program product for controlling information detail in a multi-device environment
US20120139947A1 (en) * 2010-12-02 2012-06-07 Sony Corporation Information processor, information processing method and program
US20130227418A1 (en) * 2012-02-27 2013-08-29 Marco De Sa Customizable gestures for mobile devices
US20140002327A1 (en) * 2012-06-30 2014-01-02 At&T Mobility Ii Llc Real-Time Management of Content Depicted on a Plurality of Displays
US20140071039A1 (en) * 2012-09-07 2014-03-13 Kabushiki Kaisha Toshiba Electronic Apparatus and Display Control Method
US20140223330A1 (en) * 2013-02-01 2014-08-07 Htc Corporation Portable electronic device and multi-device integration method thereof
US20140232616A1 (en) * 2013-02-18 2014-08-21 Disney Enterprises, Inc. Proximity-based multi-display configuration
CN104020839A (en) * 2013-02-28 2014-09-03 联想(北京)有限公司 Information processing method and device
US20140260642A1 (en) * 2013-03-15 2014-09-18 Samsung Electronics Co., Ltd. Electronic system with surface detection mechanism and method of operation thereof
US20140285399A1 (en) * 2013-03-21 2014-09-25 Polaris Financial Technology Ltd. Interactive rendering on a multi-display device
US20140355819A1 (en) * 2013-05-28 2014-12-04 Sony Corporation Device and method for allocating data based on an arrangement of elements in an image
US20140359492A1 (en) * 2013-06-03 2014-12-04 Samsung Eletrônica da Amazônia Ltda. Method and system for managing the interaction of multiple displays
CN104748737A (en) * 2013-12-30 2015-07-01 华为技术有限公司 Multi terminal positioning method and related equipment and system
US20150186029A1 (en) * 2013-12-30 2015-07-02 Samsung Electronics Co., Ltd. Multiscreen touch gesture to determine relative placement of touch screens
US20150293739A1 (en) * 2014-04-09 2015-10-15 Samsung Electronics Co., Ltd. Computing apparatus, method for controlling computing apparatus thereof, and multi-display system
CN105122780A (en) * 2014-02-11 2015-12-02 Lg电子株式会社 Electronic device and method for controlling the same
CN105340302A (en) * 2013-06-05 2016-02-17 诺基亚技术有限公司 Method and apparatus for controlling operation of a system
CN105493025A (en) * 2013-08-30 2016-04-13 三星电子株式会社 Method and system for presenting content
US20160140933A1 (en) * 2014-04-04 2016-05-19 Empire Technology Development Llc Relative positioning of devices
US9417835B2 (en) * 2013-05-10 2016-08-16 Google Inc. Multiplayer game for display across multiple devices
US20170111491A1 (en) * 2011-12-30 2017-04-20 Linkedln Corporation Mobile device pairing
WO2018039262A1 (en) * 2016-08-22 2018-03-01 Google Llc Interactive video multi-screen experience on mobile phones
US9952684B2 (en) 2013-05-09 2018-04-24 Samsung Electronics Co., Ltd. Input apparatus, pointing apparatus, method for displaying pointer, and recordable medium
US10120556B2 (en) 2012-12-07 2018-11-06 Microsoft Technology Licensing, Llc Slide to apply
US10365879B2 (en) * 2014-11-05 2019-07-30 Lg Electronics Inc. Image output device, mobile terminal, and method for controlling a plurality of image output devices
EP3025221B1 (en) * 2013-08-30 2020-01-01 Samsung Electronics Co., Ltd. Method and apparatus for providing information about image painting and recording medium thereof
US20050168399A1 (en) * 2003-12-19 2005-08-04 Palmquist Robert D. Display of visual data as a function of position of display device
US20120062475A1 (en) * 2010-09-15 2012-03-15 Lenovo (Singapore) Pte, Ltd. Combining multiple slate displays into a larger display
US8253649B2 (en) * 2008-09-02 2012-08-28 Samsung Electronics Co., Ltd. Spatially correlated rendering of three-dimensional content on display components having arbitrary positions
US7532196B2 (en) * 2003-10-30 2009-05-12 Microsoft Corporation Distributed sensing techniques for mobile devices
US20060164382A1 (en) * 2005-01-25 2006-07-27 Technology Licensing Company, Inc. Image manipulation in response to a movement of a display
TWI363559B (en) * 2006-01-17 2012-05-01 Inventec Appliances Corp
JP2008158452A (en) * 2006-12-26 2008-07-10 Oki Electric Ind Co Ltd Electronic paper, and application cooperation system using electronic paper
US20080216125A1 (en) * 2007-03-01 2008-09-04 Microsoft Corporation Mobile Device Collaboration
US8644757B2 (en) * 2008-12-04 2014-02-04 Nokia Corporation Method and system for creation and control of virtual rendering devices
US9213480B2 (en) * 2010-04-08 2015-12-15 Nokia Technologies Oy Method, apparatus and computer program product for joining the displays of multiple devices
2012-04-30 WO PCT/FI2012/050420 patent/WO2012150380A1/en active Application Filing
US9736291B2 (en) * 2011-12-30 2017-08-15 Linkedin Corporation Mobile device pairing
US9600169B2 (en) * 2012-02-27 2017-03-21 Yahoo! Inc. Customizable gestures for mobile devices
US9235373B2 (en) * 2012-06-30 2016-01-12 At&T Intellectual Property I, L.P. Real-time management of content depicted on a plurality of displays
US9224358B2 (en) * 2013-02-18 2015-12-29 Disney Enterprises, Inc. Proximity-based multi-display configuration
US9286025B2 (en) * 2013-03-21 2016-03-15 Polaris Financial Technology Ltd. Interactive rendering on a multi-display device
US10195523B2 (en) 2013-05-10 2019-02-05 Google Llc Multiplayer game for display across multiple devices
US9727298B2 (en) * 2013-05-28 2017-08-08 Sony Corporation Device and method for allocating data based on an arrangement of elements in an image
US9417836B2 (en) * 2013-06-03 2016-08-16 Samsung Eletrônica da Amazônia Ltda. Method and system for managing the interaction of multiple displays
EP3005745A4 (en) * 2013-06-05 2017-01-11 Nokia Technologies OY Method and apparatus for controlling operation of a system
EP3039530A1 (en) * 2013-08-30 2016-07-06 Samsung Electronics Co., Ltd. Method and system for presenting content
US9696958B2 (en) 2013-08-30 2017-07-04 Samsung Electronics Co., Ltd. Method and system for presenting content
US9270526B2 (en) 2013-12-30 2016-02-23 Huawei Technologies Co., Ltd. Multi-terminal positioning method, and related device and system
JP2015130669A (en) * 2013-12-30 2015-07-16 ▲ホア▼▲ウェイ▼技術有限公司 Multi-terminal positioning method, and related device and system
EP2908238A1 (en) * 2013-12-30 2015-08-19 Huawei Technologies Co., Ltd. Multi-terminal positioning method, and related device and system
EP2926464A4 (en) * 2014-02-11 2016-08-31 Lg Electronics Inc Electronic device and method for controlling the same
US10042596B2 (en) 2014-02-11 2018-08-07 Lg Electronics Inc. Electronic device and method for controlling the same
US10223060B2 (en) 2016-08-22 2019-03-05 Google Llc Interactive video multi-screen experience on mobile phones
US9436381B2 (en) 2016-09-06 Device, method, and graphical user interface for navigating and annotating an electronic document
US9355472B2 (en) 2016-05-31 Device, method, and graphical user interface for adjusting the appearance of a control
JP5676742B2 (en) 2015-02-25 Gesture graphical user interface for managing simultaneously open software applications
US10296166B2 (en) 2019-05-21 Device, method, and graphical user interface for navigating and displaying content in context
JP5883128B2 (en) 2016-03-09 Device, method and graphical user interface for controlling a touch user interface without physical touch functionality
US8972879B2 (en) 2015-03-03 Device, method, and graphical user interface for reordering the front-to-back positions of objects
US8806369B2 (en) 2014-08-12 Device, method, and graphical user interface for managing and interacting with concurrently open software applications
US10140301B2 (en) 2018-11-27 Device, method, and graphical user interface for selecting and using sets of media player controls
US10007400B2 (en) 2018-06-26 Device, method, and graphical user interface for navigation of concurrently open software applications
US9542091B2 (en) 2017-01-10 Device, method, and graphical user interface for navigating through a user interface using a dynamic object selection indicator
EP2539801B1 (en) 2018-08-22 Multi-screen dual tap gesture
US9146751B2 (en) 2015-09-29 Device, method, and graphical user interface for navigation of multiple applications
EP2769289B1 (en) 2019-09-25 Method and apparatus for determining the presence of a device for executing operations
EP2539803B1 (en) 2019-03-27 Multi-screen hold and page-flip gesture
EP2539802B1 (en) 2018-08-22 Multi-screen hold and tap gesture
TWI624781B (en) 2018-05-21 Method, apparatus and computer program product for joining the displays of multiple devices
US10222974B2 (en) 2019-03-05 Method and apparatus for providing quick access to device functionality
KR101929372B1 (en) 2018-12-17 Transition from use of one device to another
EP2539799B1 (en) 2018-05-23 Multi-screen pinch and expand gestures
US9075522B2 (en) 2015-07-07 Multi-screen bookmark hold gesture
US8751970B2 (en) 2014-06-10 Multi-screen synchronous slide gesture
US8473870B2 (en) 2013-06-25 Multi-screen hold and drag gesture
US10168882B2 (en) 2019-01-01 Device, method, and graphical user interface for switching between camera interfaces
KR101973631B1 (en) 2019-04-29 Electronic Device And Method Of Controlling The Same
KR101755029B1 (en) 2017-07-06 Device, method, and graphical user interface for forgoing generation of tactile output for a multi-contact gesture
Owner name: NOKIA CORPORATION, FINLAND
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LUCERO, ANDRES;JOKELA, TERO;HOLOPAINEN, JUSSI;AND OTHERS;SIGNING DATES FROM 20110523 TO 20110524;REEL/FRAME:026551/0140
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION


Prime lifestyle location will allow you to capitalise on this rare investment opportunity. This great family townhouse is a stroll to Terrigal Beach, The Esplanade, restaurants and cafes or Terrigal schools – all in a very quiet pocket of Terrigal. This well located and spacious property would suit both investors and the small family market. There is a fabulous floor plan with huge potential for renovate and resale, lifestyle change, or a holiday rental. With large under cover garage and plenty of parking – update and benefit from the paradise lifestyle Terrigal has to offer.


Med World Live, Inc. is excited to announce we will be launching our DROID tablet application Spring of 2014. Currently, our innovative video technology can be accessed via the web or the Med World Live iPad application in the iTunes Store. We understand mobile (tablet) access is imperative to our customers and we want DROID users to have the same 24/7 viewing opportunity as iPad users. DROID users will also have the capability to "hard-set" (local versions of their videos) to their tablets via the app store. Hard-sets allow users to run smooth streaming video and access all pertinent information without the need of internet connectivity. This proves to be extremely beneficial when users are in hospitals, tradeshows, airplanes, coffee shops, etc., where internet connectivity is typically poor.


After a long time I got an opportunity to travel by train. It was the Delhi-Howrah Rajdhani Express, which I had taken to go to Dhanbad. A train journey is always a pleasure to undertake as it showcases so much of the countryside that one passes and the people one comes across in the train itself, namely the fellow passengers and the train staff. The Rajdhani trains are in some ways brand ambassadors of the railways and hence are necessarily well maintained, have courteous and responsive staff, are generally on time and serve good food.
The fellow passengers, and the countryside that one passes, provide an excellent insight of what India is all about. As I passed towns like Tundla, Hathras, Aligarh and Ghaziabad, I recalled train journeys I had undertaken from my hometown to college hostel in Delhi and back. My sister and I, travelling from Delhi to Kanpur, or Bareilly, where my father was posted, used to look for the 'usual morning scenes' that heralded the arrival of a large town—our hometown. These early morning scenes were of people with a 'lotta' (a water vessel of brass) in their hands seated along the track. They would be seated all along the rail track. This time, returning from Dhanbad, my wife and I saw the very same scenes again, with the only change that the 'lotta' had been replaced by plastic bottles! These scenes were on show despite India having embarked on a massive programme of constructing toilets and ending open defecation by October, 2019.
The sights around the towns that one could not at all reconcile with were of huge—I mean really huge— dumps of garbage lying all along the rail track. It was a very depressing sight. Maybe open defecation is a personal habit and this may be on the wane, what with the massive public opinion campaign that has been launched. But, how can we put up with the massive pile up of garbage outside all towns? What is the public opinion build-up on this aspect of Swachh Bharat? What are the local bodies doing in response to the call of the prime minister? Has solid waste disposal become such an issue that we are waging a losing battle with it and will allow our towns and cities to succumb to diseases such as the plague, gastroenteritis and typhoid? Do we have to reach a disaster situation, as Surat had, before we pull ourselves up and launch a cleanliness drive?
Solid waste management has to become a priority area. Unless it is undertaken on war-footing and on a mission mode, I shudder at what we would be doing with the health of the community at large. Mere reliance on government activity will not help tide over the crisis situation that we face. We have to first take steps to ensure proper and scientific disposal of the accumulated garbage. This obviously can be done only by community efforts which could be through local bodies or through voluntary agencies. Protecting the environment is probably more important today than protecting one's religious beliefs. The parallel mission which does not seem to have attained the traction that is required is educating people and moulding mindsets on how we treat solid waste that emerges out of our households.
All the expenditure on corporate social responsibility, which has now been mandated by law for companies of different sizes, will bewcome useless unless we change mindsets and ensure that households henceforth maintain cleanliness outside as much as they do within. This mindset reform and responsiveness will be the key factor if India really has to emerge Swachh before the Mahatma's 150th birthday, which is the target that the nation has set for itself. Each household will have to target this mission and undertake it as its own personal household stake.


text:
Russia isn't likely to use chemical weapons in Ukraine – unless Putin grows desperate
Post on 12 April 2022 by Dave Steiger tagged: russia-ukraine-war-related
Jeffrey Knopf
This article is part of a larger Ukraine collection by CNS:
Putin's War with Ukraine: Voices of CNS Experts on the Russian Invasion
The following is an excerpt from The Conversation.
Reports emerged from Ukraine on April 11, 2022, alleging that Russia had used a drone to drop an unknown chemical agent in the besieged southern city of Mariupol.
There has been no official confirmation of these reports as of April 12. But the Pentagon has said the news reflects U.S. concern about Russia's "potential to use a variety of riot control agents, including tear gas mixed with chemical agents, in Ukraine."
A chemical weapon can be any chemical that is used to harm people, including to injure or kill them. Many substances have been used as chemical weapons. Nerve agents are the deadliest, because they require a smaller dose to be fatal.
As an expert who has studied the use of chemical weapons in Syria's civil war, I have thought since Russia first attacked Ukraine that the likelihood of Russia using chemical weapons there is low. Russia has little political or military motivation to use them and would face strong international rebuke and possible military consequences for this kind of attack.
But as recent reports might indicate, Russian use remains a possibility under certain circumstances. This is particularly true if Russian President Vladimir Putin believes chemical weapons are the only way to break a stalemate in a key battle zone.
Chemical weapons in Syria
The ongoing Syrian civil war offers the most recent example of widespread chemical weapons attacks on civilians.
There have been reports of more than 300 chemical attacks in Syria since the war began in 2012. A joint team from the United Nations and the Organization for the Prohibition of Chemical Weapons investigated some of the larger attacks, and conclusively attributed several to the Assad regime.
Continue reading at The Conversation.

redpajama_set_name: RedPajamaCommonCrawl


Fat is an essential component of our body. It must be considered as a reserve of energy which our body needs to manage its basic functions.
However, we are more and more concerned by the dangers and aesthetic issues that the excess of fat represents.
Several techniques have grown from this demand, but as of today, no one gives full satisfaction to end-users' or operators' expectations.
The only natural and non-invasive to slim on demand is to enhance LIPOLYSIS process.
Apart from healthy nutrition and physical exercise, we don't know any other technique which enables this natural way to combine our stored fat into pure energy.
For sure, a healthier diet or lifestyle will help to achieve global fat loss …. but how to target any kind of localized fat (cellulite, subcutaneous and visceral) ?


text:
Republican ag Platform Same as Four Years Ago
/ Baise / By dwight@dwightsworld.com
The Republicans renewed and adopted the party's 2016 ag platform.
There is no NEW Republican Party platform for the 2020 presidential campaign.
This much we can infer from the following written statement coming from the convention: "Resolved, That the Republican National Convention Will Adjourn Without Adopting A New Platform Until the 2024 Republican National Convention."
The Republicans instead renewed and adopted the 2016 Platform. The 2016 Republican Platform would not surprise any of the readers regarding agriculture. Even though the 2020 Democrat Platform never mentions agriculture, the Republican Platform has 6 sections; the third one in 2016, as adopted in 2020, is entitled "America's Natural Resources: Agriculture, Energy, and the Environment". For a refresher on Trump's 2016 ag campaign promises, go here.
The 2016 Platform discusses first the rebuilding of the economy and creating jobs. On page 17 of the 2016 Platform now adopted for 2020 it states "We look in vain within the Democrat party for leaders who will speak for the people of agriculture…"
The Republican Platform puts agriculture and its production might in exports as "…central to the Republican agenda for jobs, growth, expanded trade, and prosperity." After a paragraph discussion on how U.S. agriculture is the largest exporter in the world, the Platform suggests agricultural exports generates another $1.27 in business activity. The Republicans also insist that "…our global trading partners adhere to science-based standards with regard to food and health regulations."
Bogus science
The Republican Platform makes it abundantly clear the U.S. will no longer tolerate "…the use of bogus science and scare tactics to bar products from foreign markets, nor will we allow insufficient health and safety standards for products imported for our consumption."
It is clear from the team appointed by USDA Secretary Sonny Perdue (such as Steve Censky, Bill Northey, Greg Ibach, Ted McKinney and Scott Hutchins) took this commitment to heart. Even in 2016, and again in 2020 the Republican Platform recognizes the problem our dairy producers face. The President and his team worked hard to stop Canadian policies which harmed American dairy producers.
Regulatory burdens
The 2016 and now 2020 Platform did not overlook the regulatory burdens imposed by EPA and USDA on America's farmers. The Platform makes it clear "This regulatory impulse must be curbed, not on a case-by-case basis, but through a fundamental restructuring of the regulatory process." The Platform goes on to detail the attack by EPA regarding water found on farms and ranches. The Platform is critical of the "Waters of the United States" (WOTUS) Rule and called it a "travesty".
The Platform for 2016 and 2020 states that unelected bureaucrats must be stopped. In fact, it is stated "We must never allow federal agencies to seize control of state waters, watersheds, or groundwater." Because the President of the United States has implemented this section of the 2016 campaign, it could have been left out of the 2020 Platform.
The Platform of 2016 also addressed the Supplemental Nutrition Assistance Program (SNAP). It is stated that the Democrat administration removed nearly all of the work requirements for able-bodied adults. Republicans said they would restore these able-bodied adult provisions and have attempted to do so.
The Platform says that USDA's National Forests are worsening in health. Republicans in 2016 and 2020 state they will attempt to properly manage the forests and produce more jobs in the timber industry. Notwithstanding the California wildfires, the Republicans say they believe "…in promotive active, sustainable management of our forests…"
The Republicans could do little in 2020 to improve upon on what they said in 2016. It is no wonder they decided to copy in 2020 what was said in 2016 for agriculture. Republicans made agriculture a priority in 2016 and again in 2020! Not so for Democrats!
Note: Gary Baise organized President Trump's agricultural team of advisers.


text:
Whistleblowing, Governance and Regulation Before the Financial Crisis: The Case of HBOS
Ian P. Dewing & Peter O. Russell
Journal of Business Ethics 134 (1):155-169 (2016)
Following the financial crisis of 2008, the Treasury Committee of the UK House of Commons undertook an inquiry into the lessons that might be learned from the banking crisis. Paul Moore, head of group regulatory risk at Halifax Bank of Scotland during 2002–2005, provided evidence of his experience of questioning HBOS policies which resulted in his dismissal from HBOS. The problems that surfaced at HBOS during the financial crisis were so serious that it was forced to merge with Lloyds TSB, another UK bank, to form the Lloyds Banking Group in which the government took a significant stake. Moore's evidence to the Treasury Committee revealed that long before the financial crisis, he had raised major concerns with the management of HBOS and with the Financial Services Authority, the UK financial services regulator. Moore's evidence led to the submission of further disclosures, replies and rejoinders as evidence to the Treasury Committee. Moore's case is therefore of considerable interest to researchers of whistleblowing because it is a rare instance of high-level whistleblowing, the details of which subsequently entered the public domain. The information revealed in evidence to the Treasury Committee sheds light on the process of whistleblowing in the context of the governance and regulation of a major UK bank that subsequently had to be rescued by government intervention during the financial crisis. The paper makes a contribution to the wider literature on whistleblowing, and to a greater understanding of aspects of the financial crisis.
ISBN(s)
From the Publisher via CrossRef (no proxy)
link.springer.com (no proxy)
Organizational Dissidence: The Case of Whistle-Blowing. [REVIEW]Janet P. Near & Marcia P. Miceli - 1985 - Journal of Business Ethics 4 (1):1 - 16.
Whistleblowing: A Restrictive Definition and Interpretation. [REVIEW]Peter B. Jubb - 1999 - Journal of Business Ethics 21 (1):77 - 94.
The Credit Crisis and the Moral Responsibility of Professionals in Finance.Johan J. Graafland & Bert W. van de Ven - 2011 - Journal of Business Ethics 103 (4):605-619.
Whistle Blowers: Saints of Secular Culture. [REVIEW]Colin Grant - 2002 - Journal of Business Ethics 39 (4):391 - 399.
The Credit Crisis and the Moral Responsibility of Professionals in Finance.Johan J. Graafland & Bert W. Ven - 2011 - Journal of Business Ethics 103 (4):605-619.
View all 9 references / Add more references
Whistleblowing and Power: A Network Perspective.R. Guy Thomas - 2020 - Business Ethics: A European Review 29 (4):842-855.
Dealing Fairly with the Costs to the Poor of the Global Financial Crisis.Christian Barry & Matthew Peterson - 2010 - In Iain MacNeil & Justin O'Brien (eds.), The Future of Financial Regulation. Hart.
Ethics, Corporations, and Governance.Wesley Cragg & Dirk Matten - 2011 - Journal of Business Ethics 102 (S1):1-4.
The Politicisation of Whistleblowers: A Case Study.Tina Uys - 2000 - Business Ethics 9 (4):259–267.
Informality and Institutional Inertia: The Case of Japanese Financial Regulation.Jennifer A. Amyx - 2001 - Japanese Journal of Political Science 2 (1):47-66.
Instytucjonalizacja whistleblowingu w firmie jako wyzwanie etyczne.Anna Lewicka-Strzałecka - 2014 - Diametros 41:77-98.
The Financial Crisis and Corporate Governance Reform.Harilaos Mertzanis - 2011 - International Journal of Business Governance and Ethics 6 (1):83-109.
Do Variations in the Strength of Corporate Governance Still Matter? A Comparison of the Pre- and Post-Regulation Environment.Nancy Harp, Mark Myring & Rebecca Toppe Shortridge - 2014 - Journal of Business Ethics 122 (3):1-13.
Crisis as a Catalyst for Federal Regulation in Financial Markets: The Rise of the Consumer Financial Protection Bureau.Kyle C. Worrell - 2010 - Nexus - Chapman's Journal of Law & Policy 16:195.
Privatizing Regulation: Whistleblowing and Bounty Hunting in the Financial Services Industries.Henry Ordower, James Fisher, Ellen F. Harshman, William Gillespie, Leland Ware & Fred C. Yeager - unknown
The Intellectual Origins of the Global Financial Crisis.Roger Berkowitz & Taun N. Toay (eds.) - 2013 - Fordham University Press.
Editorial Introduction to the Symposium on the Global Financial Crisis.Sam Ashman - 2009 - Historical Materialism 17 (2):103-108.
The Corporate Psychopaths Theory of the Global Financial Crisis.Clive R. Boddy - 2011 - Journal of Business Ethics 102 (2):255-259.
Using Inside Job to Teach Business Ethics.Ernest N. Biktimirov & Don Cyr - 2013 - Journal of Business Ethics 117 (1):209-219.
Convergence of Corporate Social Responsibility and Corporate Governance in Weak Economies: The Case of Bangladesh.Mia Mahmudur Rahim & Shawkat Alam - 2014 - Journal of Business Ethics 121 (4):1-14.
¿Crisis Económica o Crisis de Valores?: Una Propuesta Axiológica.José María Méndez - 2012 - Sepha Edición y Diseño.
14 ( #676,014 of 2,401,864 )


full size of templates:lovely free ivory graduation invitations themes templates with green magnificent inspirational . graduation advertising bundle. summer pool party invitation templates summer party invitation wording samples . full size of templates:inexpensive green graduation invitations with silver magnificent speach card high definition . full size of templates:simple green graduation invitations with green hd size speach nice looking . graduation congratulations template printable an error occurred. full size of templates:logo de graduation together with graduation logo 2015 in conjunction with . 20 elegant walmart photo graduation invitations. samples of graduation invites.


If you own a booth or brick and mortar shop and would like to carry our products....drop us a line! hello@pixiedustpaints.com (please no online retailers).
In order to remain an active stockist on this list the retailer must have been active (placed an order) in the past 12 months.