Yesterday, the annual Fantasy Fest was drawing to a close, but countless visitors and locals will not forget several terrible accidents which caused Overseas Highway to be shutdown for several hours by police.
During the last weekend of the festivities in Key West, Florida Highway Patrol and numerous Sheriff's Deputies responded to more than 21 motor vehicle accidents. One of them involved the collision of a motorcycle with another car at mile marker 29.5 in Big Pine Key. One of the two people on the motorcycle was severely injured and rushed to Fishermen's Hospital in Marathon where he was pronounced dead. The second occupant was flown to Miami by helicopter for further medical treatment.
Several hours earlier, two vehicles collided at mile marker 41 on the seven-mile bridge, which required the emergency rescue and transport to three people to Fishermen's Hospital.
Over the years, the road to and from Key West has seen thousands of car accidents, with many resulting in fatalities. The causes for these crashes are often times attributed to speeding, alcohol, or texting. A study has revealed that between 2006 and 2010, Monroe County averaged 1,329 car accidents every year. Also, in the last 34 years, ending in 2009, the number of fatal car accidents throughout the county of Monroe was drastically higher than the average for the rest of the state of Florida. In the past ten years, there have been more than 220 fatal accidents in Monroe County.
Leesfield Scolaro have established their offices in Key West over three decades ago and have been a staple in the personal injury landscape in Key West and throughout the Florida Keys.
The Key West Personal Injury Lawyers of Leesfield Scolaro have resolved countless personal injury claims on behalf of local Key Westerners and out of state visitors who were injured during their stay in the Florida Keys.
If you have been injured in a car accident in Key West, or on Overseas Highway, contact one of our Key West Personal Injury Attorneys at 1-800-836-6400 for a free consultation.
Tagged: "Alexander Perkins", "Florida Keys", "Ira H. Leesfield", "Key West Personal Injury Attorneys", "Key West Personal Injury Lawyers", "key west", "Leesfield & Partners", "Monroe County Sheriff's Office", "Monroe County", "Overseas Highway" and "Thomas Scolaro"


text:
Raising EU Productivity: Lessons from Improved Micro Data
The goal of MICROPROD is to contribute to a greater understanding of the challenges brought about in Europe by the fourth industrial revolution and the associated 'productivity puzzle' in a context of globalisation and digitisation, and to provide alternative policy options to better address these challenges.
Thereby the group takes a holistic view of the productivity puzzle, with the aim of understanding the microeconomic drivers behind it, as well as its macroeconomic implications for growth and cohesion in the European Union.
IWH press release on the occasion of the project's announcement.
MICROPROD website
Funding Institution: European Commission (Horizon 2020)
Funding Period: 2019-2021
Coordinator: IWH
Project Partners: Bruegel Institute of Economics, Free University Amsterdam, Aarhus University, Centre for Economic and Regional Studies of the Hungarian Academy of Sciences, Federal Statistical Office of Germany, Bocconi University, Paris School of Economics, University College London
Research Group: Innovation, Productivity, and Economic Dynamics
Professor Dr Steffen Müller
Dr Viktor Slavtchev
Research Group Head

redpajama_set_name: RedPajamaCommonCrawl


We love shopping for great items for our home and happy to list out for you the best pc games you can possibly find today.
There are lot's of different elements we checked when we made our top lists for the best pc games. we choose to go mostly with known and proven brands that have hundreds of glowing reviews.
Stronghold 2 - The King, having fled after the defeat of his own armies, is now attempting to rule his country from a secret location. Powerful barons are jostling for what is fast becoming a disintegrating kingdom, and it is up to you to stem the tides of their ambition and unite the land again under the King.
Stronghold Crusader and Stronghold Crusader Extreme - Journey to distant Arabian lands and lead a determined group of Crusaders. Relive the historic Crusades in four campaigns as Richard the Lionheart and Saladin, the Sultan of Syria. Stronghold Crusader Extreme adds 20 new missions, new buildings and larger armies of 10,000 troops.
What to pay attention to when buying a new pc games?
Good things about buying a new pc games on Amazon is that you can look and compare reviews of shoppers just like you that already tried using the product.we highly recommended you take a close look for the reviews and see if this pc games fit your specific needs.
How long should the warranty be when buying pc games?
Always Choose a pc games that comes with a reasonable warranty. If something breaks, the warranty protects you from having to buy a brand new shower head. You just need to take it to the service center to have the product repaired or replaced. Most manufacturers offer a 2-year warranty.
What are the ranking factors you used to make your best pc games list?
They are honestly too long to mention, we looked into all aspects of the specific pc games we could find! starting from reviews, price, features and others. trying to find the very best pc games is hard this days when so many different brands are fighting for our money.(it's a good problem to have though.
What should be price range for a good pc games?
price is a thing you should consider when buying a new pc games. However, it shouldn't be the biggest influencing factor. A high price tag doesn't always equate to the best product. Similarly, a lower price doesn't always mean the product is inferior to more expensive purchases. Look beyond the numbers and focus on the features of the shower head as well as the quality of materials. These things give you a better picture as to how much value the product truly offers.
What is the refund policy when buying a pc games?
Amazon have a great refund policy if there anything wrong with your new pc games buy in any case we suggest you read carefully the guaranty offered by each specific merchant and make a smart buying decision. as a general rule you can buy with confidence at the Amazon market place.
Is it a wise idea buying pc games online?
Personally I do most of my shopping online and buying pc games is no difference to me. it's so easy seeing all the different reviews, comparing different products and making a wise buying decision.


This week's students caught on campus by LS Fashion Photographers sure did show that you can look hot even when temperatures are below freezing.
Comment: Carnage theme is "blatant and insensitive"
There are two obvious problems with the 'Pimps n Hoes' carnage theme. Firstly, the dichotomy of 'Pimps n Hoes' is an obviously gendered power imbalance – it represents the idea that men are directly in control of a woman's sexuality.


text:
Rand Paul Stands Alone Against Senate Preemptive War Resolution For Iran
The US Senate passed a resolution 90-1 to prevent Iran from acquiring nuclear weapons with Rand Paul arguing it was a de-facto declaration of war.
RT – The US Senate voted 90-1 early Saturday on a non-binding resolution to prevent Iran from acquiring nuclear weapons. Voting against the resolution was Sen. Rand Paul, arguing that the bill was a de-facto declaration of war.
The measure, which was introduced several months ago by Senators Lindsey Graham, Bob Casey and Joe Lieberman, supports continuing to pressure Iran to suspend its uranium enrichment program. The resolution advocates using methods other than containment to stop Iran, including exerting economic and diplomatic pressure. Senate Joint Resolution 41 "rejects any United States policy that would rely on efforts to contain a nuclear weapons-capable Iran." Senators expressed their fears regarding Iran's nuclear capabilities.
"We know that Iran would create access for terrorists – access for them – to these nuclear weapons, making the Middle East a nuclear tinbox," Sen. Richard Blumenthal said before the Senate. "We cannot trust this regime. We know that fact beyond any potential doubt."
The bill states that it should not be misinterpreted as an endorsement for military force or war. But as the only senator to vote against the resolution, Paul argued that the resolution would eventually lead to war with Iran.
"A vote for this resolution is a vote for the concept of preemptive war," Paul said before the Senate.
Passage of the resolution comes at a time when Israeli Prime Minister Benjamin Netanyahu, has been pressuring the US for an answer as to what would prompt a US-led military strike against Iran.
Currently, the US is already imposing tough sanctions on Iran to limit its oil sales, hurt its economy and make it problematic for Iran to finance its nuclear enrichment program.
Iran has continuously insisted that its nuclear program is entirely for peaceful, civilian ends.
Stay up to date with the latest news:
Twitter: https://twitter.com/#!/kr3at
Facebook: http://facebook.com/alexhiggins732
Google Plus: https://plus.google.com/u/0/109380553668797565914
LIVE TV And Videos: Higgins TV
Website: The Alexander Higgins Blog
Headlines: Real-time News Headlines
Categories:	US NEWS
Vets Being Round Up Nationwide, People Everywhere Just Disappearing
NASDAQ Breaks 3000, Ignores Doom and Gloom
Air Force's Hypersonic Test Fails
Help Repeal The NDAA – Start A Local PANDA Chapter
New LAPD Police Policy – Report Normal Activities As Possible Terrorism
Overheard on CNN.com: Readers Respond to Birth Certificate
Petition To The President: Free Marine Vet Brandon Raub
Video: South Dakota Partners With Big Pharma To Prey On Native Americans In Genocidal Campaign To Increase Revenues


Normal faults grow via a sympathetic increase in their displacement and length ('isolated model') or by rapid establishment of their near-final length prior to significant displacement accumulation ('constant-length model'). The isolated model has dominated the structural geology literature for >30 years, although some 3D seismic data-based studies support the constant-length model. Because they make different predictions regarding rift development, and earthquake size and recurrence intervals in areas of continental extension, it is critical to test these models with data from natural examples. Here we outline a range of techniques that constrain the kinematics of synsedimentary normal faults and thus test competing fault growth models. We then apply these techniques to three seismically imaged faults, showing that, in general, they grew in accordance with the constant-length model, although periods of relatively minor tip propagation and coeval displacement accumulation, characteristics more consistent with the isolated model, also occurred. We argue that analysis of growth strata represents the best way to test competing fault growth models; most studies utilizing this approach support the constant-length fault model, suggesting it may be more widely applicable than is currently assumed. It is plausible that the very early development of large faults is, however, characterized by the development of faults that, pre-linkage, grow in accordance with the isolated model; we may simply lack the data resolution, especially in the subsurface, to resolve this very early stage of fault growth.


Friday, 16 Aug 2019 at 4:00 PM .
3. Your payment credit or debit card is your ticket. The cardholder must be present and attend the performance. All members of the party should enter the venue at the same time.
4. Your ticket/s will IMMEDIATELY BECOME INVALID if resold OR OFFERED FOR SALE unless the sale is through the official re-sale channels advertised.
i) The payment credit or debit card used for the purchase and shown on the booking confirmation as it is your ticket/s. ii) The booking confirmation. iii) A valid photo ID matching the customer name on the booking confirmation and the credit card.
6. Ticket sales are limited to a maximum of four tickets per person.
Customers who require either a carer to accompany them or disabled access to the shows should visit Alt Tickets on the dedicated website at http://alt.tkts.me/edaccess.


text:
Q: What is recommended coding style for conditional operator in Python? The following line is part of my code. I may be wrong, but it seems to be pythonic enough to me. However it is not clear, at first sight, what exactly it means. Is there a better code layout that would make it clearer? _idName is either a function or a DataFrame.
while  id1!="cancel" and ((id1 not in _idName.id.values)
        if isinstance(_idName,_pd.DataFrame) else (_idName(id1) is None)):
    do something with the variables evaluated in the condition

A: The layout of your code does indeed make it pretty unclear what's going on.
At a minimum, I would be inclined to line break after the binary operators and and or, per the style guide, rather than in the middle of a single condition.
I would also try to keep a ternary on a single line, where possible; in this case that ends up being quite long, though, so probably not an option. I think the boolean operators in the ternary make more sense at the start of their line, although I can't find a reference for this (beyond "Martijn likes it too").
One more readable example:
while (id1 != "cancel" and
       ((id1 not in _idName.id.values) if isinstance(_idName, _pd.DataFrame)
        else (_idName(id1) is None))):

or perhaps:
while (id1 != "cancel" and
       ((id1 not in _idName.id.values)
        if isinstance(_idName,_pd.DataFrame)
        else (_idName(id1) is None)):

A: Create a small function that does the checking for you, then use that in the while statement.
def check_whatever(id1, _idName):
    if id1 == 'cancel':
        return False

    if isinstance(_idName,_pd.DataFrame):
        return id1 not in _idName.id.values:
    else:
        return _idName(id1) is None

while check_whatever(id1, _idName):
    do_stuff()

redpajama_set_name: RedPajamaStackExchange


Welcome to 8tracks radio: free music streaming for any time, place, or mood. tagged with self mix, indie, and rock. You can also download one of our free apps to enjoy internet radio on your favorite device.
* i am out with lanterns, looking for myself.


High Efficiency of Heat transfer plates,Wide distribution pattern are some of the quality characteristics of our Products. It helps our customer high productivity by reducing the down time.
With firm commitment to quality, we are manufacturing, supplying, distributing, importing and exporting a comprehensive range of Brazed Plate Heat Exchangers. High quality material that is sourced from vendors of high repute after scouring the market is used in the manufacturing process. Post-production, we inspect these products on certain parameters of quality to ensure their defect-free nature.
In order to fulfill the ever changing demands of our clients, we have been engaged in offering a quality range of Semi Welded Plate Heat Exchangers. The offered range comprises plates that are welded using advanced laser welding techniques and other channels are gasketed. To ensure their flawlessness, we inspect these rigorously on certain well-defined parameters of quality.
We can offer quality Replacement spares for GEA Ecoflex PHE -- Both PHE plate and Gasket.
Gaskets : NBR, HT NBR, HNBR, EPDM, Viton.
We offer CIP pump for heat exchanger cleaning. This is skid mounted system with PH indicator and heater for heating the chemicals.
Cleaning in place is a cleaning procedure without dismantling the plates from frame and circulating preselected cleaning agent in the reverse direction and then draining of the cleaning agent, if necessary rinsed with water.
needed for opening & cleaning.
Saves Cost as CIP prolongs life of gaskets in case of Gasketted PHE.
We can support in delivery of both single and multi-stage freshwater distillers, the choice of which depends on the intended application and whether it is going to be installed on board a vessel or on a rig.
Single-stage freshwater distillers require a relatively large amount of energy to operate, but are less expensive than their multi-stage counterparts. They are a common choice for vessels, as the engines on board produce large amounts of excess heat which can be utilized in the single-stage freshwater distillers, resulting both in the production of freshwater as well as the disposal of unwanted heat. The excess energy is thus put to good use and benefits the entire vessel, making single-stage freshwater distillers an obvious choice.
Multi-stage freshwater distillers, on the other hand, are more expensive but produce more freshwater and require less energy. The energy from the evaporation process is reused multiple times making multi-stage solutions ideal for rigs and other offshore platforms that do not generate excess heat and must instead actively produce energy. This way, the larger investment pays off in the long run with reduced energy costs for operation and increased freshwater production.


In order to compare crop data with other users, one user creates a module crop group.
This user is the administrator of the module crop group.
Users who wish to compare data will each have the same module available to them. For example: all users will have a module "Tomato Climate" for comparing.
The administrator of the crop group can be a user who does not have any modules. In this way, for instance, a crop advisor can create a module crop group, without actually making (climate) data available him/herself, and thus only look at it together with the rest of the group.
Users that are invited need a current e-mail address, with which they can receive the invitation to the module crop group.
Click on " Add crop groups" in the "Crop groups " menu on the left.
Select the year for which you want to create the crop group.
Enter a name for the crop group, for example: "Association1 Tomatoes robust"; When you would like to compare several crop phases, then you should create a crop group for every crop phase. This last applies, for example, for Phalaenopsis. For instance, in this case, you create four module crop groups, namely: "Studyclub2 Growing 1", "Studyclub2 Growing 2", "Studyclub2 Cooling" and "Studyclub2 Finishing".
You then create the "Studyclub2 Growing 1" in this screen.
Then select the modules you want to compare with other users. In addition to your Climate module you can compare several modules at the same time. For example, select your Phalaenopsis Climate module and Meteo module here.
You will find the button "Save" below. Click on this.
You have created a module crop group.
The next step shows you how to invite members.
If desired you can learn more about this in the article Invite members to module crop group.


Apparently, it's been Slipknot frontman Corey Taylor's life goal to sit on the panel of the BBC show QI. After appearing on Radio 4's Museum Of Curiosity and podcast No Such Thing As Fish, he finally got his wish. This isn't some new aim he's given himself when he's bored in the back of the Slipknot tour bus, though. In 2013, he went so far as making it one of his New Year's resolutions. Here's some quite interesting things he – and we – learnt from him achieving his goal.
The loudest noise recorded in the Guinness Book Of Records is, ironically, a Belfast teacher shouting the word "quiet". It was recorded at 121 decibels to which Taylor responded: "Our gigs top out at 109, so that's stupid." Agreed.
You'd think, as did Taylor, that helium would have the same effect on an alligator's grunts as it does on our own voices. You would be wrong. According to host Sandi Toksvig, helium doesn't actually change the pitch of your voice, it merely changes the timbre of it, hence why an alligator on helium sounds deeper than normal.
Taylor won't be stocking up on oranges anymore. He guessed that vitamin C prevents colds, as many of us probably would have said. Turns out it's vitamin D that actually stops you getting a bad case of the sniffles.
The frontman's notion that putting a duck in an echo chamber would make it pregnant wasn't quiiiite right (who knew?), but it did lead to the revelation that most ducks don't actually quack. Female mallards are the main offenders when it comes to quacking, while other ducks coo and yodel. "This show, man," drawled Taylor in disbelief on hearing the news.
The sound of cracking knuckles is bubbles in the gas in your hands popping. You can't do it more than once in a row because you need to wait for the bubbles to build back up again. As it turns out, Taylor's pretty good at cracking both his knuckles and his jaw. Gross.
Watch the full episode on BBC iPlayer.


text:
Q: GLES-Render.cpp cocos2d-X causing compile time errors I have copied the GLES-Render.h and GLES-Render.cpp files into my project and added them to the Android.ml file. Now the file is full of errors like
Symbol 'GL_FLOAT' could not be resolved
Symbol 'GL_FALSE' could not be resolved

When i click on any of these symbols eclipse opens up glew.h file or the some error open up on CCGLProgram.h. What am i doing wrong ? Is there OpenGL includes that i have to include ?
Kind Regards

A: You cna check this GLES-Render.h/.cpp in this link. and also add GLES-Render in your android.mk file. GLES-RENDER


text:
Female Athletes
Athletic Men
Seahawks' Brian Schneider On New Kick Returner
The Buffalo Bills Sale 57,000 Season Tickets
Role of Football in the American Culture
Martellus Bennett Expected To Feature During Bears Minicamp
Hot NewsGET THE HOTTEST
Four ways a woman can build an athletic body
The athletic body for women is both feminine and fierce. Women want a body that is strong, toned, but not necessarily masculine. Women can be strong and fierce and still be feminine at the same time. If your goal is to get an athletic body you have to change your lifestyle not just the way you…
Allyson Felix Overcomes Injury in Olympics Trials
Allyson Felix, one of the most notable American athletes, has proven beyond doubt that she is committed and determined to become the first US woman to win gold in both 400 and 200-meter races. Since her debut into the Olympics limelight, she has won six medals; one is a gold medal that she won in…
Track & Field athletes - Veronica Campbell-Brown, Shelly-Ann Fraser-Pryce
Veronica Campbell-Brown Veronica Campbell-Brown is the youngest Jamaican female to win an Olympic medal. At the 2012 Olympic Games, she was a six-time Olympic medalist. Veronica Campbell-Brown was born May 15, 1982. A seven-time Olympic champion, she is the second lady in history to win two…
Manon Rhéaume breaks new ground for women
Manon Rhéaume is a Canadian ice hockey goaltender and also an Olympic silver medalist. She accomplished a variety of historical firsts during her career. Manon Rhéaume was the first woman to play on an American hockey team when she, in 1992, she signed as a goalie with the National…
What is the Women's Sports Foundation?
Also known as WSF, the Women's Sport Foundation is essentially a non-profit foundation dedicated to encourage and support the role of women in sports. It was founded in 1974 by Billie Jean King, one of the greatest tennis players of all time, and her husband Larry King. Billie won the award for…
Latest News FROM OUR DESK
Stephen Curry wins best Male athlete at Teen Choice Awards
If you watched the Teen Choice Awards this year, you had plenty of surprises. The public was nervously expecting the winner of one of the most important categories, best Male athlete, and we're sure that nobody was left disappointed! Stephen Curry, one of the best shooters in the history of…
Dan Ahearn
Dan Ahearn, born in Athea, Ireland on April 12, 1888 was an Irish and later American track and field athlete and a member of the Irish American Athletic Club. In 1920 Summer Olympics, he contested for the U.S. Olympic team. Originally, he was Irish and his surname was, "Ahearne" but…
Meet Mayweather, Who Maintains An Undefeated Record In Boxing Since 1998
Floyd Mayweather emerges as the highest paid sportsman in the world of athletics. As a professional boxer, he is an American citizen with eleven world titles under his belt. He has won several awards for the sport of boxing during his career and been the brand-ambassador for several sports…
Nathan Adrian
Nathan Ghar-Jun Adrian, one of the amazing swimmers of America, was born on December 7, 1988 to Cecilia and James Adrian. He has an interesting ancestry because his mother is Chinese and his father an American. He has two elder siblings, one brother and another sister who also is a swimmer. He…
Walter Dix
Walter Dix is one of the well known sprinters of American. He usually runs the 100 meter and 200 meter races. In 200 meter race he holds the personal best of 9.53 seconds and is currently the fourth-fastest of all time. He has also among the top sprinters who have completed 100 meter in less than 10…
Baker Selected as US Slow Pitch Male Athlete of the Year
In the 5th season as a key member of the USA's softball men's slow pitch team, Bryson Baker, a middle infielder has earned his very first softball male slow pitch athlete of the 214 year. ASA/USA softball officially announced it recently. The last season was a great year for Baker, who…
What's Trending FROM THE WORLD
Kentucky Basketball Loses to Kansas State
Luka Doncic should be first pick in NBA draft
NBA to hold camps for women prospects in Mexico City
Raptors have best record in Eastern Conference thanks to DeRozan
Westbrook Triple-Double Fuels Thunder
Four top prospects for 2018 draft.
Rooney Set To Be Manchester…
Fabian Gomez Wins First Career…
Sports: A must in Life
USA Wins Women's National…
Best Environment Provided To…
How to Stay Fit at Work
How to get rid of your Double…
Components of Physical Fitness
Working Out With a Friend
Why You Should Take Better…
News In Flash
What happened to Indian football Coach Thilakan in Bahrain?
DeFilippo takes over as Vikings OC
Dolphins allow Jarvis Landry to pursue a trade
Carolinas Senior Football Showcase
Three Suggestions from Todd Durkin's Book, The Impact! Body Plan
Ryan Lochte sets record in 200m at the US Open
Three Male Gymnasts Who Are Top of Their Class
Three athletic men: Trevor Brazile, Mo Farah, and Steve House
15+ Celebrities That Have Been Arrested - Some Multiple Times!
Who are Wilfried Dietrich, Daniel Robin & Bilyal Makhov?
Alessandro Del Piero, soccer star
Three Olympic hopefuls in Men's gymnastics
Nike and Adidas will quit their golf businesses
Nike has decided to pull out of their golf business. This is another indication of the decline of the sport in America. Nike began its golf business in 1999, when they sponsored 20-year old Tiger Woods. A great deal at the time, it seemed to start to fall apart with the struggling professional and…
Three favorites to golf in US Open at Oakmont, Pa.
Heading into the US Open at Oakmont, Pennsylvania, the field of entrants is led by a distinct popular few. These include Jason Day, Jordan Spieth, and Rory McIlroy. These three dominate the betting odds, and all for different reasons. Jason Day has claimed his position by setting records across the…
The new XE! Wedge - increase your accuracy (golf)
The new XE! Wedge - increase your accuracy (golf) There's a detachment between the spirit of golf and also much of the equipment that appears each year. The sporting activity is meant to be tough. It focuses on sports skills like touch, concentration, and accuracy as opposed to speed. The…
Copyright 2014. All Rights Reserved. New World Sport
Contact Us Terms of Use Privacy Policy DMCA


Here's all about Canada's first hijab-clad news anchor!
Breaking the stereotypes, a Toronto-based television journalist Ginella Massa became Canada's first anchor to don a Muslim head scarf at one of the city's major news channel. Massa was asked to work on the anchor desk for CityNews' 11 pm broadcast last week.
The 29-year-old said she became Canada's first hijab-wearing television news reporter in 2015, when she was reporting for CTV News in Kitchener. She then returned to Toronto to take a reporting job at CityNews earlier this year.
And I said yes. "And so I tweeted about it. As much as I knew it was important, I didn't expect the reaction that I received. My phone hasn't stopped buzzing for the last week," she added.
"They've been told because of their hijab, that's not going to happen. That makes me really sad because they're being held back by someone else's idea of what the public can or cannot handle," she added.
Although the response to Massa's anchor stint was mostly positive, she also received a handful of negative remarks.


text:
California bill to empower bar & restaurant owners in lease renegotiations is dead
Senate Bill 939 would have allowed commercial tenants to renegotiate leases after losses
Los Angeles /
Scott Wiener, Lena Gonzalez
A proposed state bill to give commercial tenants a slew of powerful tools in lease negotiations was shot down this week, even after its authors dialed it back.
The latest version of Senate Bill 939, which largely would have benefited bar, cafe and restaurant owners, was voted down by the California State Senate's appropriations committee, according to Commercial Observer.
The bill would have allowed tenants to trigger lease renegotiations if they lost more than 40 percent of their revenue or were forced to operate at 25 percent reduced capacity. It also would have created a statewide commercial eviction moratorium through the coronavirus state of emergency.
Earlier versions of the bill had a longer moratorium term and would have allowed tenants to break leases during renegotiations if an agreement wasn't reached within 30 days.
Those provisions would only apply to businesses and nonprofit organizations with fewer than 500 employees. State senators Scott Wiener and Lena Gonzalez wrote the bill. Wiener is known for pushing several pro-development bills designed to address the statewide housing crisis.
They released a statement on the SB-939 vote, saying that "California faces the very real prospect of a mass extinction event for small businesses and nonprofits."
The state has already instituted an eviction moratorium through the state of emergency, but it is subject to the discretion of the governor and California's Judicial Council.
Housing advocates and academics have warned of a wave of residential evictions in particular once the state and local moratoriums are lifted. One UCLA study suggests that as many as 365,000 residential evictions could come after the moratorium expires. [Commercial Observer] — Dennis Lynch
CoronavirusevictionsRetail Real Estate
Here's what tenants are paying at Torrance Towne Center mall
Charing Cross buys Wal-Mart anchored Torrance shopping center
LA County cited 150 businesses for Covid violations since Black Friday, including 6 malls
Here are LA County's biggest retail deals of 2020
Newsom targets small businesses in $4.5B stimulus plan
LA extends eviction moratorium as Covid cases surge
Costa Mesa bar owner faces criminal charges for Covid violations
Stay-at-home order extended as retailers struggle to stay afloat
7083 Hollywood Blvd, 2nd Floor, Los Angeles, CA 90028


text:
EP1791053A1 - Systems and methods of processing annotations and multimodal user inputs - Google Patents
Systems and methods of processing annotations and multimodal user inputs Download PDF
EP1791053A1
EP1791053A1 EP20060023167 EP06023167A EP1791053A1 EP 1791053 A1 EP1791053 A1 EP 1791053A1 EP 20060023167 EP20060023167 EP 20060023167 EP 06023167 A EP06023167 A EP 06023167A EP 1791053 A1 EP1791053 A1 EP 1791053A1
Rama K. Gurram
Frankie James
2005-11-28 Priority to US11/287,850 priority Critical patent/US20070124507A1/en
2006-11-07 Application filed by SAP SE filed Critical SAP SE
2020-01-19 Application status is Withdrawn legal-status Critical
238000000034 methods Methods 0 abstract description 10
230000003213 activating Effects 0 claims description 9
230000001276 controlling effects Effects 0 claims description 5
241001422033 Thestylus Species 0 description 17
238000010079 rubber tapping Methods 0 description 8
239000000976 inks Substances 0 description 4
230000003993 interaction Effects 0 description 4
101700036544 PDA family Proteins 0 description 1
238000004590 computer program Methods 0 description 1
229920001690 polydopamine Polymers 0 description 1
G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
G06F3/16—Sound input; Sound output
G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
G10—MUSICAL INSTRUMENTS; ACOUSTICS
G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
G10L15/00—Speech recognition
G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
G10L2015/226—Taking into account non-speech caracteristics
G10L2015/228—Taking into account non-speech caracteristics of application context
Embodiments of the present invention provide multimodal input capability. In one embodiment the present invention includes an input method comprising displaying one or more display objects to a user, associating at least one voice mode with one of said display objects, associating at least one stylus mode with the display object, and associating at least one voice navigation command with the display object. The system may prompt a user for a plurality of inputs, receive a voice command or a touch screen command specifying one of the plurality of inputs, activate a voice and touch screen mode associated with the specified input, and process the voice input in accordance with the associated voice mode or the associated touch screen mode.
The present invention relates to user interfaces and processing user inputs, and in particular, to receiving and processing annotations and multimodal user inputs.
The growing prevalence of computer systems in society has given rise to the need for easier and more harmonious techniques for interfacing with computers. Computer systems of all kinds can be found in a wide variety of uses. Portable computer systems such as personal digital assistants ("PDAs"), cellular phones, portable music and video players, laptops, and tablet personal computers can be found in a wide variety of applications. Traditional methods of interacting with computer systems include use of a keyboard or point and click device such as a mouse. As such systems become more integrated into daily life, new mechanisms of providing inputs have been developed, such as the use of a touch screen. In some systems, complex software may be loaded onto the computer and activated to allow voice inputs to implement operating system commands and translate voice inputs into text.
The problem with existing inputs systems is that such systems do not function seamlessly with the way human beings interact with computers. Existing voice command systems, when activated, require a user to provide inputs exclusively though voice commands, which can be extremely unnatural. On the other hand, most existing touch screen systems are limited to providing inputs using a touch screen device, such as a stylus, in conjunction with a mouse, keyboard, or keypad. It would be desirable to provide a system wherein a user can use multiple different modes of input to flexibly choose the best input mechanism for the particular moment. Additionally, the best mode of input may change depending on the type of input being entered. Accordingly, it would be desirable to provide users with different input modes that are tailored for specific tasks.
Thus, there is a need for improved input mechanisms. The present invention solves these and other problems by providing systems and methods of processing annotations and multimodal user inputs.
Embodiments of the present invention improve the flexibility of user inputs. In one embodiment, the present invention includes a computer-implemented method for processing user inputs comprising prompting a user for a plurality of inputs, receiving a command specifying one of the plurality of inputs, wherein the system is activated to receive both a voice command and a manual selection command, activating a voice and manual selection mode associated with the specified input, an if a voice input is detected, processing the voice input in accordance with the associated voice mode, or if a manual selection input is detected, processing the touch screen input in accordance with the associated manual selection mode.
In one embodiment, the plurality of inputs are display objects each having an associated voice command, voice mode, and touch screen mode.
In one embodiment, the method further comprises storing metadata for defining associations between display objects and voice commands, voice modes, and touch screen modes.
In one embodiment, the display objects include a page, a section of a page, a particular field of a page, an image, a button, a radio button, a check box, a menu, a list, an icon, a link, a table, a slider, a scroll bar, an user interface control, or a step of a program that is illustrated graphically on a screen.
In one embodiment, the voice mode is a short text entry mode for translating a voice input into text and inserting the text into a field.
In one embodiment, the voice mode is a free form dictation mode for translating voice dictations into text.
In one embodiment, the voice mode is voice annotation mode for associating a voice input with a particular display object.
In one embodiment, the voice mode is a voice authorization mode for performing an authorization using a received input.
In another embodiment, the present invention includes a computer-implemented method for processing user inputs comprising displaying one or more display objects to a user, associating at least one voice mode with one of said display objects, associating at least one touch screen mode with the display object, and associating at least one voice command with the display object.
In one embodiment, the method further comprises receiving a voice command or a touch screen command specifying one of the display objects, and in accordance therewith, activating a voice and touch screen mode associated with the specified input.
In one embodiment, the method further comprises detecting a voice input or touch screen input, wherein if a voice input is detected, processing the voice input in accordance with an associated voice mode, or if a touch screen input is detected, processing the touch screen input in accordance with an associated touch screen mode.
In one embodiment, the voice mode translates a voice input into text.
In one embodiment, the voice mode associates an annotation with the display obj ect.
In one embodiment, the voice mode performs an authorization.
In one embodiment, the display object is an element of a screen displayed to a user by a computer system.
In one embodiment, the display object is an application page or element of a page displayed to a user by an application.
In one embodiment, the display objects include a page, a section of a page, a particular field of a page, an image, a button, a radio button, a drop down menu, an icon, a link, or a step of a program that is illustrated graphically on a screen.
In one embodiment, the display objects include a web page.
In another embodiment, the present invention includes a computer system including software for processing user inputs, the software comprising an annotation component for associating voice or touch screen inputs with particular objects in a display, an input controller for selecting between voice and touch screen inputs, a speech recognition component for receiving grammars and voice inputs and providing recognition results, and metadata for specifying said grammars and said associations of voice or touch screen inputs with particular objects in a display.
In one embodiment, the software further comprises an association model for defining the association between voice and touch screen inputs with particular objects in a display.
In one embodiment, the software further comprises an authorization component for performing an authorization using a received input.
In one embodiment, the objects in the display include a page, a section of a page, a particular field of a page, an image, a button, a radio button, a drop down menu, an icon, a link, or a step of a program that is illustrated graphically on a screen.
In one embodiment, the system is a client system that downloads pages over a network, and wherein the pages include said metadata.
In one embodiment, said metadata further defines associations between objects in the display and voice commands, voice modes, and touch screen modes.
In another embodiment, the present invention includes a computer-readable medium containing instructions for controlling a computer system to perform a method of processing user inputs comprising displaying a plurality of display objects, receiving a command specifying one of the plurality of display objects, wherein the command is a voice command or a touch screen command, activating a voice and touch screen mode associated with the specified display object, and if a voice input is detected, processing the voice input in accordance with the associated voice mode, or if a touch screen input is detected, processing the touch screen input in accordance with the associated touch screen mode.
In another embodiment, the present invention includes a computer-readable medium containing instructions for controlling a computer system to perform a method of processing user inputs comprising displaying one or more display objects to a user, associating at least one voice mode with one of said display objects, associating at least one touch screen mode with the display object, and associating at least one voice command with the display object.
In one embodiment, the method further comprises receiving a voice command or a touch screen command specifying one of the display objects, activating a voice and touch screen mode associated with the specified object, and detecting a voice input or touch screen input, wherein if a voice input is detected, processing the voice input in accordance with an associated voice mode, or if a touch screen input is detected, processing the touch screen input in accordance with an associated touch screen mode.
The following detailed description and accompanying drawings provide a better understanding of the nature and advantages of the present invention.
Fig. 1 illustrates processing user inputs according to one embodiment of the present invention.
Fig. 2 illustrates computer system software for processing user inputs according to one embodiment of the present invention.
Fig. 3 illustrates a method of processing user inputs by associating voice modes and stylus modes with display objects according to one embodiment of the present invention.
Fig. 4 illustrates a method of processing voice or stylus inputs according to one embodiment of the present invention.
Fig. 5 illustrates a display with multiple display objects according to one embodiment of the present invention.
Fig. 6 is an example graphical user interface illustrating one embodiment of the present invention.
Fig. 7 is an example graphical user interface illustrating another embodiment of the present invention.
Fig. 10 illustrates a network based implementation of the present invention.
Fig. 11 is an example flow chart of a multimodal interaction across a network according to one embodiment of the present invention.
Fig. 12 is an example flow chart of a multimodal interaction according to one embodiment of the present invention.
Described herein are techniques for processing user inputs. In the following description, for purposes of explanation, numerous examples and specific details are set forth in order to provide a thorough understanding of the present invention. It will be evident, however, to one skilled in the art that the present invention as defined by the claims may include some or all of the features in these examples alone or in combination with other features described below, and may further include obvious modifications and equivalents of the features and concepts described herein.
Fig. 1 illustrates processing user inputs according to one embodiment of the present invention. Embodiments of the present invention improve the interactive experience of working with computer systems by providing multiple input modes. According to one aspect of the present invention, a computer system 100 may include a microphone 101 for receiving voice inputs. Computer system 101 may also include other manual input mechanisms such as a keyboard; mouse, or a touch screen display for receiving manual selection inputs (e.g., keyboard entries, mouse clicks, or touch screen inputs). One way of providing touch screen inputs is to use a stylus 102, for example. A stylus is a handheld device typically having an elongated body with a tapered tip similar to a traditional pencil or pen. A software program may display a variety of objects 120 to a user that are associated with multiple different voice functionality and keyboard, mouse, or stylus functionality. For example, a user may interact with objects in a program display 110 by issuing voice inputs through a microphone 101 coupled to the computer system 100. A user may also interact with objects in the display 110 by "clicking," "tapping," or "writing" on the display with a mouse or the stylus, for example. A program display 110 may include one or more display objects 120. In one embodiment, a display object is an element of a screen displayed to a user by a computer system, for example, on a monitor or other display device. In another embodiment, a display object is an application page or element of a page displayed to a user by an application. In some embodiments of the present invention, a display object may include an entire page, such as a web page in a web based application or a display page generated by a native application. As illustrated below, display objects may also include sections of pages (i.e., particular areas of a screen or page), particular fields of a page (e.g., for text entry), images (e.g., pictures), buttons, radio buttons, check boxes, menus (e.g., drop down menus or lists), icons, links, tables, sliders, scroll bars, user interface controls (e.g., HTMLB controls), or steps of a program that are illustrated graphically on a screen. The types of display objects listed above and disclosed herein is not exhaustive.
Embodiments of the present invention allow users to flexibly interact with different types of display objects using multiple input modes (e.g., using either voice or touch screenmanual select inputs such as a stylus). For example, in one embodiment the software is activated to receive either voice or stylus inputs for selecting fields of a page, and a user may even enter data into a selected field using either voice or stylus data entry. For example, the system may be activated to receive both a voice command and a manual selection command for selecting a display object. Other embodiments allow users to associate voice inputs or touch screen inputs with particular display objects. For example, in one embodiment a user may attach a voice note or a handwritten stylus note to a web page, a particular section of a web page, or even a particular image of a web page. As illustrated below, embodiments of the present invention may be implemented in a web-based architecture or as an enhancement to a native application.
Referring again to Fig. 1, display objects such as web pages or fields in an application display may be associated with different voice and touch screenmanual select inputs (e.g., a touch screen input). As illustrated in Fig. 1, computer program display 110 includes one or more display objects 120. Display object 120 may be associated with particular voice commands 130, voice modes 140, and stylus manual select modes 150 (e.g., a touch screen mode). As mentioned above, example manual select modes include keyboard inputs, mouse inputs, or stylus (touch screen) inputs. In this description, it is to be understood that the term "stylus mode" and "touch screen mode" may be used interchangeably to refer to any mode associated with a touch screen input of which a stylus is just an example. For example, a page of an application may include a number of labeled fields for entering data. According to prior art techniques, data could be entered into each field by moving a mouse pointer over the field and entering a mouse click to move the cursor into the field. One aspect of the present invention allows fields to be selected using either voice or or manual inputs, such as mouse or stylus inputs. Accordingly, each display object may have an associated voice command 130 that may be used to select a particular object, such as a particular field, for example. Thus, the system may be "listening" for voice command inputs associated with one of the fields. The voice command associated with each object may be a particular grammar, wherein when a voice input is received and the particular grammar is detected by a speech recognizer, the associated display object is selected for further manipulation, such as data entry, for example. The system may also be waiting to detect a stylus input, for example. If a touch screen detects a "tap" of the stylus on a particular object (e.g., in a particular data entry field), then the system will select the object for further manipulation.
Each display object may further have associated voice modes 140 and stylus manual select modes 150 (e.g., a touch screen mode). For example, a data entry field may be associated with a "short text entry" voice mode. A short text entry voice mode may cause the system to automatically enable a microphone and speech recognizer so that if a user provides a voice input, the voice input is translated into text (i.e., recognized) and the text may be entered into the data entry field. Other example voice modes that may be associated with particular display objects include a "free form dictation mode," "voice annotation mode," or "voice authorization mode," for example. Free form dictation mode may allow a user to dictate notes into longer text fields, such as a "Notes" field. Accordingly, a display.object such as a "Notes" field may be associated with a free form dictation mode so that when such object is selected, the system automatically activates the microphone and recognizer to receive and translate a voice input into text and enter the text in the particular field. Voice annotation mode may allow a user to associate a voice input with a particular display object, such as a page as a whole, or objects in the page such as a "picture" or a "Note," for example. Accordingly, a display object such as a "Notes" field may be associated with a voice annotation mode so that when such object is selected, the system automatically activates the microphone, stores a voice input, and associates the voice input with the display object. Voice authorization mode may allow a user to associate an authorization with a display object, such as a "sales proposal web page" or a "price" field of a page. Accordingly, a display object such as a "price" field may be associated with an authorization mode so that when such object is selected, the system automatically activates the microphone, receives input speech or handwritten signature with the stylus, and performs an authorization on the received input to verify that an authorized user is associated with the object (e.g., only authorized users may be able to make changes to the price). Examples of these modes are provided below. Similarly, each object may be associated with particular stylus manual select modes, such as "mouse clicks," "taps," or "text entry." Text entry modes may include either a stylusn "ink mode" or a "text recognition mode." Ink mode may configure the stylus to receive free form writings and store the touch screen input as a script (e.g., hand writing). Text recognition mode may receive the touch screen stylus written script and input the script letter by letter or as a whole sequences into a script recognizer for translating the script into text. Since different input modes may be more or less useful with different types of display objects, embodiments of the present invention associate particular input modes (voice or stylus) with particular objects.
Fig. 2 illustrates computer system software for processing user inputs according to one embodiment of the present invention. Computer software system 200 may be executed on a microprocessor based system, for example, and stored on a hard drive, local memory, or other computer-readable medium containing instructions for controlling a computer system to perform the methods described herein. The present invention may include a software component 210 that processes voice and touch screen inputs and performs annotations, authentications, and recognition, for example. Example software may include a voice input component 211, stylus manual select input component 212, annotation component 213, authentication component 214, metadata 215, and a recognition component 216. It is to be understood that embodiments of the present invention may include some or all of these components. Voice input component 211 may process voice inputs, such as the voice commands and voice modes described above. An example of a manual select input 212 is a stylus input. Stylus input component 212 may process touch screen inputs, such as taps or text entry also described above. Annotation component 213 may implement annotation functionality, so that a voice, for example, may be attached to an image. Authentication component may perform authentication functions including working with a recognition engine to verify voice patterns or stylus signatures and managing security such as data access and modification privileges, for example. As described in more detail below, software 210 may use metadata 215 for defining associations between display objects and voice commands, voice modes, and stylus modes. Software 210 may generate such metadata based on user inputs, or it may use metadata generated by other users, or both. Metadata 215 may also be used for specifying recognition parameters, such as grammars that define voice commands and/or voice mode inputs or text recognition parameters if a stylus script recognizer is used. Metadata 215 may also be used for specifying annotations and authentication rules, for example.
Software 210 may interface with a native application 220 to provide some or all of the multimodal functionality described herein. In one embodiment, application 220 may be a web based client, such as a web browser, and software 220 may work with the client software (e.g., as a plug-in or helper program) to provide some or all of the multimodal functionality described herein. Examples of a web-based application are provided below.
Fig. 3 illustrates a method 300 of processing user inputs by associating voice modes and stylus modes with display objects according to one embodiment of the present invention. At 301, one or more display objects are displayed to a user. As mentioned above, display objects may include a page, sections of a page, images, or fields of a page (e.g., text entry fields or links). Voice commands, such as navigation commands, may be associated with different objects in the display as illustrated at 302. For example, a page may include three fields for entering text labeled "Name," "Address," and "Comments." Different voice commands for the page may be associated with each of the different fields to allow users to select each field using a voice input. For example, one voice command may be associated with the "Name" field (e.g., a grammar used to recognize when a user speaks the word "name"), and other voice commands may be associated with other fields to allow users to activate the other fields with voice commands. Each display object may also be associated with different voice modes as illustrated at 303. The "Name" field in the previous example may be associated with a "short text entry" mode, for example, so that a user may speak a name and the voice input is automatically recognized and entered as text into the field. It may be more useful to associate different display objects with particular voice modes to improve the user's experience. At 304, stylus modes, such as tapping or text entry, may be associated with each display object. At 305, the system may receive a voice or stylus command corresponding to a particular display object from a user. At 306, the voice mode and stylus mode inputs for the selected object are activated. At 307, voice or stylus inputs are received. At 308, the received voice or stylus input is associated with the object. Accordingly, users are provided with a flexible system for selecting objects in a display (e.g., either by voice or stylus) and may flexibly enter data into input fields or attach data using multiple input modes (e.g., voice or stylus).
Fig. 4 illustrates a method 400 of processing voice or stylus inputs according to one embodiment of the present invention. At 401, a user is prompted for a plurality of inputs. For example, a page may be displayed to a user, and the page may include multiple text entry input fields, selectable links or images, or a variety of other potential inputs. At 402, the system receives a command specifying one of the inputs. In one embodiment, a user may tap the stylus on an object to select the object (e.g., tapping a "Name" input field). Alternatively, a user may speak a voice command to select a particular object (e.g., speaking the word "name"). At 403, the system activates a voice and touch screen input mode associated with the specified input. For example, if the input is an "Attach Notes" field, the system may activate the voice annotation mode and the stylus text entry mode, and generate a pop up notepad for a user to enter voice inputs or stylus script notes or diagrams using the stylus to be stored as notes. At this point, a user may have the option of either entering information using voice or touch screen inputs, and the system may wait for a user to enter inputs using either of these input modes. At 404, a user may provide an input and the system detects an input. If the user enters information using the stylus, the system may automatically upon detecting a touch screen input transition to a new state illustrated at 405. At 405, the system receives the stylus input and processes the touch screen input according to the particular touch screen (stylus) mode associated with the object. Alternatively, if the user starts speaking, the system may automatically upon detecting a voice input transition to a new state illustrated at 406. At 406, the system receives the voice input and processes the voice input according to the particular voice mode associated with the object.
Fig. 5 illustrates a display 500 of an application with multiple display objects according to one embodiment of the present invention. In accordance with the execution of an application, a page 501 may be displayed to a user (e.g., as a graphical user interface). In this example, page 501 has an attached annotation 550. Annotation 550 may be a voice recording or stylus note, for example. Page 501 may include sections 502 and 503 that each correspond to different aspects of the program, such as different topics, categories of data, or different functionalities, for example. Section 502 ("Section 1") may include a button 510 having a button name displayed on it. Button 510 may have associated voice commands, voice modes, and stylus modes 511. For example, the voice command associated with the button may allow a user to activate the button by speaking the button name. Once the button is activated, the next steps may depend on the voice mode and stylus mode associated with the button. Similarly, section 502 includes two input fields 512 and 514 with associated commands, voice modes, and stylus modes 513 and 515, respectively. Section 502 also includes an image 516. Images may also have commands and modes associated with them. In this example, image 516 has been associated with an annotation mode. Accordingly, image has an associated annotation 517 attached to it. Section 503 ("Section 2") may also include a button 520 for associating information with the section as a whole. In this example, the button 520 has been used to associate an annotation with section 503. Section 503 also includes radio buttons 522 and 524, which have associated commands and modes 523 and 525, respectively. Each radio button may be selected by speaking the radio button name, which will activate the associated voice command and may further activate the voice and stylus modes.
Fig. 6 is an example graphical user interface illustrating one embodiment of the present invention. In Fig. 6, a user interface page 600 (e.g., a web page) is displayed to a user with a variety of display objects, some of which may prompt a user for input. This example illustrates that voice or stylus annotations may be associated with pages as a whole. In this example, page 600 includes three (3) primary sections including a first section 610 entitled "Business Partner," a second section 620 entitled "Contact Persons," and a third section 630 entitled "Activities." A "Record" button 650 prompts a user for inputs that may be associated with the page as a whole. The "Record" button is another example of a display object. A user may select the "Record" button using either voice commands (i.e., speaking the word "Record") or through a touch screen command (i.e., touching the tip of the stylus to the record button). When the computer receives the command specifying the "Record" button 650, the software may cause an input field 651 to appear and activate voice and touch screen inputs. For instance, input field 651 may be associated with a free form dictation voice mode and a text entry stylus mode. Thus, if a user begins speaking, the system will automatically record the user's spoken comments and the comments will automatically be associated with the page for future access. If, on the other hand, the user uses the stylus to enter text into field 651, the system will automatically record the touch screen entry (e.g., as a stylus ink note), and the entry will automatically be associated with the page for future access. As mentioned above, in some embodiments voice entries may be recognized and translated into text messages, and similarly, stylus entries may be recognized by a text recognition engine and translated into text messages.
Fig. 7 is an example graphical user interface illustrating another embodiment of the present invention. This example illustrates that voice or stylus annotations may be associated with sections of pages. In this example, page 700 includes two (2) primary sections including a first section 710 entitled "Item Set" and a second section 720 entitled "Product." A "Record" button 730 in section 720 prompts a user for inputs that may be associated with the "Product" section of the page 720. The user may specify the selection of the "Record" input 730 in section 720 by either speaking the word "record" or by touching a stylus to the "Record" button. When the computer receives the command specifying the "Record" button 730, the software may cause an input field 731 to appear and activate voice and touch screen inputs. Similar to the page 600 of Fig. 6, input field 731 may be associated with a free form dictation voice mode and a text entry stylus mode. Thus, if a user begins speaking, the system will automatically record the user's spoken comments and the comments will automatically be associated with section 720 of page 700 for future access. If, on the other hand, the user uses the stylus to enter text into field 731, the system will automatically record the touch screen entry, and the entry will automatically be associated with section 720 of page 700 for future access. It should be noted that section 720 may not be display with section 710 under all circumstances. Or more generally, sections (or portions) of pages may be accessed together in some cases and separately in others. In some embodiments, users may tailor pages to show different types of information. However, according to this embodiment, the voice or stylus annotation may be associated with the section 720 whenever it is accessed.
Fig. 8 is an example graphical user interface illustrating another embodiment of the present invention. In this example, a user may specify a particular field of a page, and voice modes or stylus modes associated with the field are automatically activated for receiving inputs. For instance, page 800 may be activated to receive a variety of voice commands associated with each of the different inputs available on the page, such as for the field 810 "Name," for example. The "Name" field 810 may have an associated voice command (e.g., a grammar) that will trigger activation of the "Name" field when the word "name" is spoken by a user. The "Name" field 810 may also be selected through touch screen by tapping the "Name" field with a stylus, for example. Multimodal selection allows users a more natural way of interfacing with the page. When the "Name" field is selected by either a voice command or a stylus, the field will activate associated voice and stylus modes for receiving input. In this example, a stylus text entry box 820 is generated and located adjacent to the field 810 of interest. The system is then ready to receive the name as either a voice input or touch screen input. The "Name" field may have an associated short text entry voice mode, for example, for receiving and recognizing names, and the recognized names may be inserted as text into the field of the page. For instance, a user may speak "John Smith," and the system may enter the voice input into a speech recognition component and translate the voice input into text. Additionally, the "Name" field may have an associated text recognition stylus mode for receiving and recognizing stylus name entries, and the recognized stylus name entries may be inserted as text into the field of the page. For instance, a user may write the name "John Smith" using a stylus in field 820, and the system may enter the written stylus script into a recognizer and translate the script into text.
Fig. 9 is an example graphical user interface illustrating another embodiment of the present invention. This example illustrates authentication associated with particular display objects. In this example, a signature box 910 prompts a user for authorization. In this example, the details surrounding a sales transaction are illustrated, and authorization may be required from a sales manager, for example. A user may select the signature box using either a voice command (e.g., by speaking the words "signature" or "authorize sale") or by touch screen (e.g., tapping the tip of the stylus inside or near the signature box). Once authorization is selected, the system may activate both an authorization voice mode and a text entry stylus mode for receiving either a voice input or stylus signature. If the user provides a voice input (e.g., speaking their name), the system may automatically provide the voice input to a recognition engine to recognize the voice as the voice of a particular user, thereby authenticating the user. If the voice matches an authorized user, then the voice signature may be used to authorize the sale, for example. If the user provides a stylus input (e.g., a written signature), the system may automatically associate the stylus input with the signature box for authorization of the sale. In one embodiment, the signature may be provided to a recognition engine to recognize the signature as the signature of a particular user, thereby authenticating the user. If the signature matches an authorized user, then the signature may be used to authorize processing of the sale, for example.
Fig. 10 illustrates a network based implementation of the present invention. In this example implementation, a client computer system 1001 includes a web browser or stand alone application 1010 coupled to multimodal software 1011. Multimodal software 1011 may be a plug-in to a browser, for example, or an enhancement program interfaced with a native application. Multimodal software 1011 includes a stylus/voice input component 1013, a voice annotation component 1014, voice authentication component 1015, voice command component 1016, voice command loader component 1017, speech recognition component 1018, and metadata repository 1019. Client computer system 1001 may be coupled to other applications ("Services" 1050) or a server 1030 over a network 1020 (e.g., the Internet or an Intranet), which may allow communication with other clients 1040, for example. In one embodiment, a browser or stand alone application may be enhanced with some or all of the functionality described above via software 1011 and related components. Stylus and voice input component 1013 manages the activation of voice and touch screen inputs and coordinates accessing rules and grammars from the metadata repository 1019 based on the received inputs. Voice annotation component 1014 manages the storage of annotations (e.g., voice or ink from stylus) and defines associations of the annotation to display objects such as pages, images, parts of a page, or fields, for example. Voice authentication component 1015 controls access rights to the system based on user inputs (e.g., voice). Voice command component 1016 controls the processing of voice navigation commands associated with each display object, including the selection of prompts on a page, for example. Voice command loader component 1017 loads metadata for generic voice controlled system commands that are controlled, for example, by the operating system and are not associated with a particular display object (e.g., the "Back" button on a browser or commands to "Open" a new "Folder" or "Close" command to a window). Such commands may be identified and passed through to the operating system for execution, for example. Speech recognition component 1018 may receive grammars and voice inputs and provide an output indicating whether or not the input was recognized and an indication of the recognized word or phrase.
A variety of parameters may be stored as metadata in repository 1019. In one embodiment, a web browser may receive a page, for example, and metadata may be associated with particular display objects. The metadata may define the relationships between the objects in the page and associated grammars to enable voice commands and modes. The metadata may be customized for each page depending on the number and types of display objects included in the page. For example, fields may have associated metadata that define grammars corresponding to voice commands for selecting the fields and corresponding to the voice modes associated with the fields. The grammars included in each page for each object may be used to constrain the voice inputs and improve recognition accuracy, for example. Voice metadata may be associated with older legacy systems so that such pages can become enabled for multimode functionality described herein. Similarly, the metadata may define the associations between the objects and annotations or the authentication parameters, for example.
As mentioned, client 1001 may be receive multimodale enabled web pages from a server 1030 over network 1020 from server 1030. Server 1030 may store information associated with pages including information for displaying particular display objects, associations between the display objects and voice commands, voice modes, and touch screen modes, for example. The data specifying the display objects and associations between the objects and voice commands, voice modes, and touch screen modes may be defined by users of other client systems or as part of an application or service, for example, and transmitted to other clients for use.
Fig. 11 is an example flow chart 1100 of a multimodal interaction across a network according to one embodiment of the present invention. At 1101, a system (e.g., a client) may receive a document object model ("DOM"). The DOM is logical representation of a page and the objects in a page, and typically defines a tree structure. At 1102, the DOM is parsed. At 1103, metadata and associations embedded in the DOM are extracted and loaded into the multimodal software layer. Associations may be stored as an association model for defining the association between voice and stylus inputs with particular objects in a display, for example. At 1104, the metadata and associations are applied to the objects in the DOM and the components of the multimodal software, and the page is displayed to the user. At 1105, the software receives inputs from the user. As described above, the inputs may be any of the voice commands, voice modes, or stylus modes described above including multimodal commands, annotations, authentications, or data entry. At 1106, the system updates the DOM based on the inputs. The new associations and/or user inputs may be embedded in the DOM and stored in a remote repository for access by other users at 1107. Of course, the DOM may also be stored locally.
Fig. 12 is an example flow chart 1200 of a multimodal interaction according to one embodiment of the present invention. At 1201, the system retrieves a page and presents the page to a user with a plurality of inputs. Among other things, the page may include a "product code" field for entering the digits of a product code to retrieve information about a particular product. The page may further have an "Add Note" section for attaching notes to the page. At 1202, the user selects the product code field by tapping the stylus or speaking "product code." At 1203, the user enters the data by providing the product code digit-by-digit as a voice input or writing digits in pop up stylus entry field. The voice or stylus input may be automatically translated into a text entry by a recognizer and entered into field in accordance with a voice or stylus mode, such as a short text entry mode, associated with the product code field. At 1204, a user exits by tapping an "exit" button or speaking "exit." At 1205, the user selects the "Add Note" feature associated with the page by speaking "add note" or tapping "Add Note" with the stylus. At 1206, the user provides a voice note that is stored as a wave file or provides a handwritten note with the stylus. At 1207, the input note is attached to the page in accordance with the annotation mode. At 1208, the page associations and metadata are updated and stored on remote or local system. At 1209, another user accesses page and associated information. Other users may similarly modify or add to the associations to enhance the information included with the page.
An example application of the present invention may be a case where a sales person with a voice and touch screen enabled Table PC (a client) visits a customer site and communicates with a senior manager at headquarters. While at the customer site, the sales person may download a page the displays information about the customer being visited. The page may be generated as part of a customer relationship management ("CRM") application, for example, and may include a variety of information about the customer, information about products previously purchased by the customer, products to be sold, and other information for performing a sales transaction. According to embodiments of the present invention, the page may include a variety of voice or handwritten annotations from previous sales visits so that the sales person can understand more about the history of the customer relationship. Additionally, each display object in the page may include annotations giving the sales person more information about the history of the customer relationship. During the meeting with the customer, the sales person may make a variety of handwritten notes on the touch screen and voice notes that may be annotated with the page as a whole or to various display objects such as a "Delivery" section, or "Special Requirements" section. If the customer is a potentially valuable customer to the salesman's company, the sales person may attach a voice note or handwritten annotation to the page or a "Sales Terms" section of the page, or a "Price" field object on the page indicating that the customer desires to purchase very large volumes and desires a special discount on the price. The information may be stored on a remote database and accessed by a product manager back at headquarters. The product manager can access the annotation regarding the discount and authorize the transaction using either a voice or stylus. The sales person may then receive the authorized transaction and finalize the sales transaction.
The above description illustrates various embodiments of the present invention along with examples of how aspects of the present invention may be implemented. The above examples and embodiments should not be deemed to be the only embodiments, and are presented to illustrate the flexibility and advantages of the present invention as defined by the following claims. Based on the above disclosure and the following claims, other arrangements, embodiments, implementations and equivalents will be evident to those skilled in the art and may be employed without departing from the spirit and scope of the invention as defined by the claims. The terms and expressions that have been employed here are used to describe the various embodiments and examples. These terms and expressions are not to be construed as excluding equivalent terms or equivalent processes, systems, or configurations of the features shown and described, or portions thereof, it being recognized that various modifications are possible within the scope of the appended claims.
A computer-implemented method for processing user inputs comprising:
prompting a user for a plurality of inputs;
receiving a command specifying one of the plurality of inputs, wherein the system is activated to receive both a voice command and a manual selection command;
activating a voice and manual selection mode associated with the specified input; and
if a voice input is detected, processing the voice input in accordance with the associated voice mode, or if a manual selection input is detected, processing the touch screen input in accordance with the associated manual selection mode.
The method of claim 1 wherein the plurality of inputs are display objects each having an associated voice command, voice mode, and touch screen mode.
The method of claim 2 further comprising storing metadata for defining associations between display objects and voice commands, voice modes, and touch screen modes.
The method of claim 2 or 3 wherein the display objects include a page, a section of a page, a particular field of a page, an image, a button, a radio button, a check box, a menu, a list, an icon, a link, a table, a slider, a scroll bar, an user interface control, or a step of a program that is illustrated graphically on a screen.
The method of one or more of the preceding claims wherein the voice mode is a short text entry mode for translating a voice input into text and inserting the text into a field; a free form dictation mode for translating voice dictations into text; voice annotation mode for associating a voice input with a particular display object; or a voice authorization mode for performing an authorization using a received input.
displaying one or more display objects to a user;
associating at least one voice mode with one of said display objects;
associating at least one touch screen mode with the display object; and
associating at least one voice command with the display object.
The method of claim 6 further comprising receiving a voice command or a touch screen command specifying one of the display objects, and in accordance therewith, activating a voice and touch screen mode associated with the specified input.
The method of claim 7 further comprising detecting a voice input or touch screen input, wherein if a voice input is detected, processing the voice input in accordance with an associated voice mode, or if a touch screen input is detected, processing the touch screen input in accordance with an associated touch screen mode.
The method of anyone of claims 6 to 8 wherein the voice mode translates a voice input into text; associates an annotation with the display object; or performs an authorization.
The method of anyone of claims 6 to 9 wherein the display object is an element of a screen displayed to a user by a computer system; or
an application page or element of a page displayed to a user by an application.
The method of anyone of claims 6 to 10 wherein the display objects include a page, a section of a page, a particular field of a page, an image, a button, a radio button, a drop down menu, an icon, a link, or a step of a program that is illustrated graphically on a screen.
The method of anyone of claims 6 to 10 wherein the display objects include a web page.
A computer system including software for processing user inputs, the software comprising:
an annotation component for associating voice or touch screen inputs with particular objects in a display;
an input controller for selecting between voice and touch screen inputs;
a speech recognition component for receiving grammars and voice inputs and providing recognition results; and
metadata for specifying said grammars and said associations of voice or touch screen inputs with particular objects in a display.
The computer system of claim 13 further comprising an association model for defining the association between voice and touch screen inputs with particular objects in a display.
The computer system of claim 13 or 14 further comprising an authorization component for performing an authorization using a received input.
The computer system of anyone of claims 13 to 15 wherein the objects in the display include a page, a section of a page, a particular field of a page, an image, a button, a radio button, a drop down menu, an icon, a link, or a step of a program that is illustrated graphically on a screen.
The computer system of anyone of claims 13 to 16 wherein the system is a client system that downloads pages over a network, and wherein the pages include said metadata.
The computer system of claim 17 wherein said metadata further defines associations between objects in the display and voice commands, voice modes, and touch screen modes.
A computer-readable medium containing instructions for controlling a computer system to perform a method of processing user inputs comprising:
displaying a plurality of display objects;
receiving a command specifying one of the plurality of display objects, wherein the command is a voice command or a touch screen command;
activating a voice and touch screen mode associated with the specified display object; and
if a voice input is detected, processing the voice input in accordance with the associated voice mode, or if a touch screen input is detected, processing the touch screen input in accordance with the associated touch screen mode.
The computer-readable medium of claim 19 wherein the method further comprises storing metadata for defining associations between display objects and voice commands, voice modes, and touch screen modes.
The computer-readable medium of claim 19 or 20 wherein the voice mode translates a voice input into text; associates an annotation with the display object; or performs an authorization.
A computer-readable medium containing instructions for controlling a computer system to perform operations according to a method of anyone of claims 7 to 9 or 12.
EP20060023167 2005-11-28 2006-11-07 Systems and methods of processing annotations and multimodal user inputs Withdrawn EP1791053A1 (en)
US11/287,850 US20070124507A1 (en) 2005-11-28 2005-11-28 Systems and methods of processing annotations and multimodal user inputs
EP1791053A1 true EP1791053A1 (en) 2007-05-30
EP20060023167 Withdrawn EP1791053A1 (en) 2005-11-28 2006-11-07 Systems and methods of processing annotations and multimodal user inputs
DE102007024110A1 (en) * 2007-05-22 2008-12-11 Deutsche Telekom Ag Method for influencing the interpretation of multimodal inputs
WO2009105652A2 (en) * 2008-02-22 2009-08-27 Vocollect, Inc. Voice-activated emergency medical services communication and documentation system
DE102009059792A1 (en) * 2009-12-21 2011-06-22 Continental Automotive GmbH, 30165 Method and device for operating technical equipment, in particular a motor vehicle
US8255225B2 (en) 2008-08-07 2012-08-28 Vocollect Healthcare Systems, Inc. Voice assistant system
US8451101B2 (en) 2008-08-28 2013-05-28 Vocollect, Inc. Speech-driven patient care system with wearable devices
CN103186326A (en) * 2011-12-27 2013-07-03 联想(北京)有限公司 Application object operation method and electronic equipment
US20060123220A1 (en) * 2004-12-02 2006-06-08 International Business Machines Corporation Speech recognition in BIOS
US8594305B2 (en) 2006-12-22 2013-11-26 International Business Machines Corporation Enhancing contact centers with dialog contracts
US7809838B2 (en) 2005-12-08 2010-10-05 International Business Machines Corporation Managing concurrent data updates in a composite services delivery system
US8189563B2 (en) 2005-12-08 2012-05-29 International Business Machines Corporation View coordination for callers in a composite services enablement environment
US20070133773A1 (en) 2005-12-08 2007-06-14 International Business Machines Corporation Composite services delivery
US7818432B2 (en) 2005-12-08 2010-10-19 International Business Machines Corporation Seamless reflection of model updates in a visual page for a visual channel in a composite services delivery system
US20070133769A1 (en) * 2005-12-08 2007-06-14 International Business Machines Corporation Voice navigation of a visual view for a session in a composite services enablement environment
US8005934B2 (en) * 2005-12-08 2011-08-23 International Business Machines Corporation Channel presence in a composite services enablement environment
US7877486B2 (en) 2005-12-08 2011-01-25 International Business Machines Corporation Auto-establishment of a voice channel of access to a session for a composite service from a visual channel of access to the session for the composite service
US10332071B2 (en) 2005-12-08 2019-06-25 International Business Machines Corporation Solution for adding context to a text exchange modality during interactions with a composite services application
US7792971B2 (en) * 2005-12-08 2010-09-07 International Business Machines Corporation Visual channel refresh rate control for composite services delivery
US20070147355A1 (en) * 2005-12-08 2007-06-28 International Business Machines Corporation Composite services generation tool
US7890635B2 (en) 2005-12-08 2011-02-15 International Business Machines Corporation Selective view synchronization for composite services delivery
US7827288B2 (en) 2005-12-08 2010-11-02 International Business Machines Corporation Model autocompletion for composite services synchronization
US20070136449A1 (en) * 2005-12-08 2007-06-14 International Business Machines Corporation Update notification for peer views in a composite services delivery environment
US20070143111A1 (en) * 2005-12-21 2007-06-21 Conley Kevin M Voice controlled portable memory storage device
US8161289B2 (en) 2005-12-21 2012-04-17 SanDisk Technologies, Inc. Voice controlled portable memory storage device
JP5464785B2 (en) * 2006-12-05 2014-04-09 キヤノン株式会社 Information processing apparatus and information processing method
US8612230B2 (en) * 2007-01-03 2013-12-17 Nuance Communications, Inc. Automatic speech recognition with a selection list
US8259923B2 (en) 2007-02-28 2012-09-04 International Business Machines Corporation Implementing a contact center using open standards and non-proprietary components
US20080215962A1 (en) * 2007-02-28 2008-09-04 Nokia Corporation Pc-metadata on backside of photograph
US9055150B2 (en) 2007-02-28 2015-06-09 International Business Machines Corporation Skills based routing in a standards based contact center using a presence server and expertise specific watchers
US9247056B2 (en) 2007-02-28 2016-01-26 International Business Machines Corporation Identifying contact center agents based upon biometric characteristics of an agent's speech
US8862475B2 (en) * 2007-04-12 2014-10-14 Nuance Communications, Inc. Speech-enabled content navigation and control of a distributed multimodal browser
US7945566B2 (en) * 2007-08-10 2011-05-17 Sap Ag System and method of information filtering
US8121784B2 (en) * 2007-09-07 2012-02-21 Maritz, Inc. GPS triggered narration and recording for drive events
US8010286B2 (en) * 2007-09-07 2011-08-30 Maritz Inc. Automated narration and recording for drive events
US8176438B2 (en) * 2008-09-26 2012-05-08 Microsoft Corporation Multi-modal interaction for a screen magnifier
US9372590B2 (en) * 2008-09-26 2016-06-21 Microsoft Technology Licensing, Llc Magnifier panning interface for natural input devices
US10068072B1 (en) * 2009-05-12 2018-09-04 Anthony Alan Jeffree Identity verification
US9049258B2 (en) * 2009-09-17 2015-06-02 Border Stylo, LLC Systems and methods for anchoring content objects to structured documents
EP3091535A3 (en) * 2009-12-23 2017-03-01 Google, Inc. Multi-modal input on an electronic device
US20120260176A1 (en) * 2011-04-08 2012-10-11 Google Inc. Gesture-activated input using audio recognition
JP2012221393A (en) * 2011-04-13 2012-11-12 Fujifilm Corp Proof information processing apparatus, proof information processing method, program, and electronic proofreading system
US9263045B2 (en) * 2011-05-17 2016-02-16 Microsoft Technology Licensing, Llc Multi-mode text input
US8255218B1 (en) 2011-09-26 2012-08-28 Google Inc. Directing dictation into input fields
US8788269B2 (en) 2011-12-15 2014-07-22 Microsoft Corporation Satisfying specified intent(s) based on multimodal request(s)
US10209954B2 (en) * 2012-02-14 2019-02-19 Microsoft Technology Licensing, Llc Equal access to speech and touch input
US20130246920A1 (en) * 2012-03-19 2013-09-19 Research In Motion Limited Method of enabling voice input for a visually based interface
WO2013147845A1 (en) * 2012-03-30 2013-10-03 Intel Corporation Voice-enabled touchscreen user interface
US8543397B1 (en) 2012-10-11 2013-09-24 Google Inc. Mobile device voice activation
TWI528186B (en) * 2012-11-09 2016-04-01 財團法人資訊工業策進會 System and method for posting messages by audio signals
US10157618B2 (en) 2013-05-02 2018-12-18 Xappmedia, Inc. Device, system, method, and computer-readable medium for providing interactive advertising
US20140372892A1 (en) * 2013-06-18 2014-12-18 Microsoft Corporation On-demand interface registration with a voice control system
US9582484B2 (en) * 2013-10-01 2017-02-28 Xerox Corporation Methods and systems for filling forms
US9942396B2 (en) * 2013-11-01 2018-04-10 Adobe Systems Incorporated Document distribution and interaction
US10163455B2 (en) * 2013-12-03 2018-12-25 Lenovo (Singapore) Pte. Ltd. Detecting pause in audible input to device
US9544149B2 (en) 2013-12-16 2017-01-10 Adobe Systems Incorporated Automatic E-signatures in response to conditions and/or events
US20150370772A1 (en) * 2014-06-20 2015-12-24 Microsoft Corporation Annotation preservation as comments
US20160092074A1 (en) * 2014-09-26 2016-03-31 Lenovo (Singapore) Pte. Ltd. Multi-modal fusion engine
US9703982B2 (en) 2014-11-06 2017-07-11 Adobe Systems Incorporated Document distribution and interaction
US9531545B2 (en) 2014-11-24 2016-12-27 Adobe Systems Incorporated Tracking and notification of fulfillment events
CN106033418A (en) * 2015-03-10 2016-10-19 阿里巴巴集团控股有限公司 A voice adding method and device, a voice play method and device, a picture classifying method and device, and a picture search method and device
US9935777B2 (en) 2015-08-31 2018-04-03 Adobe Systems Incorporated Electronic signature framework with enhanced security
US9626653B2 (en) 2015-09-21 2017-04-18 Adobe Systems Incorporated Document distribution and interaction with delegation of signature authority
US9978366B2 (en) 2015-10-09 2018-05-22 Xappmedia, Inc. Event-based speech interactive media player
US10228775B2 (en) * 2016-01-22 2019-03-12 Microsoft Technology Licensing, Llc Cross application digital ink repository
US10347215B2 (en) 2016-05-27 2019-07-09 Adobe Inc. Multi-device electronic signature framework
US10229680B1 (en) * 2016-12-29 2019-03-12 Amazon Technologies, Inc. Contextual entity resolution
US10503919B2 (en) 2017-04-10 2019-12-10 Adobe Inc. Electronic signature framework with keystroke biometric authentication
EP1184782A2 (en) * 2000-08-29 2002-03-06 Sharp Kabushiki Kaisha On-demand interface device and window display for the same
WO2002068886A1 (en) * 2001-02-23 2002-09-06 Electrolux Professional S.P.A. Kitchen and/or domestic appliance
WO2003050668A2 (en) 2001-12-13 2003-06-19 Koninklijke Philips Electronics N.V. Gui with voice control system
US6668244B1 (en) * 1995-07-21 2003-12-23 Quartet Technology, Inc. Method and means of voice control of a computer, including its mouse and keyboard
US20040122674A1 (en) * 2002-12-19 2004-06-24 Srinivas Bangalore Context-sensitive interface widgets for multi-modal dialog systems
US5704029A (en) * 1994-05-23 1997-12-30 Wright Strategies, Inc. System and method for completing an electronic form
US20020099552A1 (en) * 2001-01-25 2002-07-25 Darryl Rubin Annotating electronic information with audio clips
US7107533B2 (en) * 2001-04-09 2006-09-12 International Business Machines Corporation Electronic book with multimode I/O
US7174323B1 (en) * 2001-06-22 2007-02-06 Mci, Llc System and method for multi-modal authentication using speaker verification
US7036080B1 (en) * 2001-11-30 2006-04-25 Sap Labs, Inc. Method and apparatus for implementing a speech interface for a GUI
US7246063B2 (en) * 2002-02-15 2007-07-17 Sap Aktiengesellschaft Adapting a user interface for voice control
US7257769B2 (en) * 2003-06-05 2007-08-14 Siemens Communications, Inc. System and method for indicating an annotation for a document
US7506271B2 (en) * 2003-12-15 2009-03-17 Microsoft Corporation Multi-modal handwriting recognition correction
US20060031755A1 (en) * 2004-06-24 2006-02-09 Avaya Technology Corp. Sharing inking during multi-modal communication
US20060007189A1 (en) * 2004-07-12 2006-01-12 Gaines George L Iii Forms-based computer interface
US8079079B2 (en) * 2005-06-29 2011-12-13 Microsoft Corporation Multimodal authentication
US7694214B2 (en) * 2005-06-29 2010-04-06 Microsoft Corporation Multimodal note taking, annotation, and gaming
2006-11-07 EP EP20060023167 patent/EP1791053A1/en not_active Withdrawn
US8521538B2 (en) 2008-08-07 2013-08-27 Vocollect Healthcare Systems, Inc. Voice assistant system for determining activity information
US10431220B2 (en) 2008-08-07 2019-10-01 Vocollect, Inc. Voice assistant system
CN103186326B (en) * 2011-12-27 2017-11-03 联想(北京)有限公司 A kind of application operating method and electronic equipment
US9966065B2 (en) 2018-05-08 Multi-command single utterance input method
US10191940B2 (en) 2019-01-29 Gesture-based searching
US9158757B2 (en) 2015-10-13 System and method for preview and selection of words
US7895534B2 (en) 2011-02-22 Information processing apparatus, control method therefor, and program
CA2501118C (en) 2011-02-08 Method of combining data entry of handwritten symbols with displayed character data
KR101037266B1 (en) 2011-05-26 Systems and methods that utilize a dynamic digital zooming interface in connection with digital inking
US6144380A (en) 2000-11-07 Method of entering and using handwriting to identify locations within an electronic book
DE112016003459T5 (en) 2018-04-12 speech recognition
US7966352B2 (en) 2011-06-21 Context harvesting from selected content
US7137076B2 (en) 2006-11-14 Correcting recognition results associated with user input
US20150067519A1 (en) 2015-03-05 Device, Method, and Graphical User Interface for Manipulating Framed Graphical Objects
US8595642B1 (en) 2013-11-26 Multiple shell multi faceted graphical user interface
US9575720B2 (en) 2017-02-21 Visual confirmation for a recognized voice-initiated action
JP2010517150A (en) 2010-05-20 Document changes
KR20140051228A (en) 2014-04-30 Submenus for context based menu system
US7954063B2 (en) 2011-05-31 Methods and systems for assigning an attribute value to an object
JP2011525665A (en) 2011-09-22 Display of teaching videos on the user interface display
DE112013002409T5 (en) 2015-02-26 Apparatus, method and graphical user interface for displaying additional information in response to a user contact
US6462760B1 (en) 2002-10-08 User interfaces, methods, and computer program products that can conserve space on a computer display screen by associating an icon with a plurality of operations
KR20130001261A (en) 2013-01-03 Multimodal text input system, such as for use with touch screens on mobile phones
US8886521B2 (en) 2014-11-11 System and method of dictation for a speech recognition command system
US7721226B2 (en) 2010-05-18 Glom widget
US8056070B2 (en) 2011-11-08 System and method for modifying and updating a speech recognition program
US20130111380A1 (en) 2013-05-02 Digital whiteboard implementation
US7458038B2 (en) 2008-11-25 Selection indication fields
Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR
Countries concerned: ALBAHRMKYU
2008-02-06 AKX Designation fees paid
2014-10-22 RAP1 Rights of an application transferred
Owner name: SAP SE
2016-02-24 18D Application deemed to be withdrawn