Coming Soon: Turn Your Kitchen Counter Into a Touch Screen
Discover how touch projection technology might turn your tables and countertops into iPad-like devices — and sooner than you think
Mike Elgan
April 30, 2013
Houzz Contributor. I'm a Silicon Valley-based writer, columnist and blogger, covering technology and culture. http://elgan.com
Houzz Contributor. I'm a Silicon Valley-based writer, columnist and blogger, covering... More
The futurist consensus is that someday household surfaces, like kitchen counters and refrigerator doors, will function like giant iPads, with Internet-connected interactive touch displays. No, not built-in displays. Entire surfaces will be usable as interactive computers.
It sounds like far-fetched, space-age technology, and expensive, too. And the idea of replacing choice pieces of your home decor with big screens sounds horrible. But in fact, none of that is the case. That's because touch displays don't require a new counter or fridge. It's possible even today to convert any surface into an interactive touch display using projected light and camera sensors.
This has long been a central feature of Microsoft Home, which is a showcase house built to demonstrate futuristic ideas from Microsoft Research.
It sounds like far-fetched, space-age technology, and expensive, too. And the idea of replacing choice pieces of your home decor with big screens sounds horrible. But in fact, none of that is the case. That's because touch displays don't require a new counter or fridge. It's possible even today to convert any surface into an interactive touch display using projected light and camera sensors.
This has long been a central feature of Microsoft Home, which is a showcase house built to demonstrate futuristic ideas from Microsoft Research.
The Microsoft Home kitchen uses projection displays to beam information and recipes right onto the surface of the countertop. The dining room tablet has games projected onto that surface, as well as step-by-step instructions for crafts.
Even more advanced than Microsoft's prototype is its "Vision" video, which projects into the future (pun intended) how projector touch displays will work in five to 10 years. A girl builds a product on a touch tablet in this scene:
But an overhead projector extends the animation beyond the tablet and onto the table. Then she does the same thing with recipes. (Microsoft actually has a patent for this and could even ship the technology this year in the next version of its Xbox gaming system.) Her dad checks the contents of the fridge without opening the door, also with a projector touch display.
The content, and even the interface, is almost irrelevant. That merely requires programmers to write software, which they will do once this technology is more widespread. It's possible with relatively inexpensive projectors and cameras to turn any household surface into a powerful, huge interactive touch display that can be conjured up or dismissed at any time. When it's gone, no tech is visible.
Even more advanced than Microsoft's prototype is its "Vision" video, which projects into the future (pun intended) how projector touch displays will work in five to 10 years. A girl builds a product on a touch tablet in this scene:
But an overhead projector extends the animation beyond the tablet and onto the table. Then she does the same thing with recipes. (Microsoft actually has a patent for this and could even ship the technology this year in the next version of its Xbox gaming system.) Her dad checks the contents of the fridge without opening the door, also with a projector touch display.
The content, and even the interface, is almost irrelevant. That merely requires programmers to write software, which they will do once this technology is more widespread. It's possible with relatively inexpensive projectors and cameras to turn any household surface into a powerful, huge interactive touch display that can be conjured up or dismissed at any time. When it's gone, no tech is visible.
Touch projection technology is already here. It's just not widely distributed yet. A restaurant in London called Inamo projects its menu from the ceiling onto the tables, as well as projects custom "tablecloths." Diners order from the touch display projected onto the tables. A menu of other options includes interactive games and a service for ordering a cab.
The technology is something of a gimmick, designed to entertain restaurant customers. But it also proves the feasibility and functionality of such display technology.
The technology is something of a gimmick, designed to entertain restaurant customers. But it also proves the feasibility and functionality of such display technology.
A widely available and inexpensive gadget called the Celluon Magic Cube projects a red laser keyboard onto any table or desk. When the user taps on the projected keys, the keystrokes are registered on any newish OS X, iOS, Windows, Android or Windows Phone device. It also works as an invisible "mouse."
You might consider the Magic Cube to be a rudimentary proof of concept for things to come. It projects only one color and only lines, numbers and letters. The "resolution" of the touch interaction is fairly crude. Yet it's an inexpensive product (just over $100) and uses just one camera with the projector in the same device. And it works.
Imagine what will be possible with multiple cameras, no requirement for battery operation and better software.
You might consider the Magic Cube to be a rudimentary proof of concept for things to come. It projects only one color and only lines, numbers and letters. The "resolution" of the touch interaction is fairly crude. Yet it's an inexpensive product (just over $100) and uses just one camera with the projector in the same device. And it works.
Imagine what will be possible with multiple cameras, no requirement for battery operation and better software.
A company called Ubi Interactive is working on software that uses any projector plus Microsoft's Kinect for Xbox 360 product to turn any surface into an interactive touch screen. Kinect for Xbox 360 is a low-cost add-on for Microsoft's Xbox gaming system that is usually used for in-the-air motion-sensing games.
Ubi's software uses the Kinect sensors to figure out where people are touching, pointing, tapping or swiping on a surface, and how that relates to the projected interface. One benefit of the software is that it will work with regular, off-the-shelf products. For example, it will project and control Windows software, so you'll be able to project any Windows game or application onto a wall out of the box. You'll also be able to use it with any projector. All you'll need is the Ubi software and a surface to project onto.
The $149 software is available for preorder.
Ubi's software uses the Kinect sensors to figure out where people are touching, pointing, tapping or swiping on a surface, and how that relates to the projected interface. One benefit of the software is that it will work with regular, off-the-shelf products. For example, it will project and control Windows software, so you'll be able to project any Windows game or application onto a wall out of the box. You'll also be able to use it with any projector. All you'll need is the Ubi software and a surface to project onto.
The $149 software is available for preorder.
The Japanese company Fujitsu has done some incredible research with video projection displays. The most impressive is a projection product that integrates real-world objects. The way it works is that with a simple gesture a book, magazine page or picture can be scanned and then converted into a digital version in the same place, and at the same size as the original.
For example, let's say your projector displays four electronic bills on the kitchen table, plus you've got a paper bill that came in the mail. By simply drawing your finger diagonally across the paper, you could digitize the paper bill. You could then toss the paper version and use the electronic one in its place.
Another use for the technology is to make paper pictures and documents interactive. For example, advertisers could put codes in ads; when you lay the ad flat on the table and touch the code, interactive videos or coupons or other information could appear to jump right off the page.
Fujitsu plans to start selling the product in 2014. Its name and price have not yet been announced.
For example, let's say your projector displays four electronic bills on the kitchen table, plus you've got a paper bill that came in the mail. By simply drawing your finger diagonally across the paper, you could digitize the paper bill. You could then toss the paper version and use the electronic one in its place.
Another use for the technology is to make paper pictures and documents interactive. For example, advertisers could put codes in ads; when you lay the ad flat on the table and touch the code, interactive videos or coupons or other information could appear to jump right off the page.
Fujitsu plans to start selling the product in 2014. Its name and price have not yet been announced.
Related Stories
Media Rooms
10 Stylish and Comfortable Home Theaters
Find ideas for seating arrangements, furnishings and more in spaces large and small
Full Story
Events
4 Trends in Smart Appliances and Features at CES 2021
The Consumer Electronics Show revealed a push toward customization, integration, relaxation and cleanliness at home
Full Story
Life
6 Video Backdrops to Elevate Your Work-From-Home Time
By Janet Paik
Spruce up your next video conference call with an instant virtual design makeover
Full Story
Inside Houzz
Cover Your Floor in Virtual Tile Using Houzz’s Enhanced App
By Houzz
The updated View in My Room 3D tool lets you virtually cover your space with tile to see how new flooring would look
Full Story
Kitchen Design
These New Products Aim to Make Your Kitchen Smarter
By Erin Carlyle
The latest appliances use home assistants, apps and sensors to help you shop, prep, cook and communicate
Full Story
Bathroom Design
Tech Brings More Luxury and Convenience to the Bathroom
By Erin Carlyle
The latest products include voice- and remote-controlled mirrors, showers and toilets, as well as zero-gravity tubs
Full Story
Inside Houzz
How Technology Is Making Its Way Into the Kitchen
By Erin Carlyle
Home assistants and tablets are on the rise in kitchen remodels, according to the 2019 U.S. Houzz Kitchen Trends Study
Full Story
Wall Treatments
Frames of the Future: The Latest Ways to Display Photos and Art
Digital frames and photos have evolved in recent years, and how we interact and decorate with them can too
Full Story
Design Pop
Dive Into the Best Home Theater Setups for Shark Week
As the Discovery Channel’s annual shark salute turns 30, sink your teeth into pro tips for screens, sound and seating
Full Story
Design for Good
Can 3D-Printed Homes Solve the Global Housing Crisis?
By Erin Carlyle
A San Francisco nonprofit and an Austin, Texas, tech firm aim to bring printed concrete homes to El Salvador next year
Full Story
I love how connected tech can keep us to those we love. I have friends in more than 20 countries and love that I can reach out and communicate with them instaneously whever they are.
I'm going to watch the 2nd corning video now.
Gilliane, I have friends who feel the same. No issues. But I find it interesting that you mention six degrees of abstraction from what is real as determined by our senses. If you delve into quantum physics you'll see that our senses are merely interpreting energy so that we perceive it as real. That is one reason why we do not all see the same (our interpretation devices (eyes, for example) are set to different settings. It is why neither is wrong when two people argue about what color something is - each is seeing it the way it shows up on their monitor. We just think we all see the same because we have come to a lot of agreements and make a lot of assumptions. I see the tech as expanding our ability to interpret. From the earliest TV's and radio's to the more sophisticated gadgets of today - they all just do very specialized jobs of what our senses have always done. But we still use our brains to interpret the output.
It is all about how one uses them. Tech can be used to withdraw and be isolated from life and others or to embrace life on a broader scale and connect with others in an expansive way.
Thanks for this article. I am watching all of this closely as the house plans firm up and try to anticipate what will be needed to incorporate the features I will benefit from the most.
I also love looking behind the scenes. How much fun it must be to have this sort of idea and be able to bring it to fruition. The creativity that can become reality today is positively delicious.