• MSN
  • Hotmail
  • More
    • Autos
    • My MSN
    • Video
    • Careers & Jobs
    • Personals
    • Weather
    • Delish
    • Quotes
    • White Pages
    • Games
    • Real Estate
    • Wonderwall
    • Horoscopes
    • Shopping
    • Yellow Pages
    • Local Edition
    • Traffic
    • Feedback
    • Maps & Directions
    • Travel
    • Full MSN Index
  • Bing
  • NBCNews.com
  • TODAY
  • Nightly News
  • Rock Center
  • Meet the Press
  • Dateline
  • msnbc
  • Breaking News
  • Newsvine
  • Home
  • US
  • World
  • Politics
  • Business
  • Sports
  • Entertainment
  • Health
  • Tech
  • Science
  • Travel
  • Local
  • Weather
Advertise | AdChoices
  • Recommended: House GOP: Don't grab an asteroid — let's put bases on moon and Mars
  • Recommended: Sally Ride and Neil Armstrong: Space icons get new round of remembrance
  • Recommended: Space station crew opens Europe's Einstein cargo ship after fungus flap
  • Recommended: NASA wants you ... to join Grand Challenge to hunt down asteroids

Quantum fluctuations in science, space and society, from quarks to Hubble and Mars. Served up by Alan Boyle, NBC News Digital science editor. E-mail Alan, or connect via Facebook, Twitter or Google+.

  • ↓ About this blog
  • ↓ Archives
    • Icons Email E-mail updates
    • Icons Twitter Follow on Twitter
    • Icons Feed Subscribe to RSS
  • 5
    Jul
    2011
    1:08pm, EDT

    Kinect inspires bionic vision for the blind

    Dr. Stephen Hicks/Oxford University

    By Winda Benedetti

    While some scientists have been busy using Kinect for the forces of eeevil (read: to turn helicopters into our future robot overlords), it seems others have been busy using the motion-sensing game controller for good (read: to help the blind see).

    Oxford University researcher Dr. Stephen Hicks (our hero) is working on a pair of glasses that will help people with a very small amount of vision see again. And he was inspired — at least in part — by the Kinect game controller.


    Hicks' prototype for the spectacles just went on display at the Royal Society's Summer Science Exhibition in London.

    The glasses have tiny cameras built into the frames and small LED lights built into the lenses and are attached to a small but sophisticated computer that detects what's in front of the user. The computer behaves like a small robot, seeking out things of interest and presenting them to the person wearing the glasses in a simplified way.

    Hicks has said that Kinect — the camera-based motion-sensing controller for the Xbox 360 — as well as the iPad have helped inspire some of his team's work.

    "These days computers are small enough and powerful enough to do a lot of real time visual processing such as person recognition or depth recognition and in certain cases to be able to read words," Hicks explains. "The simple idea is that the computer will recognize objects of interest and display them in a way that is simplified and bright enough for a person who has only a small amount of sight."

    Hicks says his aim is to make the glasses as discreet as possible and also as cheap as possible so the average person will be able to afford them. The lightweight glasses will look essentially like normal glasses (see picture above) and the small computer they're attached to will use basically the same components that are used in smartphones, he says.

    You can see Dr. Hicks discuss the project in more detail here:

    Watch on YouTube

    Now, here's hoping these glasses also will be able to detect an incoming Kinect-controlled quadrocopter attack. For the sake of all humanity.

    Thanks to Kotaku for the heads up.

    For more gaming news, check out:

    • Kinect quadrocopter flight, perfected by Swiss researchers
    • Kinect-controlled helicopter scores win for robot overlords
    • The Force is strong with "Star Wars: Kinect"
    • Martial artist shows off real life motion control gaming
    • Dance Central 2' delivers more dancers, music, laughs

    Winda Benedetti writes about gamesfor msnbc.com. You can follow her tweets about games and other things right here on Twitter.

    3 comments

    Fabulous!!!!

    Show more
    Explore related topics: microsoft, research, vision, blind, video-games, featured, motion-control, kinect
  • 13
    Apr
    2011
    5:06pm, EDT

    Control the cosmos with your fingers

    Microsoft Research's Curtis Wong zooms in on Saturn.

    By Alan Boyle, Science Editor, NBC News

    What do you get when you cross a WorldWide Telescope with a Kinect motion-sensing game controller? You get the “universe at your fingertips,” according to Microsoft Research’s Curtis Wong, who demonstrated the gesture-controlled cosmos today at the MIX11 conference in Las Vegas.

    Actually, having the universe at your fingertips is how Wong has thought of the freely available WorldWide Telescope project since it was first unveiled in 2008. The software, which is freely available through a Web-based interface and as a standalone program, displays the night sky and lets users zoom in on cosmic imagery from a wide variety of sources. You can even go on 3-D fly-throughs of distant galaxies, or create your own tours of celestial hot spots.

    But back then, Wong was talking in terms of fingertips tapping on a keyboard or guiding a computer mouse. Now, thanks to the Microsoft's Kinect controller, he can control the cosmos on a trio of high-definition video projectors, just by waving his hands in the air. (Msnbc.com is a joint venture of Microsoft and NBC Universal.)


    "If I just move my fingers out about a half-inch, the earth suddenly begins zooming in, more and more. ... Then I bring my fingers together, and the earth retreats," Wong told me.

    The effect is similar to the hand-waving tricks that Tom Cruise's character used to manipulate virtual displays in the movie "Minority Report" — only better, at least in Wong's estimation. "First of all, Tom Cruise had to wear these funny gloves with lights on them," Wong said. "We don't have to do that. ... We have a lot more control than he did. He had to move things on a 2-D surface and rotate them."

    Subtle gestures can be coupled with voice commands to navigate through a 3-D computer model of the universe. You can set a planet spinning or change the perspective on our Local Group of galaxies just by moving your fingers, hands or arms. "The motions that we're doing with the universe are fairly subtle," Wong said.

    The sky's not the limit
    The system capitalizes on Kinect's multiple-sensor, hands-free gaming system, which processes depth data as well as audio and 2-D video as a way of letting users interact with 3-D virtual worlds through gestures, jumps and other body movements. The system has already been hacked to create virtual-reality superheroes, sign-language translators, seeing-eye guides for the blind and even touch-sensitive robo-surgeons.

    In recognition of Kinect's hackability, Microsoft is planning to release a non-commercial software development kit for Kinect sometime this spring. Anoop Gupta, distinguished scientist at Microsoft Research, told me that the kit is "on track" to ship within weeks. Wong declined to lay out a timetable for making the Kinect connection available to WorldWide Telescope users, but it would make sense if it rolled out at about the same time as the software development kit.

    The most obvious setting for a Kinect-enabled planetarium program would be in a classroom — or, come to think of it, in an actual planetarium, where a teacher or guide could control a sky show from center stage rather than from behind a computer monitor. Home users could conceivably get a kick out of flying through the virtual solar system via a Kinect controller and a big-screen TV. And there might be an eventual payoff for PC users as well. Gupta told me that Kinect's developers were thinking about "not just the 10-foot experience, but the 2-foot experience."

    Of course, the new possibilities would apply to PC gamers as well: In addition to the WorldWide Telescope demo, today's MIX11 session featured a Kinect-powered "Wall Panic" PC game, in which players contort their bodies to match a series of Tetris-style shapes that flash on a large screen.

    Looking farther down the software development road, Gupta gushed about potential applications ranging from yoga instruction to remote-controlled robotics. "I think the possibilities are endless," he told me. "We are looking to the community to see how they put this to use."

    More about sky software:

    • Sharing the Google Sky
    • Science thrives in virtual worlds
    • Planet hunters sift through data
    • Biggest picture of the sky unveiled

    Join the Cosmic Log community by clicking the "like" button on our Facebook page or by following msnbc.com science editor Alan Boyle as b0yle on Twitter. To learn more about Alan Boyle's book on Pluto and the search for planets, check out the website for "The Case for Pluto."

    3 comments

    Even from the start I've thought that the Kinect has much more potential beyond being a game controller.

    Show more
    Explore related topics: technology, space, games, video, featured, worldwide-telescope, kinect

Browse

  • featured,
  • science,
  • space,
  • images,
  • nasa,
  • innovation,
  • cosmic-log,
  • video,
  • john-roach,
  • tech-science,
  • mars,
  • new-space,
  • daily-dose,
  • technology,
  • energy,
  • participation,
  • environment,
  • whimsy,
  • holiday-calendar,
  • planets,
  • archaeology,
  • physics,
  • on-the-fringe,
  • curiosity,
  • spacex,
  • moon,
  • books,
  • msl,
  • politics,
  • aurora,
  • hubble,
  • sun,
  • robot,
  • religion,
  • japan,
  • 3-d,
  • asteroids,
  • iss,
  • updated,
  • movies,
  • genetics,
  • astrobiology,
  • evolution,
  • saturn,
  • automotive
Also
Advertise | AdChoices

Winda Benedetti

writes about games for msnbc.com. That's right, she gets paid to play video games for a living. No really, it's harder than it sounds.

  • Read her previous stories here
  • follow Winda Benedetti on Twitter

Alan Boyle, Science Editor, NBC News

Science editor at msnbc.com, author of "The Case for Pluto," winner of the National Academies Communication Award for Cosmic Log in 2008. Alan Boyle covers the physical sciences, anthropology, technological innovation and space science and exploration for msnbc.com. Check out Cosmic Log's archives by following the links below, and see Boyle's full biography at http://bit.ly/boyle-bio

Alan Boyle, Science Editor, NBC News Blogroll

  • Bad Astronomy
  • CollectSpace
  • Cosmic Variance
  • Curmudgeons Corner
  • Discovery News
  • The Daily Grail
  • EarthSky
  • GeekPress
  • Habitable Zone
  • HobbySpace Log
  • LiveScience
  • The Loom
  • NASA Watch
  • NASA Spaceflight
  • Out of the Cradle
  • SciDev.net
  • Science Blog
  • ScienceBlogs
  • Science Quest
  • SciAm Observations
  • Seed Magazine
  • Slashdot Science
  • Space.com
  • Spaceflight Now
  • Space Fellowship
  • The Space Review
  • Transterrestrial Musings
  • Universe Today
  • Unmanned Spaceflight
  • Phenomena
  • Planetary Society Blog
  • Science News
  • Popular Mechanics
  • Popular Science
  • Science Insider
  • NASAEngineer.com
  • EurekAlert
  • Nature: The Great Beyond
  • Space Daily
  • Space Politics
The Case for Pluto
Alan Boyle's first book tells the story of Pluto's ups and downs as well as the discoveries of other dwarf planets in our own solar system and even more alien worlds beyond. Buy "The Case for Pluto" ...

Archives

  • 2013
    • June (30)
    • May (48)
    • April (55)
    • March (53)
    • February (44)
    • January (45)
  • 2012
    • December (65)
    • November (12)
    • October (39)
    • September (43)
    • August (62)
    • July (45)
    • June (51)
    • May (46)
    • April (40)
    • March (56)
    • February (63)
    • January (66)
  • 2011
    • December (89)
    • November (73)
    • October (62)
    • September (67)
    • August (61)
    • July (70)
    • June (82)
    • May (86)
    • April (69)
    • March (94)
    • February (67)
    • January (82)
  • 2010
    • December (118)
    • November (62)
    • October (82)
    • September (63)
    • August (62)
    • July (54)
    • June (83)
    • May (51)
    • April (31)
    • March (35)
    • February (36)
    • January (35)
  • 2009
    • December (42)
    • November (34)
    • October (35)
    • September (40)
    • August (32)
    • July (38)
    • June (45)
    • May (37)
    • April (42)
    • March (38)
    • February (37)
    • January (35)
  • 2008
    • December (33)
    • November (31)
    • October (42)
    • September (48)
    • August (35)
    • July (37)
    • June (42)
    • May (43)
    • April (40)
    • March (39)
    • February (42)
    • January (42)
  • 2007
    • December (29)
    • November (40)
    • October (57)
    • September (35)
    • August (47)
    • July (38)
    • June (44)
    • May (44)
    • April (43)
    • March (40)
    • February (41)
    • January (47)
  • 2006
    • December (45)
    • November (49)
    • October (39)
    • September (50)
    • August (58)
    • July (45)
    • June (56)
    • May (8)

Most Commented

  • This is your brain on fatherhood: Dads experience hormonal changes too, research shows (73)
  • How duct tape patched up the world – and why we're still sticking with it (39)
  • Laser scans flesh out the saga of Cambodia's 1,200-year-old lost city (45)
  • Duhhh-WHAT-cho? Find out how a derecho packs its windy punch (16)
  • China's Shenzhou 10 spaceship brings crew to orbital lab for practice (21)
  • From Superman saga to real-life science: It's not an impossible leap (17)
  • NASA wants you ... to join Grand Challenge to hunt down asteroids (15)

Other blogs

  • Red Tape Chronicles
  • PhotoBlog
  • US News
  • Open Channel

NBCNews.com top stories

3147,10
© 2013 NBCNews.com
  • Science on NBCNews.com
  • About us
  • Contact
  • Help
  • Site map
  • Careers
  • Closed captioning
  • Terms & Conditions
  • Privacy policy
  • Advertise