Imagine Cup 2012: Team Australia “Stethocloud” diagnoses pneumonia with Windows Phones

With it’s home base advantage, the Australian team is a hot contender at Microsoft’s Imagine Cup 2012 worldwide finals in Sydney, trying to decrease the number one cause of childhood deaths with a Windows Phone-powered health solution.

This afternoon team Stethocloud presented their first presentation to a packed room of judges and supporters, including but not limited to many of Microsoft Australia’s developer evangelism team and Pip Marlow, Managing Director of Microsoft Australia.

Their 30-minute presentation was very similar to their Australian finals presentation which I saw a few months ago. The problem they are tackling is pneumonia, which kills nearly 2 million children due to a lack of early detection. Many of the affected are in developing countries.

Their solution is centred around a custom “stethomic” stethoscope they built that plugs straight into an ubiquitous 3.5mm audio jack of most phones. Even with all the custom cabling, microphone and filtering they do, they predict these devices will only cost $15-25 to manufacturer at scale.

To complement the hardware, they demoed a Windows Phone client that takes the breathing sounds generated by the stethomic and converts it into a digital audio file that gets sent to a Windows Azure-powered cloud service for analysis and diagnosis.

Running custom audio algorithms on Windows Azure that strips away unwanted background noise, they are then able to detect and count individual breaths. By cross-referencing the official health handbook for diagnosing childhood pneumonia, they are able to accurately identify in seconds whether a patient has it or not.

Even in developed countries, trained healthcare professionals have trouble accurately diagnosing pneumonia. Their solution, the combination of hardware, phone software and cloud service allows for reliable, cheap and untrained diagnosis of pneumonia where early detection is essential for successful treatment.

To address the needs of developing countries without 3G data services, the team also has a Java J2ME port of their solution to run on even basic Nokia phones. Of course the advantage of the smartphone & cloud-powered solution is the “big data” that accumulates over time, leading to continuously improved diagnosis.

The team, who some are actual medical students, are currently seeking a clinical trial at the Royal Melbourne Children’s Hospital. Once successful, they hope to prove the technology by demonstrating its effectiveness on real patients.

The Australian team is just one of the dozen teams at this year’s Imagine Cup finals that seems to have a project related to healthcare or disabilities and a solution integrating either Windows Phone or Kinect. Naturally saving or enriching people’s lives makes for a compelling presentation.

The cool thing is even if this teams doesn’t win, their technology has shown to have considerable potential impact and benefit for a large number of people in developing countries. Their “stethomic” product alone has wider applications in detecting respiration-related issues.

You can find more photos of their presentation on my Flickr here.

Update: Unfortunately Team Australia did not advance into the finals of the Imagine Cup 2012 world finals.

Imagine Cup 2012 kicks off in Sydney Australia

Tonight, inside the Sydney Convention Centre at the heart of Sydney’s Darling Harbour, Microsoft’s annual Imagine Cup worldwide finals kicked off with the official opening ceremony. As a past worldwide winner at the 2008 Paris event, this event brings back a lot of fun memories and it’s great to see the event stronger than ever.

This year marks the 10th year of the competition which invites students all around the world to a competition where “technology intersects global problems”, as described by Dan’l Lewin, corporate VP for Strategic and Emerging Business Development at Microsoft.

Over 350 students in teams from around 75 countries are here in Australia to compete for an array of categories and prizes, including but not limited to the prestigious software design category which the winners will receive $20,000 in cash from the pool over $175,000 in total prizes.

At the opening ceremony, Microsoft will also randomly picked four student teams from Tunisia, Belgium, Bosnia and South Korea to go to their annual developer conference (presumably BUILD 2012), all expenses paid for.

Nokia, who is a platinum sponsor of the event also announced tonight they will be providing each participating student a free Nokia Lumia 800. All finalists will also receive a special certificate signed by Bill Gates and Steve Ballmer (we didn’t have this in 2008).

The competition will span over the next 4 days where teams will present up to three times to three sets of judges who will score their projects on problem definition, solution innovation, technical and design implementation, business viability and presentation.

New to this year’s competition is a demo portion to prove the project’s tangibility with real functionality. I think this is a good addition that should help separate the projects that claim to work and projects that actually work – rewarding teams that put in the extra work.

To give students a breather during the competition, Microsoft Australia have also gone the extra mile to organize some fun cultural events to give visiting students a taste of Australia, including but not limited to the opportunity to climb the Sydney Harbour Bridge, sponsored by Internet Explorer.

I look forward to the winning teams and their projects who will be announced next Tuesday evening. Good luck to all.

Microsoft Bing’s Stefan Weitz gives TEDx talk: “Make No Plans: The Power of Serendipity”

Stefan Weitz is the director of search at Microsoft Bing. I just came across this fascinating TEDx talk he gave at Parker School in Chicago last month titled “Make No Plans: The Power of Serendipity”. During the 22 minute talk, he covers the topics of his own life experiences in Australia, neuroscience, chaos theory, accidental discoveries and personal networks, all to make a point that long-term planning in life might not pay off as well as you think.

I owe Stefan for propping my “Real Live Search” instant-Bing-search project to USA Today fame in an interview he gave after Google introduced Instant in 2010.

LG 3D Cinema TV challenge for lots of 3D fun

When a 3D TV shows up at your doorstep, it’s hard to refuse. LG Australia ran a competition this month that asked various Aussie bloggers to try out a new 3D Cinema TV along with coupons to purchase movies and drinks to just have fun with friends. The videos with the most views also get to keep the TV and win another one to give away.

Needless to say, challenge accepted.

Having experienced 3D before in both cinemas and other brand TVs, I was genuinely curious how good the 3D would be on this device since it utilizes passive technology – glasses are just polarized filters and do not require batteries.

It turns out to be actually quite impressive for real 3D content, some of what we tried include TRON: Legacy 3D Blu-Ray, Kinect Star Wars and Halo Anniversary Edition. For B-grade 3D material (automatically converted, sample material), the effect was much less convincing.

It hadn’t occurred to me the XBOX 360 supported 3D games until just a couple of days ago – Kinect Star Wars works quite well. Speaking of which, it’s hard to top the dancing to the Star Wars dancing game with 3D glasses on.

There’s also a cool “Dual-Play” feature that enables two special glasses to shows two different images to two different players in a split-view game. This could finally end the screen-cheating debate that dates all the way back to Goldeneye for the Nintendo 64.

The LG Cinema TV also includes the SmartTV technology which enables native WiFi network access to power built-in apps and third-party apps which adds quite an interesting set of features to the TV. The most interesting of which is the web browser which is quite capable with modern websites. The “Wii-like” motion controller the TV comes with actually makes navigation quite easy compared to a standard controller.

Having direct access to free TV show streaming services from free-to-air TV stations like Yahoo7, ABC and SBS is convenient. If TV isn’t your thing, then there’s also YouTube, Twitter and even Facebook. The LG Smart World app store also has a bunch of simple games and interactive content to keep kids entertained like “If You’re Happy and You Know it” singalongs.

The LG TV in the video is a 47LM8600 which retails for about AUD$2799.

Special thanks to Rory McNeice for being the star of the video and Dinesh George for his editing work.

Designing MetroTwit for Windows 8

The “preview” version of MetroTwit for Windows 8 is finally available in the Windows Store.

We know it’s still a bit rough around the edges and not feature complete but we hope it offers a teaser of what we think will be a compelling Twitter app for Windows 8 users.

Designing MetroTwit for Windows 8 was no walk in the park. We couldn’t simply copy and paste our desktop application’s source code; WPF code doesn’t port to WinRT as well as you may have heard. But regardless, that code wasn’t designed for touch. A tough challenge to say the least.

Fortunately we had the opportunity to work with some experienced Microsoft folks who provided invaluable feedback to form the design you see today. It’s a whole new (and better) app from the ground up.

On the home screen, you will find a simple but powerful multi-column layout that allows you to keep tabs on multiple conversations at once. Our in-app live tiles provide at-a-glance and one-tap access to all the stuff you care about on Twitter. This combination should satisfy the needs of both casual and professional Twitter users.

To maximize screen real-estate and functionality, we hide most tweet options and action buttons in the application bar. This bar only appears when additional functionality is available.

We also implemented an app-wide tweet compose window. This window is layered on top of whatever you’re doing, allowing you to still interact with the page underneath. You won’t need to remember the entire tweet conversation you’re responding to.

Mouse support in Metro also presents a whole new set of challenges. We designed for both mouse and touch from the start and believe we found a good balance between the two in terms of usability.

We are proud to be one of the first applications that have built-in support for “edge scrolling”, that is, a type of horizontal scrolling triggered by the mouse when it reaches a vertical screen edge (as seen in the Start Screen). We believe this is a necessity for mouse usability in a panoramic Metro experience.

MetroTwit for Windows 8 also includes a comprehensive and almost no-compromise Snap view. Snap is a killer new feature in Windows 8 and having the app docked beside Internet Explorer or the desktop works great.

We still have a lot of work ahead of us but feel free to give the preview version in the Windows Store a whirl. We definitely want to hear from all our users to help shape the future of MetroTwit.

Microsoft Connected Car Platform envision car with Kinect, Windows 8, Win Phone, TellMe and more

Microsoft’s Channel9 Project Detroit car modification created a
1967 Ford Mustang Fastback outfitted with the latest in Microsoft technology.

The Microsoft Connected Car team is dreaming big for the future of automotive technology assistance.

In a recent job posting, the team teased an outline of their plans to leverage the full suite of current and upcoming Microsoft products and technologies to create a compelling automotive platform that sounds like the gizmo-car from the Knight Rider.

We, the Microsoft Connected Car team, have a strong track record and an extensive customer base in the automotive industry. In the past fourteen years, we delivered various iterations of our Windows Embedded Automotive platform to the automotive suppliers of major auto brands such as Honda, Nissan, BMW, Mercedes-Benz, Aston Martin, and McLaren. We also partnered directly with select automakers to create integrated Telematics products such as Fiat Blue&Me, Ford SYNC, and Kia UVO. Featuring cutting-edge communications, travel information, entertainment, and accessory control via voice and touch interfaces, these products have been highly successful, increasing the automakers’ US sales of by up to 35% and telematics adoption up to 70%.

Yet our ambitions do not end there. For the next generation of the Connected Car Platform, we plan to leverage the full power of the Microsoft ecosystem including Kinect, Windows 8, Windows Phone, Windows Live, Bing, Azure, and Tellme. The combination of rich local sensing, user identification, cloud access, and data mining will transform tomorrow’s cars from passive objects into intelligent assistants for both the driver and their passengers. The new Connected Car will know its riders, and will interact with them naturally via speech, gestures, and face tracking. It will learn their habits, and offer personalized contextual information and driving assists to get them to their destination as quickly and safely as possible. Through a growing catalogue of applications, it will inform and entertain them, and keep them connected with the people and information they care about. The possibilities are endless.

With those goals in mind, perhaps the Connected Car team should have a talk with the Channel9 team who in March of this year showed off the final result of Project Detroit, an experiment to outfit a 1967 Ford Mustang Fastback with a suite of technologies.

In a matter of months they modified the car to include a Windows Phone remote lock/start app, built-in WiFi hotspot, digital instrument cluster, passenger heads-up-display, Ford Sync, Kinect backseat entertainment, Kinect front & back sensors, cloud analytics of car statistics and a customizable rear windshield message display.

Too bad that car is one of a kind, but hopefully the Microsoft Connected Car team can help make it a reality, or at least an expensive factory-installed option.