2008-03-21

3D visualization with Irwin Sobel, Palo Alto, March 20, 2008

15 years of progress in 3D imaging
Someone who influenced my own interest in multimedia innovations over the last 15 years is Irwin Sobel, a senior researcher at HP Labs. Irwin should enjoy retirement since a few years but he carries-on working on his passions, attempting to be what he calls the good conscience of research projects he contributes to at HP Labs or follows at Stanford University. He has always been kind enough to give me small tutorials and I also learnt from discussions with him an approach of research, mixing detailed analysis of problems over several years with a pinch of stubbornness or rebellion. What's constant with these projects is that they seems luxurious and far-out initially, but given Moore's law and progress in algorithms and peripheral, they appear reasonable 5 years later and commonplace 5 years later.

From 3D medical imaging
On my last visit, we strolled on the grounds of Stanford Medical University and recalled our first project in 1992. I had initiated an eclectic stream of research covering tele-radiology, web-based medical records and the emerging field of image management (or picture archiving systems ; PACS). Irwin and my friend Dr. Davide Caramella at the University of Pisa convinced me to add a 3D project. This included a 1-year sabbatical of Irwin at HP’s center in Pisa, to investigate visualization system to facilitate surgical-planning using multi-modal magnetic resonance imaging (MRI). MRI measurements generate 3 images (T1, T2 and Proton Density) and false-color technique allows the visualization of a composite image. The results were shown in 1993 at RSNA and allowed holographic-like virtual explorations of a 3D thorax with cardiac MRI scans. Students from Francesco Beltrame at the University of Genoa helped develop the software on HP's most powerful RISC-processor. RSNA 93, was also important as we participated to the launch of the 1st medical imaging standard, DICOM with interoperability with 20 medical imaging vendors . But from that year I remember mostly project reviews in Pisa under the natural colors of Tuscany.

To telepresence and collaboration
More recently I followed his work on immersive visualization. In 2002 he showed me Coliseum, a teleconferencing system, involving 5 cameras, that rendered arbitrary-perspective views of participants giving the illusion of interacting in a common space. In 2005 I met him at a meeting of the AMI project, investigating multi-party interaction. (I commented on later results of AMI in February). At my next visit to Palo Alto, I sat in an early prototype of the Halo collaboration studio that HP was developing with DreamWorks. I looked at the video processing equipment, mostly professional TV equipment, probably the influence of DreamWorks. The challenges of telepresence ranged from accurate calibration of screens and cameras to improving eye contact feeling. .Irwin is still working on this last problem using 3D video cameras that allow perform 3D facial extraction that can then be oriented towards the video conference participant.

Having fun with immersive game boys
In 2007, Irwin worked on photometric and geometric calibration for the Panoply project, an immersive visualization using stereo projection on a concave screen that covers the field of view. The demo featured a F1 racing simulation game played from a car seat, steering wheel, stick shift, and pedals with major force feedback on the steering wheel and acceleration vibrations on the seat. It's so immersive I was quite stressed and, like most beginners I experienced the off-track flying experience serveral times !

Mobile Rules! San Jose, March 19, 20008

Nokia 's innovation award dinner was at the San Jose City Hall Rotunda. They had winners in categories such as business plans, technologies, applications from entrepreneurs around the world .

Music social communities :
I was with MyStrands, winner of the multimedia category. The Social Player enables users to discover and play music, meet people with similar musical tastes. The MP3 player supports Symbian 3.

Location-based communities
Infotainment catefory winner Earthcomber is an navigation software that relies on communities to let users specify exact types of information and plot them on a map. Users join or create groups that let them share or discover spots.

Focus on beter user intefaces :

I also liked a 3D user interface demo from Virginia Tech.





Mobile multimedia winner was : kannuu search technology uses partial word completion with joystick or touch screen interactions with exponential search algorithm.

User interface winner was : Tiki'labs 6 keys is a simplified user interface that relies on just six keys to deliver full messaging and communication capabilities.

I met Peter Vesterbacka of Mobile Mondays at the event. Other sponsors of Mobile Rules! 08 are obviously Nokia Growth Partners and included Accel, Advanced Technology Ventures, BlueRun Ventures, CMEA Ventures, FinNode, IDEO, Nexit, , Orange, Palo Alto Software, SINA, SK Telecom International, SVASE, Swisscom, Vision Capital and ZEF Solutions. Media and Community sponsors included GigaOM, LIVEdigitally, Mobile Game Developer Magazine, Red Herring, Teknopreneur Indonesia, Stirr and VentureBeat.

2008-03-20

Spring VON.x, San Jose, March 18-20, 2008

Here are my takeaways from Spring VON.x


  • Spring time for personal video

  • Green light for video conferencing

  • Fall of network and VoIP infrastructure

    • Spring time for personal video
      Quite a few proof points that personal video will blossom. Jeff’s social network panel was broadcasted live by Robert Scoble from his N95, check the blog or video show.


      Jonathan Christensen, is Skype's GM for audio and video, says 30% of their calls include video. He defines Skype users as a tightly clustered community, not an open social network like Facebook where the signal to noise ration is too high, you get too much and you don’t know all of your friends. Skype uses On2´s TrueMotion VP7 video codec that offers profiles including Simple (for low datarates on inexpensive processors) and Advanced (for datarates under 200 Kbps).

      Brad Hunstable, co-founder Ustream.tv has 250’000 registered users of their interactive micro broadcasting. There is no time restriction on length of streaming sessions. Brad says it’s a trillion channel world now and he was born in a 3 channel world! The generation of teens is thinking this is as simple as SMS and there will be mass market soon. .Kyte TV going after celebrity models will get there drag the rest of the video players in.

      Loic Le Meur, CEO Seesmic says that video conversation will be huge and asynchronous. Seesmic adds video to online communication such as IM, SMS, email, video. Users record on the website, upload or link to a video posted on a SNS and broadcast via Twitter. Seesmic API allows plugins / widgets: Wordpress, Netvibes, Firefox, Jabber, Shozu mobile clients. He says the community has requested 100’000 features request. Loic.tv, includes a video show on the company.

      Ramu Sunkara, CEO Qick.com provides handset software to stream live videos from Nokia S60 to the Web. Qik is integrated with Twitter, seesmic, mogulus, blogger, mobuzz.tv, Justin.tv, YouTube and currently in alfa test. Ramu says it’s a new era form of communication that is happening and 1 billion people take this for granted. Video quality goes up and up and up, andyou should expect new features, just as ICQ or Apple II came out of nowhere 30 years ago. VON.x was streamed live on Qik.

      Matt Gore , Vice President of Marketing, Paltalk presented in the online video and social media panel. They manage the long tail of video-enabled chat rooms, inter-operates with ICQ and AIM, adding live video calls. Typically there are 500 simultaneous users / rooms with the top reaching 2500 users. in categories such as music romance sport. They report 4 million active users , 1.1 million log-ins/day and 15% of users turning on theirweb-cams. They offer a freemium (free+premium) business model.



      Kathryn Jones, Produce/co-founder, Synchronis.tv also presented in the online video and social media panel. In 2007, she produced “35” a 10 episodes drama streamed live on Ustream.tv from 3 cameras and earlier “Question of the Week 30 episodes podcast seen by 500'000 viewers . She talked about online video + social media : the community is there to sustain the show : I know the people that watch the same show as I do . She says that the idea that video has to follow up Hollywood rules will disappear. YouTube has been a backslash to Hollywood where every actor needed 5 plastic surgeries. “ I used used to put make-up before turning the web cam, I don’t do it anymore” .


      Green light for video conferencing

      I presented video collaboration attempting to cover integration issues from handsets, laptops, telepresence and beyond. Telephony published a cover page article on telepresence. Telephony lists vendors of 500 rooms worldwide and comments on the contribution to make corporations greener by reducing carbon-emissions, even if by a negligible factor.


      On the panel with me was Joan Vandermate of Polycom and we agreed that we should walk the talk and in a next trade show install some of these telepresence rooms in exhibition booths rather than have employees, although these are not usually those flying the corporate jet. Her presentation was focused on the interoperability with unified communication server and Polycom had just announced integration with Microsoft’s Office Communications Server . We all agreed that fragmentation of standards for integrating directory and communication services would inhibit the pervasive use of video.







      HP’s telepresence started in 2005 when DreamWorks Animation tried to links teams of animators in northern and southern California, then in Bristol. You obviously needed a “Dream” system to convince visualization professionals and the engineering constraints were quality and experience, not cost. When I first sat in one of the prototype rooms, even having worked around video for 15 years, I was amazed at the feeling you get from a 50 inch screen with home cinema quality and dedicated OC-3 (MPEG 2 1280x720 at 30 fps and CD-audio). While I was presenting HP was announcing Halo’s new 2/4-seater model designed to operate with one of the 150 or so existing Halo studios, at 25% of the original price. The beauty for me is to know that this is all using a video software pipeline running on a commodity server (HP DL380), the same one our team had used for entry-level videoconferencing on mobile phones or PCs. So in less than 2 years we have convergence of video conferencing technology from the low-end to the top. But of course my talks expanded on the convergence issues (even with software implementations), from signaling across protocols, SIP/IMS, H.323, H.320, H.324M and the challenge of trans-coding from MPEG2, H.263, H.264 etc…

      Ofer Shapiro, from Vidyo gave a good overview of H.264 scalable video coding as a substitute for trans-coding gateways and even network-based multi-conferencing units. It is clearly the right technology direction asend-points are getting enough processing power, ultimately the network will only route the video stream on QoS networks and the end-points will perform the video adaptation. But that may take some time before we have a cross-industry agreed profile.

      Fall of network and VoIP infrastructure
      It’s more Fall than Spring for developers and providers of network-centric voice services. It’s more Fall than Spring for developers and providers of network-centric voice services. One sign was that the biggest exhibits at VON were edge services developers on Open Source such as Asterix and OpenSER . Another illustration was the discussions in the Telco 1-2-3 panel.

      Martine Lapierre, VP at Alcatel-Lucent summarized this: Growth opportunities are no more telecom-centric, since the on-line and content players will provide network access freely. The stock market drives this further : audiences valuations exceed networks, therefore intangible services are eating the tangible businesses. For telecom operators, they need to move to businesses adjacent to telecoms. Questioned about mobile data opportunities she says : data at 20$/month is not sustainable when WIMAX will be offered free. There will remain a market for low cost transport at low margins : even with a very high demand, volume multiplied by zero equals zeros. The same is true for the equipment manufacturers that will scale-down with network simplification from 100 elements to 5.

      Among the adjacent business opportunities, she listed : home networking, industry and public enterprises, advertising and commerce. If you own the home you own the customer, she says. This means content sharing, home management, and multi-screen services. In terms of equipment they focus on broadband gateways and femtocells but also content delivery networks for caching content. For enterprise service development she mentions exposing network features using web APIs such as BT 21CN. For advertising and commerce advertisement insertion capabilities in triple play messaging and video. And she mentioned mobile terminal m-payment


      My colleague Gary Iosbaker, HP OpenCall, CTO Americas, was also on the panel.
      He is more positive and states that change can mean opportunities such as : personalized rich content, instant communications and FMC services adapted not transplanted from the internet to mobile. He sees two barriers to creativity : one is the focus on network access rather than services, the other one is the risk aversion, carrier having been focused instead on 99.999% QoS and pre-defined ROIs. We have to lower the cost of experimentation, allow new service features and make it acceptable to fail. His view is that the killer app is speed and innovation. And as a developer he stresses the need to expose the information model and APIs of the underlying infrastructure. Where is the data ? I need to access to enablers and APIs I need a programming model. There is value in a global approach such as IMS, but it has barely moved forward it takes forever to progress anything thru standards. We need to allow 100s to write widgets and even service creation environments can be a hindrance because we cannot foresee all the requirements .

      Another answer to innovation came from the social network panelist who admired :
      Facebook : for the strength of vision to make sure experience is safe for users to open their information to others .
      Mark Canter of Broadband Mechanics for articulating the need for distributed social end-to-end and for providing their social web software