360° Video with Papervision3D

2008-02-29 by Quentin Lengelé
Posted in Flex, Papervision3D

This movie requires Flash Player 9

Click and move your mouse over the movie.

Concept :

First, you need a movie filmed with a 360° camera.
This is what the original movie looks like :

Here is the FLV file :
http://www.cornflex.org/files/video3d/videos/new_york.flv

And you can see what the camera looks like on this page.

The idea was to apply the BitmapData of that movie on a GeoSphere.

The GeoSphere is made in 3DSMAX with flipped faces and exported in ASE Format.
The ASE Format is readable by Papervision3D.

Then you just need to draw your bitmapData into a texture you apply to the ASE in ActionScript.

About videos :

The videos I use come from ImmersiveMedia.com.
This 360° Video System was already made by ImmersiveMedia but only for the Shockwave plugin.
I think I have a good approach here with the Flash Player plugin ;)

Sources :

You can take a look to my sources by clicking here.

70 Responses

  1. Fuad Khan



    Hello Quentin,

    Your comment about ’shockwave only’ is not accurate. We released a player implemented Flash earlier this year, which you can see on our website:

    http://demos.immersivemedia.com/

    …and on some of our clients’ sites as well:

    http://www.redbullsurfing.com/videos/immersive/

    At the very least, this is confirmation that you did, in fact, have a very good approach ;)

    Since you clearly share our enthusiasm for both spherical video and Flash technologies, and because this is in your R+D corner, I will overlook the fact that you are using our content without permission.

    Please feel free to ask in the future, though.

    Best Regards,
    Fuad.

    Fuad Khan
    Engineering Manager
    Immersive Media Company


  2. Quentin Lengelé



    Hi Fuad,

    Sorry to say I received a mail from Eric Weymueller (Director, studios & network / executive producer) from Immersive Media 3 months ago to ask me to put some proper credit for the usage of your 360 flv files… And I did it.

    There is what he said to me :

    “Quentin –

    We were recently made aware of your blog and posting at: http://adn.blam.be/papervision/ where you appear to have appropriated our video content in order to run some tests on delivering Flash/Spherical.

    As you’ll see in the coming days, we are about to migrate our Flash/Cylindrical to Flash/Spherical, with a few other bells and whistles attached.

    Obviously, we would appreciate if you could include proper Credit and Linkage back to us ….
    Our first public usage and updates to our site will start taking place in about 24-hours.

    So, I’m still saying I was the first to publish it in Flash :p
    I’m not ripping or reselling your stuff… Otherwise I think I made a good advertising for you.
    I received a lot of questions about this R&D and I’m not fool to say I made the video myself…so all the benefits came to you.

    Q.


  3. Fuad Khan



    Quentin,

    Before you get too excited, I was merely pointing out an error on your posting, applauding your efforts and inviting you start a dialog with me.
    I am a huge proponent of R+D (I have built a career upon it) and I encourage all developers — professional, hobbyist, and otherwise — to take an interest in what we are doing and to push the limits on this amazing technology.

    My chief concern is that our applications (and applications that use our content) present Immersive content in the best possible light. You can see that the features in our Flash player aim to do this — for example, displaying high-resolution images when the player is paused and providing an automatic link for sharing:

    Like I said, I admire your enthusiasm and I hope you continue to pay close attention to Immersive Media. Feel free to check in with me from time to time, and visit our website…

    http://immersivemedia.com

    …regularly to keep abreast of developments. You may even want to check out our careers page:

    http://immersivemedia.com/aboutus/aboutus.php?pageID=10

    Best regards,
    Fuad.


  4. sikanrong



    yeah man, you wrote papervision 3d in the title, come ON!


  5. totallycrap



    Awesome! Looking forward to more 360°-stuff from both of you ( immersivemedia and Quentin ;-) ).


  6. Bleh



    This conversation doesn’t sound very professional O_O


  7. tee



    This is great ! Is there any way to post .fla as well ?


  8. Quentin Lengelé



    The source code is not for Flash CS3 but made with Flex Builder (ActionScript Project)


  9. Matt



    Cool.

    We’ll soon be sitting in domes at home and watching standard TV broadcasts like this from a swivel chair.


  10. tee



    I got FLEX, downloaded Papervision3d classes, when I compile I get Error: No class registered for interface ‘mx.resources::IResourceManager’.


  11. txalin



    Amazing!

    Wirst use i will do it with it: Put the cameras in a ball and throw it with a cannon :D


  12. Chris Hester



    It’s incredible! I was able to turn my head, sorry I mean the camera angle, and look at things as if I was there!

    This will be a major benefit to security. Also I imagine the military will be very interested in using this tech!

    Now imagine several of these cameras in one place. You could flick between the feeds and be able to see all around the scene.

    I just had to add a link to this page on my website. I’ll try and spread the word on other sites where I can too. Very impressive!


  13. Dario



    Combine this with Hollywood and VR glasses and you have a whole new level of movie watching!


  14. Vincent Robleto



    Look, good against remotes is one thing. Good against the living? That’s something else.


  15. Mustaaf



    Hi There

    Im looking for the camera, any idea where one can get it from

    cheers

    btw great concept


  16. AndyChou



    Need 3 Flex engineers in New York City:
    1. You have to be living in New York City for now.
    2. Work part time or full time with us.
    3. Good at Adobe Flex technology.
    4. Please contact us for other requirement and details.

    Busycode Inc. is a top Adobe Flex shop who develops Flex/AIR applications for clients.
    For more info, please visit http://www.busycode.com


  17. Misenensis



    Great! Though, the performance is a bit low. Is that because the 3d model being a bit complicated for flash?

    These technologies are looking very proposing though.


  18. Misenensis



    Though, 1 small question. Is it possible you can publish your .max file?


  19. Pedro R. Lopez



    Slow what you mean slow , it might be your bandwich. I see car with 3D cameras around miami beach.


  20. infoon



    This is awesome. Can anyone help me try to put some of these videos on my site or send me links to sources of what I need to do it in Flash? Thanks


  21. Sicminded



    fuad off!


  22. Legal adviser



    Hi there!

    No matter how great is the technology involved in this argue, there is simply a legal concern.
    It is normal that one should clearly point out the sources (=creator) of the content/code/technology if he uses it. That’s just a legal issue and it perfectly normal and desirable.
    Discussion over.

    (But I repeat I love the technology ;)


  23. wirlarra



    Gr8 site thnx for the information and insite in2 flex stuff.

    Quentin, don’t get discouraged by the possessive mob at immesive…….they are followers not leaders mate.

    : ) wir


  24. Winsa



    Hi,

    How to integrate video on a blog ?


  25. tom



    Hi, this is a great example of 360 video in Flash! :)
    I wanted to have a go with a different video so I downloaded your source. I’m using Flex SDK at the moment, when I compile the MXML files I get the interface with drop down but no video showing. Not sure what I’m missing. Also with your 360 Cubic VR still example source I get an empty SWF after compiling. I would really appreciate any tips you can offer, thanks!


  26. seth



    I don’t understand why Q is so insulted by Fuad’s generous and supportive interest in this project. Nice work, but chill out, Q. Why would you not want friends at immersive media??? Way to make friends and influence people.


  27. Rich



    I agree, I think Q overreacted. I thought Immersive Media’s response was legitimate, fair, and supportive, especially as Q used their stuff without permission or crediting them initially. I think it’s petty to fight over who-did-what-first things, it makes no difference to anyone.

    Still, great work from both you guys!


  28. GlobalVision video 360°



    This Flex application seems a great way to display 360° videos. However I’m wondering what about the sound as this question has not been adressed yet?

    Also to say, if you want to have a look at our latest 360° immersive video, captured at the Cannes Film Festival, I suggest you visit:
    http://www.virtualvisit.tv/360/Cannes2008


  29. Ryubin



    Hi all,

    I’ve already done this more than a year ago.
    http://www.ryubin.com/panolab/panoflash/techdemo080602/spherevideo_01.html

    I know IMC is a great company, anyhow.


  30. Social Advice



    Geeze “I will overlook”, give me a break. He’s advertising your product, be excited about that, don’t concentrate on your IP. He’s promoting your product and panoramas in general!

    This totally makes your company look like overbearing irreverent fools, that are more interested in making a buck than being excited about technology and getting others excited in it too. Before you know it with that attitude towards your customers, people will start saying “Immersive Media Sucks”.


  31. Matthew



    Hi,

    Can anyone tell me where to purchase the camera.

    I’ve searched 360 degree cameras on google with no luck.

    Thanks.


  32. anonymyymymym



    The discovery channel might be interested!


  33. Ouch



    Well, those at Immersive Media should by now have learned that making private matters public concern is not professional conduct. The credit was given, let bygones be bygones.


  34. mike darnell



    Just bumped into this after stumbling along a string of posts from the “Digital Art” blog news feed I’m fiddling with on site.

    I was really impressed by your movie. I wonder what happens when you drive around a block a few times and loop the whole thing.

    Or you could do this on a roller coaster…

    All the best.
    Mike

    PS
    If you have Digital Artists to recommend to the index i’m building please contact me via my site.

    the index is here:
    http://www.digitalartprintgallery.com/digital-gallery-index-digital-computer-generated-photomanipulation-and-3dgalleries-online.html


  35. Fernando



    Thx, and 1 question. How much that camera?


  36. Ricardo



    Hello if we have a 360 degree camera can we use the software publish here to have 360 videos on our site?

    is it legal?


  37. Luc Van Esch



    Where to buy 360 video camera’s or other hardware?


  38. kiss'm



    - well done, Very great job Quentin ;o)
    I think 360° Video is a major revolution in the multimedia since the birth of photographic

    QTVR, soon 15 years ago ! Wahouu long time !
    - Quentin, When the creation of sensitive “hot spot” dynamic in the 360° video ?

    To answer some questions raised, some informations about Hardwares (and softwares) for 360°

    Video

    -Professional multimedia Works

    http://www.ptgrey.com/products/spherical.asp
    360° camera + software
    Price : 9999 $ / 6400 €
    (I think five times cheaper than ImmersiveMedia for the same result … or almost, the fov is

    little bit different)

    -Personal multimedia Works
    http://www.realitylens.net/demonstration.html
    360°Spherical Panoramic Camera Lens (very Ingenious !!!)
    Price : 449 $ / 290 €
    http://sp.zdt.ru/sp_video.php
    Visualizing soft SP_VIDEO
    price 25 $ / 16 €
    http://sp.zdt.ru/sp_vcn.php
    editing soft (convert doughnut format 360° video to rectangular format 360° video)
    price free !

    -security or why not multimedia !
    http://www.immervision.com/en/security/security_products/security_products_1.php
    panomorph optical lens
    price ??
    http://www.immervision.com/fr/conferencing/
    WebCube, 360 Webcam
    end 2008, price ??

    -360 video examples (DivX codec)
    http://www.ptgrey.com/products/ladybug2/samples.asp
    http://www.virtual360video.com/vs/BurrardBridge.avi
    http://www.virtual360video.com/vs/BurrardStreet.avi
    http://www.virtual360video.com/vs/CanadaPlace.avi


  39. xDRoNe



    Hi all
    Interesting enough to read about little quarrels and yet we forgot how flash became an adobeee product. ha ha. Anywhooo, this high graphics GUI is all software computer graphics, nothing happening in the hardware parts of your machines. Hope one day someone develops a flash equivalent ocx that uses OpenGL. Only then the graphics are worth while.
    Meanwhile, you all enjoy your 2D scribbles.


  40. David



    Quentin,

    cool stuff indeed. I noticed that the frame rate seemed to take a noticeable hit when audio was present. Do you have any info on the impact the different audio compression rates have on playback?


  41. ChinaMojo



    Kudos to Quentin for the great cool work. Seems like some people are using his blog for advertising? Geez people… come ON!


  42. Stefan



    Hi there Quentin,

    I tried to contact you trough Linked-in but i needed an upgrade to mail you~. So i post my question here.

    We are interested in your your flashplayer for the same videotechnique. Could you contact me?

    With regards,

    Stefan


  43. syckls



    Now you just need to combine this with holophonic sound.


  44. GeniusGrid



    Good work Quentin. I do recall being at a meeting in 2001 at Ipix corp. and they were demonstrating this 360 Video and I was blown away to see the Heli flying over a jungle and being able to scroll around in any direction. Although this wasn’t presented in flash. I don’t think they ever fully marketed the technology though. And remember at that time (2000 – 2001) Flash was still very young and it was Macromedia before Adobe absorbed it. Also I think it would have been difficult to this in AS1. I was trying to develop pano 360 viewer in flash back then and it was a B*tch! haha Finally succeeded with AS2 though! But anyways this is great technology that you are working on here… keep up the good work. peace .V,


  45. Dutch design



    Quentin,

    Nice work.. now we need a realtime “bullit time” effect with zoom… ha ha.
    I love what you made……. keep up the good work!

    Remco


  46. Freams



    Hello
    it’s great. Can you post a link with fla source?
    It’s really great.

    Freams


  47. Tyler



    Hi Quentin,

    I have a few questions regarding your amazing videos. Can you send me your email address?

    Thank you,
    Tyler


  48. Recent Links Tagged With "papervision3d" - JabberTags



    [...] aspender on Mon 22-12-2008 .NET Magazine Awards PV3D Saved by monkeysrock26 on Mon 15-12-2008 CornFlex – Flex & Flash by Quentin Lengelé » Blog Archive » 360°… Saved by guitar90 on Sat 13-12-2008 gen-hx-classes papervision3d Saved by skemsley on Wed [...]


  49. Joseph Corr » Blog Archive » 360 Video, avec Papervision3D



    [...] http://www.cornflex.org/?p=1 [...]


  50. sorbo



    Your work is great, Can you post a link with fla source?

    Tks.


  51. Quentin Lengelé



    There is no FLA source.
    It was made with Flex Builder.


  52. Voltando Para Todos os Lados « FotoBlográfico



    [...] http://www.cornflex.org [...]


  53. Marcos



    Hi, very interisting article.
    I didn’t see your source, but I tried to do it in flash, not in flex.

    I created a sphere directly in papervision and I texturized it width “VideoStreamMaterial”.

    It works but the quality of video is very low and I don’t understand why…

    Tha same if I use a 360 photo inside of video.

    Any ideas?


  54. Oooh, I want one! | hilpers



    [...] wee bit on the big & heavy side and probably rather expensive, but the output is fascinating! http://www.cornflex.org/?p=1 [...]


  55. Audio Michael



    You did a great job! You have me convinced. I would like to shoot a music video in 360. Can you point me in the right direction to get a 360 lens with a 35mm adapter? I am just now learning papervision3D. Thank you. (I’m in the US)


  56. Quentin Lengelé



    Hi Audio Michael,

    I’m not a expert in 360 lens. I know there are lots of 360° lens types. You can easily find them on Google.
    The only thing I can tell you is the Immersive Media camera is much more accurate then other lens because it’s made with multiple lens and then multiple movie captures.

    Think about the fact if you choose a certain type of lens, you’ll have to find the correct unwarp algorithm in AS3.
    Here, for the Immersive Media cam, it was a sphere to rebuild with Papervision (easy to do)… but it may be more complicated with another type of lens.


  57. Papervision: Mundo virtual en 360º « Mundotutorial’s Blog



    [...] Ver Street view 360º con Papervision 3D. [...]


  58. Tolga



    Hi Quentin,

    I need to ask you a question about the camera up there that is shooting 360 degree video. The weird one has alot of lenses around. Is it something to buy easly, Or something very costly. Could you please give me more info about the camera and software to able to do movement. Thanks alot.


  59. Quentin Lengelé



    Take a look at the comments here :

    http://www.cornflex.org/?p=1#comment-390


  60. Tolga



    Thanks for you quick reply. but link you post me is, the brand of the camera is point grey research inc but the camera you put here is diffrent. Because I’h already know the ptgrey and searching more cheaper and shoothing ~360/180. btgrey is shooting that way but the lens up there is shoots 150 degree which is cheaper. But not, what I want.


  61. Lance



    the cam you are referring is at least 5 times more expensive then Point Grey’s depending on what else you get with it. I’ve used both it on many occasions for spherical 360-degree productions.


  62. Jim Bon



    I prefer still imagery with higher quality

    New York Virtual tour – http://www.pixelcase.com.au/vr/2009/newyork


  63. Leo



    hey incredible job man, i was wondering how did you find the camera, what brand distributes it and how expensive is that technology..

    greetings man..


  64. Frank



    Have a look to Germany:

    http://www.city-views.tv/wb/pages/beispiele.php

    http://www.roterfaden-hannover.de

    http://www.youtube.com/panograf


  65. Alan



    Hi Quentin,

    This is a brillian method of achieving this.

    Where do you think would be the best source of learning exactly what your code is doing?

    cheers


  66. Alex



    Anyone know where I would be able to rent one of these cameras? Very interested in playing around with.


  67. Ian



    This is so awesome. Everything should be filmed like this it would be great. Just a quick question whats that file size on these. They have to be pretty big for some of the higher res longer videos


  68. Luigi Assom



    Dear Quentin,

    I have been impressed by this results.
    My name is Luigi Assom, background both in communication and art, and sustainable development.

    I’ve been requested to make a video in Nigeria and /or Kenya applied to the development sector.
    The committent is an international agency for development.
    I’d like to know if it will be possible to use your camera and software and/or support, in terms of a collaboration.

    I look forward to hear from you soon!
    Please email me back
    Thanks,
    L.A.


  69. » WOW, 360° Video med Papervision3D Henning Birkeland's 3D blogg



    [...] Ved hjelp av noen kameraer plassert i en kule kan man nå ta opp 360 graders video og presentere dette på en webside ved hjelp av Papervison 3D for Flash: http://www.cornflex.org/?p=1 [...]


  70. Week #2 – Homework - Chris Drogaris – Computation Arts



    [...] http://www.cornflex.org/?p=1 [...]


Leave a Comment

Please note: Comment moderation is enabled and may delay your comment. There is no need to resubmit your comment.




Google

About CornFlex – Flex & Flash by Quentin Lengelé


Hi, I’m a Rich Internet Application developer, based in Belgium.

CornFlex.org is my R&D corner and I hope it will convince you to do more web applications with Adobe Flex and Flash!