Monday, February 19, 2018
PITCH For Pi-DAY - We're making a Virtual Reality Video!
We will be shooting a fictional,
narrative Virtual Reality Video, “PITCH For Pi-DAY”, this weekend (2018, Feb
23-25), in NYC, with a dress rehearsal on Wednesday (2/21).
This is a 5 min (no-pay, non-union)
VR video, shot with the VUZE & LucidCam, and also shot for standard video.
Synopsis: “PITCH for PI-DAY” -- An
aggressive, ambitious entrepreneur pitches a high-tech, comprehensive
healthcare solution to a venture capital investor at a Pitch Fest: Successful
pitches may get $$$ and will be invited to pitch to a large audience of potential $$$$$$ investors on
Pi-Day (3/14). But it's not an easy pitch!
Beyond this video, I am building a
team for making fictional, documentary, and commercial XR videos. (XR = VR + AR + MR with AI and interactivity & …)
In addition to XR video production, I am also interested in developing software
to support live XR streaming, as well as archived XR video discovery and
hosting.
I have a fine cast! I could use
(and would greatly appreciate!) help in any of the following areas for this
weekend’s video (and beyond, as we build a team):
Line
producer / assistant director / equipment monitor
Someone
to run any sudden errands that may be needed
Set
designer / set dresser
Assistant
Videographer (we’re wrangling multiple cameras!)
VR
video editor (PP After Effects & Mettle)
Standard
video editor
Also
Sound
engineer / editor
Assistant
producer for post-completion promotions
If you are in NY and would like to join the team for this
weekend’s shoot, please e-mail me at
qporit.casting@gmail.com.
Labels: ATT Create-a-Thon, eXtended Reality XR, LucidCam, Pi-Day, PITCH For Pi-DAY, Virtual Reality, VR Video, Vuze
Tuesday, November 21, 2017
GR = Gifting Reality 2017
GR
GIFTING REALITY
Here are some suggestions for gifts for your family, your friends, or yourself, or for anyone interested in Virtual Reality (VR), Augmented Reality (AR), Mixed Reality (MR), and even the other components of XR (eXtended Reality) which include AI and IoT, (including robotics) . But first, here, we'll concentrate (mostly) on VR, with more to come on other resources for other elements of XR
This batch of suggestions includes books, hardware, and other info for beginners as well as for more advanced practitioners.
The principal ecosystems include Microsoft, Google, Facebook (with Oculus), and WebXR. WebXR is a new way to create VR and AR applications for everyone's internet.
For the most part, cameras are independent of these ecosystems. They capture content that can be used in a viewing application (like YouTube).
Unity is a software tool to create interactive, full-spherical (360), 3D content for most every platform. Other companies, like Apple, Amazon, Intel, NVidia, and others are just getting started with their own products. Sony has VR games.
Amazon is a very convenient marketplace for selling many of the products from many of the companies. (Note: we are an Amazon Affiliate.)
For simplicity, these suggestions are organized by ecosystems. Books are listed chronologically, with the more recent first, Note that the technology is changing very, very, very fast. Books older than a year can be very valuable for understanding the ideas and concepts, and some of the code may still work. However, to actually create applications, the developer sites we list should be consulted for the latest methods and details!
* *** *
MICROSOFT MIXED REALITY
(formerly called "holographic")
COMPUTING
Currently "Mixed Reality" hardware for MS consists of the HoloLens, plus several headsets that are essentially actually Virtual Reality tools, not "mixed reality" (that is, the outside world is not visible).
The software may be referred to as "mixed reality" or, at least in older references, as "holographic".
For developers, there are many reasons why MS may be the best choice of an ecosystem. It has Windows 10 behind it. The company's support offerings, including AI are super, the products will likely work with Steam and the Xbox soon, and the HoloLens is the most powerful XR display device. For pure consumers, it may or may not be the best choice of gift at this time, since there is a limited amount of XR software dedicated to these devices at the moment. But more will arrive!
WINDOWS MIXED REALITY DEVELOPER CENTER
https://developer.microsoft.com/en-us/windows/mixed-reality
BOOKS
MICROSOFT HOLOLENS DEVELOPERS GUIDE
DEVELOP MICROSOFT HOLOLENS APPS NOW
HARDWARE
THE HOLOLENS
The HoloLens, a headset (or HMD, Head Mounted Display), enables you to "mix" computer generated 2D and 3D content, shown on the vizor of the HoloLens, with the real world seen through the vizor. Distance sensors on the device allow it to map the real world onto a mesh. It has an on-board computer with Windows 10 software, so it is completely untethered. (Note: It is quite expensive, and there may be various bundles containing the HoloLens, so this link may not be the best price or bundle, but it is a great place to start.)
SAMSUNG ODYSSEY
The Samsung Odyssey headset is a moderately priced VR (ie occluded) headset that works with Windows 10 holographic/mixed-reality software. It currently has the best video display resolution on the market for any VR headset.
SAMSUNG ODYSSEY
https://www.samsung.com/us/computing/hmd/windows-mixed-reality/xe800zaa-hc1us-xe800zaa-hc1us/
ACER HEADSET
The Acer headset is a low-cost VR (ie occluded) headset that works with Windows 10 holographic/mixed-reality software.
LENOVO HEADSET
The Lenovo headset is a low-cost VR (ie occluded) headset that works with Windows 10 holographic/mixed-reality software.
* *** *
GOOGLE DAYDREAM
Google Daydream is the successor to Cardboard. It is now in its second generation. It is lightweight, but it requires a "Daydream Ready Phone" which means right now mostly the Pixel II. Including the phone, it is not cheap. Nevertheless, Google seems serious about developing the technology of XR, including the AI and other tools that will work together. There is not a lot of consumer-friendly content yet. But it is a good place for developers: Google is particularly interested in developing a mass-market. Of course, YouTube is a Google product, and Google is very interested in VR content for YouTube, which is one of the best, and most conspicuously, constantly, improving sites to host VR video content. (Google also has pioneered VR 360 3D cameras with the JUMP, but that is currently > $10,000.)
DEVELOPER SITE
https://developers.google.com/vr/daydream/overview
BOOKS
VIRTUAL REALITY DEVELOPMENT FOR THE GOOGLE DAYDREAM
* *** *
OCULUS
Oculus has two systems, the computer powered RIFT and, in partnership with Samsung, the Gear VR powered by a Samsung Smart phone. It is not clear where the best place to buy these might be. For the RIFT, you must also have a Rift compatible computer. For the Gear VR, you need a compatible smartphone. In fact, the Gear VR may be bundled with the smart phone. Both the Rift and Gear VR also have controllers, which may (or may not) be bundled with the HMD.
OCULUS RIFT HOME
https://www.oculus.com/
RIFT
https://www.oculus.com/rift/
DEVELOPER CENTER
https://developer.oculus.com/
OCULUS RIFT ON AMAZON
BOOKS
This is an old book. It is a good introduction, but for programming it is necessary to look at the latest information from the developer center above.
OCULUS RIFT IN ACTION
WEB XR
There is a programming tool that will enable the creation of a web site that can be viewed in a VR or AR headset (through a VR web enabled browser). Created from JavaScript, it is a tool called a-frame.
AFRAME
aframe.io
WEBXR
webxr.io
BOOKS
LEARNING WEB BASED VIRTUAL REALITY
* *** *
CAMERAS
LUCIDCAM
The LUCIDCAM is a 3D front facing VR camera that sees the entire front hemisphere and produces 180VR videos and still photos for about $500. The advantages of 180VR over 360VR are that (1) it is easier to shoot and (2) you do not have to worry about stitching, and (3) you do not have to worry about people or objects that are behind the camera. Of course, you do not get the entire full spherical scene around you.
Here is a review of the LucidCam:
QPORIT Review: LUCIDCAM -- 180VR CAMERA
http://qporit.blogspot.com/2017/10/review-lucidcam-180vr-camera.html
UPDATE 2017-11-24
BLACK FRIDAY & CYBER MONDAY SALES
DIRECT FROM LUCIDCAM
LUCIDCAM – 180 X 180 3DTHE VUZE
The VUZE is an eight-lens 3D full spherical 360VR camera, selling for about $800. It is currently the best value I have seen for full VR shooting.
Here is a review of the VUZE:
QPORIT Review: the VUZE -- 360 VR CAMERA
http://qporit.blogspot.com/2017/11/review-vuze-360-3d-vr-prosumer-camera.html
UPDATE 2017-11-23
BLACK FRIDAY SALE
DIRECT FROM VUZE
VUZE KIT
$640
VUZE BLACK (also available in red and blue)
* *** *
For continuing information about all the facets of eXtended Reality, you are
INVITED
Please join us at
NYXR - the New York eXtended Reality Meetup!
* *** *
These are some hints and suggestions for
GIFTING eXtended Reality products
and getting into the development of the
current wave of new technology!
Happy Holidays!
Labels: AR, Augmented Reality, Daydream, eXtended Reality, Google, Hololens, LucidCam, Microsoft, Mixed Reality, MR, Oculus Rift, the New York eXtended Reality Meetuo, Virtual Reality, VR, Vuze, XR
Sunday, October 22, 2017
THE NYVR EXPO
NYVR EXPO 2017
OCTOBER 26-28 2017
JACOB JAVITS CENTER, NYC
The NYVR EXPO 2017 is the largest New York VR Expo so far.
Hopefully there will be many more: with its confluence of technical skills, media skills, and financial resources, plus its location midway between California and Europe, NY should be the epicenter of the VR industry (in fact, the whole eXtended Reality industry XR = VR + AR + MR + AI + IoT + Fog Computing +...+ ...)!
(See more about QPORIT'S coverage of eXtended Reality in the links below!)
The Expo has been energetically curated by D.J. Smith, creator of the Glimpse Group and co-organizer of the important NYVR Meetup, and by Hugh Seaton, of Aquinas Training, and the organizer of the NY WebVR Meetup.
The expo will feature a professional conference, a consumer conference, an exhibit space, and a number of special events. The speaker list is impressive.
We caught up with Hugh Seaton after a WebVR meetup, and he talked about this Expo, the state of VR, and WebVR.
The conference is co-located with the PhotoPLus Expo at the Javits Center in NYC. The NYVR EXPO home page is a good place to start, with easy access to comprehensive information about the Expo. We've also listed some short-cut links below.
The two main prosumer VR cameras will be represented: the <$500 180VR LucidCam, and the <$1000 360VR Vuze. QPORIT recently reviewed the LucidCam -- see the link below. We also interviewed Han Jin, the co-founder and CEO of Lucid in 180VR using the LucidCam.
(QPORIT covered the 2017 Hamptons International Film Festival (HIFF) using both the Vuze and the LucidCam for VR interviews and Red Carpet VR videos and both cameras worked well. In their coverage of HIFF, NBC's 1st Look captured a shot of the LucidCam in action, filming Hong Chau, one of Variety's "10 Actors to Watch" on the Red Carpet.)
Here is our interview of HAN JIN, shot in 180VR on the LucidCam.
LINKS[*] FOR THE NYVR EXPO
NYVR EXPO HOME PAGE
http://www.nyvrexpo.com/
SPEAKERS
http://www.nyvrexpo.com/speakers/
SEMINARS AND CLASSES
http://www.nyvrexpo.com/seminars-classes/
NYVR PROFESSIONAL CONFERENCE - SEMINAR SUMMARY AND REGISTRATION
https://photo.a2zinc.net/PhotoPlus2017/public/Sessions.aspx
NYVR CONSUMER CONFERENCE - SEMINAR SUMMARY AND REGISTRATION
https://photo.a2zinc.net/PhotoPlus2017/public/Sessions.aspx
SPECIAL EVENTS:
> >> NYC MEDIA LAB INCUBATOR ZONE (EXPO HOURS)
> >> GLIMPSE GROUP START-UP PITCH COMPETITION (FRI, AWARDS SAT)
http://www.nyvrexpo.com/special-events/
THE CO-LOCATED PHOTOPLUS EXPO
https://www.photoplusexpo.com/
SOME SELECTED RECENT LINKS[*] TO
EXTENDED REALITY IN
QPORIT
LUCIDCAM REVIEW
http://qporit.blogspot.com/2017/10/review-lucidcam-180vr-camera.html
NYXR - THE NEW YORK EXTENDED REALITY MEETUP
http://qporit.blogspot.com/2017/09/nyxr-new-york-extended-reality-meetup.html
Teaser Preview: READY PLAY ONE
http://qporit.blogspot.com/2017/08/teaser-preview-ready-player-one.html
Preview: OC4 - OCULUS DEVELOPERS CONFERENCE
http://qporit.blogspot.com/2017/08/preview-oc4-oculus-developers-conference.html
ALTSPACEVR & VIRTUAL IMMERSION TECHNOLOGIES
http://qporit.blogspot.com/2017/07/altspacevr-virtual-immersion-technogies.html
EXTENDED REALITY, THEATER, AND THE TRU LIVE STREAMING PANEL
http://qporit.blogspot.com/2016/11/extended-reality-theater-and-tru.html
OCULUS CONN3CT KEYNOTE 2016
http://qporit.blogspot.com/2016/10/oculus-conn3ct-keynote.html
GETTING STARTED WITH THE MICROSOFT HOLOLENS
http://qporit.blogspot.com/2016/06/getting-started-with-microsoft-hololens.html
FULL BODY REMOTE COMMUNICATION - "HOLOPORTATION"
http://qporit.blogspot.com/2016/03/full-body-remote-communication.html
A WORKING OUTLINE OF EXTENDED REALITY (2015)
http://qporit.blogspot.com/2015/11/a-working-outline-of-extended-reality.html
XR - EXTENDED REALITY (XR = VR + AR + MR + ...) SOME VARIATIONS ON REALITY (2015).
http://qporit.blogspot.com/2015/09/some-variations-on-reality-extended.html
[*] At the time of writing, the links listed here appear to work. In this era of rapid change and rampant hacking, links sometimes break or worse. Links within older articles may not all still work. Always be protected when linking!
Labels: eXtended Reality, LucidCam, NYVR EXPO, NYXR, the New York eXtended Reality Meetup, Virtual Reality, VR CONFERENCE, Vuze, XR
Monday, October 02, 2017
Review: LUCIDCAM -- 180VR CAMERA
LUCIDCAM
A TERRIFIC, CONVENIENT CAMERA
FOR VR PHOTOS AND VIDEOS
OVERVIEW
The LucidCam is a terrific, convenient camera for VR still and video photography. It produces high quality, state-of-the-art, 180VR format videos and stills. For several reasons, discussed below, this may be the most consumer-friendly VR format.
It costs only $499, making it the least expensive high-quality camera for 3D VR photography. This could be the camera that brings VR camcording to a mass audience.
It uses a pair of fisheye lenses to photograph the front hemisphere in 3D. The camera has front facing stereo microphones.
It weighs only 8 ounces, and is small enough to fit in your pocket.
It shoots mp4 video at either 1920 x 1080 (1K per eye or 2K total), 3000 x 1500 (called 3K) or 3180 x 2160 (4K per eye for an 8K video, called 4K in the App). It shoots with a variable frame rate that averages about 25 to 30 frames per second. The camera also shoots still 3D photos at 2160 x 4320 whichever resolution is set in the App.
Since it is only capturing a hemisphere, the 8K mode is twice the resolution of a camera that is 8K for the entire 360x180 4Pi full sphere. (However, it will be a while before most people have a viewing headset capable of displaying this resolution.)
It has a fixed, rechargeable battery. Photos and videos can be stored in the 24 GB internal memory or in a removable micro SD card.
The LucidCam can connect with Wi-Fi to a smartphone App. The App is used to select the resolution. It can also select whether the camera records with an equirectangular layout or a fisheye layout.
The camera also live streams the video (only the 2K mode, currently) to the smartphone. The App also allows updating the firmware, and provides a window into the battery status and the file storage. It can also be used to share the videos and photos.
The camera has a mini USB port, a mini HDMI port and a slot for a micro SD card of up to 32 MB. (It is probably a good idea to use a fast card: 80 MB/second or faster.) Content on the camera’s internal memory can be copied to a computer with the USB port, and content on the microSD card by putting the micro SD card in the adapter and placing that in the SD card slot of the computer.
The controls for shooting with the camera are very simple: there is a switch on top of the camera to turn on video or stills, and a button to take a still picture or start and stop a video.
I’ve dropped it and it still runs, so it seems pretty sturdy. It is a good idea to keep the camera covered when not being used, and to protect the lenses from dirt and scratches.
At 8K, the quality of the images is better than the current ability of consumer VR display devices to show them; so the videos will hold up well as the display technology continues to improve over time.
Processing and showing the videos is not hard, and we’ll discuss that below, along with shooting suggestions. This is a simple, convenient, solution for shooting state-of-the-art VR videos and photos. And it’s also currently the least expensive 3D VR camera.
SHOT WITH THE LUCIDCAM
HEMISPHERIC VS FULL SPHERICAL VIDEO
+THE 180VR FORMAT
+THE 180VR FORMAT
The LucidCam shoots the front hemisphere (180 x 180) in 3D, producing what are called 180VR videos. It shoots 180 degrees (half a panorama) horizontally and 180 degrees (from straight up to straight down) vertically.
By contrast, a 360 video (2D or 3D) shoots in all directions, all 360 degrees horizontally. A “360 video” will sometimes cut off the top or bottom of the view (or both) and show less than 180 degrees vertically. A full-spherical video that shoots the entire sphere surrounding the camera can also be called a 4Pi video because the surface area of a sphere is A=4πr^2 and 4π is called the solid angle of the surface of the sphere.
While, of course, it does not show everything around the camera, a hemispheric front facing video camera (like the LucidCam) has certain advantages over a full spherical camera.
First, it points directly at the subject of the image. When shooting 360 videos, one of the questions is where to let the main subject(s) be located: (Always in front? Wandering around? Popping up in back? Does the viewer freely discover action anywhere it might be in the circle, even behind the user; or is the user guided by audio or video cues to follow the action of the story?) These new questions about 360 videos and locating the subject are not necessary in 180VR.
Secondly, a full spherical camera with lenses pointing in all directions can be intimidating for subjects, or just passersby, who feel like they are swept up in someone else’s picture. Front facing alleviates some privacy concerns, and even some copyright issues (where a 360 camera can inadvertently pick up copyrighted images that are to the side or back of the camera).
Third, the fact that the image is limited makes it easier to apply some of the traditional camera techniques of cutting (even zooming! – although the LucidCam can only zoom through post-production editing software -- the LucidCam has a fixed F/2.2 aperture -- or by moving the camera closer or further from the subject, the VR180 format may also permit other methods of “zooming” including cutting to shots filmed with other cameras.)
The 3D 180VR image is immersive and realistic. Even though the format does not include the entire panorama, a seated user turning their head still sees a 3D scene covering their entire field of view (FOV), so it is still realistic and immersive.
Many people who view the video on YouTube or other sites may not be using a VR headset. When the video is being viewed in 2D (rather than in a 3D headset), if the main subject of the action being photographed is basically in front of the camera, then 180VR format generally looks better in 2D than the 360 video format.
Of course, if some of the important subject matter can be anywhere, front or back, then the 360 video format is necessary. If you need to shoot full spherical 3D videos, three LucidCam cameras can be connected in a triangular, six-lens rig that can be used to make 3D 360 full spherical VR videos. (I have not tried this option.)
ISSUES
The LucidCam is a first-generation product and it does have some problems. These are mostly annoyances that can be dealt with. Moreover, even with the current hardware, the supporting software is continually changing and improving.
Audio sync
The frame rate for the LucidCam videos is variable; different portions of the video may have different frame rates – this allows for the maximum flexibility in real time recording. However, Premiere Pro (and the current version of the LucidCam YouTube Converter), require a fixed frame rate in order to preserve the syncing of the audio to the video. The raw video can be processed with “Handbrake” to yield a fixed frame rate, but this outputs only 2160 x 1080 videos, even if the original video was 8K. FFMPEG or other converters may be able to convert variable to fixed frame rate for the 8K videos without losing resolution. (It should be noted that 8K resolution is beyond the display capability of most VR display devices today.)
Wi-Fi connection
It sometimes requires several tries (or practice) to get the Wi-Fi connection established between the camera and the smartphone. Additionally, the button for starting Wi-Fi is very close to the shutter control. It is easy to shoot several random pictures or turn the video on by accident while trying to just press the Wi-Fi button.
Indicator lights
The indicator lights are hard to see when shooting in broad daylight. It is sometimes necessary to cup your hands around the lights to block the sunlight in order to determine the status. Using the smartphone can sometimes avoid the need for looking at the lights. However, sometimes it is difficult to handle both the camera and the smart phone at the same time.
Holding the camera
Because the camera is small and captures the full hemisphere, fingers holding the camera can easily be captured in the image, (and a stray finger on just one side really trashes the 3D effect). It is necessary either to be very careful hand holding the camera, or use a selfie stick extending backwards from the camera so it is not in the image, or use a tripod.
Support
UPDATE 2017-10-22
LucidCam now has both an issues forum and a Facebook group
FORUM
https://www.lucidcam.com/forum
FACEBOOK GROUP
https://www.facebook.com/groups/lucidcamusers
LucidCam is quite good at providing personal support at info@lucidcam.com[*]. But it would be helpful to have a LucidCam forum to discuss “everything about LucidCam”, to have LucidCam staff providing and logging answers to questions as they arise, so many support questions will be already answered online, plus having other LucidCam users to help out and network with. More online tutorials will be helpful too. (We have some on the way from QPORIT, as well.)
SOME TIPS
Using the LucidCam is very easy. Turn on the camera to Picture or Video, press the shutter button for stills or to turn video on and off. Copy the result to the computer or the smartphone. A little processing, and you can share it.
It is not a good idea to let the camera wobble, or move randomly. Also, set it level to the horizon.
Be careful: avoid ledges and cliffs, cars, tripping hazards, and biting hazards (insects or bigger animals). Also, avoid copyright infringement; and get releases (when you need them) before you shoot.
For best results, keep your fingers out of the way: use a selfie stick or tripod to support the camera.
Speak clearly and naturally but reasonably loudly; make sure unwanted sounds (airplanes, music in the background, other people talking) are soft.
Often, keeping the camera at eye level with the subject is the ideal placement. With a single subject, keeping the camera at roughly an arm’s length works well. Since the camera has a fisheye lens, objects get much smaller very quickly as they get further away. (A herd of deer, for example, at the other end of a field may look like squirrels with short tails.)
Moderately long takes – longer than you would use with a standard movie camera – are recommended. Letting the user settle into experiencing the scene at their own pace helps the LucidCam provide the user the feeling of immersion and presence, the two most extraordinary aspects of Virtual Reality video.
Among the many fabulous uses of the camera are: recording life’s memories, and making creative fiction and non-fiction movies (which become more real and alive by using the exciting, realistic, and immersive presence of 3D images and a very wide field of view). Experiment with new applications!
Enjoy the LucidCam!
LINKS [*]
LUCIDCAM
www.lucidcam.com
LUCIDCAM ON FACEBOOK
https://www.facebook.com/LucidCam
LUCIDCAM FAQ
https://www.lucidcam.com/faq/
LUCIDCAM APP ON GOOGLE PLAYSTORE
https://play.google.com/store/apps/details?id=com.lucidcam.lucidvr
HANDBRAKE
https://handbrake.fr/
LUCIDCAM ON AMAZON
[*] These links seem to be functioning as this article is being prepared for publication. The state of change and of hacking being what it is these days, everything online is subject to change or to hacking. Links are provided “as is”, with no guarantees. Treat every link with care and a protection plan.
Labels: 180VR, 360 VR, Han Jin, LucidCam, VR camera
