Categories
Home-and-Garden

How to access kinect pictures

Answered by:

Question

I am working on a project which uses kinect sensor and camera.

In my project, I would like to save (store) video on to disc. Please help me if it is possible.

Answers

Lucas, the C++ SkeletalViewer sample (installed to C:UsersPublicDocumentsMicrosoft Research KinectSDK SamplesNUISkeletalViewerCPP) shows how to get image data from kinect using the NUI_IMAGE_FRAME structure. Look at CSkeletalViewerApp::Nui_GotVideoAlert method. The LockedRect.pBits buffer contains the RGB image stream, 4-bytes to each pixel, and bytes for a pixel are in X8R8G8B8 format (i.e.: 8 unused bits, 8 red color bits, 8 green color bits and 8 blue color bits).

Jingesh, is this thread discussion in the direction you intended or not? If you’re using C# API, you can look at discussion in this other thread (http://social.msdn.microsoft.com/Forums/en-US/kinectsdknuiapi/thread/d82022ca-5015-4217-8f4a-1228cd1b0841) for better information.

I’m here to help

  • Marked as answer by Eddy Escardo-Raffo [MSFT] Monday, October 3, 2011 7:52 PM

ofstream myFile("depthframe", ios::out | ios::binary);
if(myFile)
<
myFile.write ((char*)pBuffer,320*240*2);
myFile.close();
OutputDebugStringA(buf);
>
else
<
OutputDebugStringA("failed to create a file");
>

  • Marked as answer by Eddy Escardo-Raffo [MSFT] Monday, October 3, 2011 7:52 PM

All replies

I have the very same question. I have tried using OpenCV and the Coding for Fun solutions but I am running in to problems with each.

I would like to solve the problem using OpenCV but I cannot figure out how to access the camera feed when using the cvCaptureFromCAM(0) function.

*** It would be especially helpful if someone could give the solution as it would apply to the SkeletalViewerApp (supplied by Microsoft SDK) so that there are some sort of standard variables, and I can try and track the pipeline from the camera

This page provides details about how to retrieve images from the Azure Kinect. The article demonstrates how to capture and access images coordinated between the device’s color and depth. To access images, you must first open and configure the device, then you can capture images. Before you configure and capture an image, you must Find and open device.

You can also refer to the SDK Streaming Example that demonstrates how to use the functions in this article.

The following functions are covered:

Configure and start the device

The two cameras available on your Kinect device support multiple modes, resolutions, and output formats. For a complete list, refer to the Azure Kinect Development Kit hardware specifications.

The streaming configuration is set using values in the k4a_device_configuration_t structure.

Once cameras are started, they’ll continue to capture data until k4a_device_stop_cameras() is called or the device is closed.

Stabilization

When starting up devices using the multi device synchronization feature, it is highly recommended to do so using a fixed exposure setting. With a manual exposure set, it can take up to eight captures from the device before images and framerate stabilize. With auto exposure, it can take up to 20 captures before images and framerate stabilize.

Get a capture from the device

Images are captured from the device in a correlated manner. Each captured image contains a depth image, an IR image, a color image, or a combination of images.

By default, the API will only return a capture once it has received all of the requested images for the streaming mode. You can configure the API to return partial captures with only depth or color images as soon as they’re available by clearing the synchronized_images_only parameter of the k4a_device_configuration_t .

Once the API has successfully returned a capture, you must call k4a_capture_release() when you have completed using the capture object.

Get an image from the capture

To retrieve a captured image, call the appropriate function for each image type. One of:

You must call k4a_image_release() on any k4a_image_t handle returned by these functions once you’re done using the image.

Access image buffers

k4a_image_t has many accessor functions to get properties of the image.

To access the image’s memory buffer, use k4a_image_get_buffer.

The following example demonstrates how to access a captured depth image. This same principle applies to other image types. However, make sure you replace the image-type variable with the correct image type, such as IR, or color.

Next steps

Now you know how to capture, and coordinate the cameras’ images between the color and depth, using your Azure Kinect device. You also can:

The Photos app in Windows 10 gathers photos from your PC, phone, and other devices, and puts them in one place where you can more easily find what you’re looking for.

To get started, in the search box on the taskbar, type photos and then select the Photos app from the results. Or, press Open the Photos app in Windows.

Find photos fast

How to access kinect pictures

Browse your collection by date, album, video projects, people, or folder. Or search to find a specific person, place, or thing. The app recognizes faces and objects in images and adds tags to help you find what you need without endless scrolling. For example, try searching for “beach,” “dog,” or “smile,” or select a face shown in the search pane to see all photos that person is in.

Upload photos automatically

One of the simplest ways to copy all your photos and videos to one place in the Photos app is to set up automatic upload to OneDrive from your mobile device.

Install the OneDrive app on your iOS or Android device. Next, turn on Camera Upload in the settings. The latest photos and videos that you take will automatically start uploading. Once uploaded, they’ll automatically appear in the Photos app on your PC.

Import photos and videos

You can import photos and videos you have stored on a camera’s SD card, a USB drive, or on another device.

Use a USB cable to connect your device to the PC.

In the search box on the taskbar, type photos and then select the Photos app from the results.

Select Import and follow the instructions to import from a folder or a USB device. The app automatically selects items you haven’t imported before, or you can choose what to import.

Note: If you’re using an Android phone and Import isn’t working, you might need to change your phone’s USB setting to allow it to transfer photos.

Help the app find more photos

The Photos app automatically displays the photos and videos in the Pictures folder on your PC and OneDrive. Here’s how to add more source folders to the Pictures folder.

In the search box on the taskbar, type photos and then select the Photos app from the results.

Select More … > Settings .

Under Sources, select Add a folder .

Choose a folder from your PC, an external drive, or a network drive connected to your PC, and then select Add this folder to Pictures to add it to the app. Subfolders of the folders that you add will be included, too.

How to access kinect pictures

Build desktop applications for Windows 10 or sell your Kinect v2 UWP apps in the Microsoft Store to take advantage of unique Windows Runtime features and expand distribution.

Developer resources

Learn how to implement different Kinect for Windows features and more about tools, like Kinect Studio, that support your development experience.

Connect with Microsoft and other developers like yourself on technical forums, Facebook, and Twitter to keep current on the latest news and announcements relevant to Windows app and game development.

Get troubleshooting advice, warranty and safety information, and more.

Tools and extensions

Windows developer tools

These tools include a free, full-featured Visual Studio Community client, universal app templates, a code editor, a powerful debugger, Windows Mobile emulators, rich language support, and more, all ready to use in production.

NuGet and Unity Pro add-ons

Install the Kinect SDK 2.0 and use the NuGet packages for a better .NET Framework development experience. You can also take advantage of the Unity Pro packages to build Kinect-based Unity apps.

Kinect for Windows language packs

The language packs enable you to add speech recognition to your Kinect for Windows apps.

Because the Windows SDK is the primary developer SDK for Windows, DirectX is now included in it. You can now use the Windows SDK to build great games for Windows.

Microsoft Speech Platform SDK 11

You can use the technologies and tools in the Speech Platform SDK 11 to give applications the ability to recognize spoken words (speech recognition) and to generate synthesized speech (text-to-speech or TTS). Using this SDK, you can give users an effective and natural way to interact with your applications, complementing the use of mice, keyboards, controllers, and gestures.

Kinect Configuration Verifier

Run the Kinect Configuration Verifier tool to check your system for issues and to verify that you’re running the latest driver for your GPU.

Burton, Rare's New Technology Development Lead, is currently working on Kinect Sports Rivals, a game that will place great emphasis on subtlety of movement. A hard or gentle twist of the wrist while revving a jet ski will affect its acceleration, for example, and specific hand placement during rock climbing will actually be reflected onscreen.

It's the way your Champion will actually be 'built' in the game, however, that speaks of an upgrade the loudest. Rather than using your Xbox Avatar like in previous Kinect Sports titles, the Kinect will "capture your facial structure, hair, skin color, body composition and even expression, and build a remarkably accurate virtual athlete – your Champion – in seconds."

Have you played Kinect Sports Rivals?

As we outlined in our Comic-Con coverage, the new Kinect will offer a more personalized gaming experience. Creative Director at Microsoft Studios Kenn Lobb goes on to elaborate how the sensor will recognize new players and adjust the game accordingly.

"In fighting games, players like to map their buttons all over the controller. So when playing Killer Instinct, once you make a profile and set your preferred button configuration, Kinect will instantly recognize when you’re holding the controller and map the buttons accordingly, even if it’s in the middle of a match."

You can read the full post, which also outlines Xbox One Cloud, graphical fidelity and second screen features here.

Lucy O'Brien is Entertainment Editor at IGN AU. Follow her ramblings on IGN at Luce_IGN_AU,or @Luceobrien on Twitter.

Obviously the post is outdated, some commenters pointed this out already. However, I keep failing even given the corrected instructions.

I’m really going nuts here, trying for like the 20th time, installing the components in all possible different orders.

Thing is, since this bugs me literally *every* time I try to get a Kinect to work on Windows, I got a combination that works for me on my development PC, consisting of:

OpenNI 1.5.7.10 for Windows 64-bit
PrimeSense – NITE 1.5.2.23 for Windows 64-bit
PrimeSense Sensor 5.1.6.6 for Windows 64-bit
PrimeSense Sensor KinectMod 5.1.2.1 for Windows 64-bit
Windows Driver Package – PrimeSense (psdrv3) PrimeSense (01/21/2013 3.2.0.1)
Windows Driver Package – PrimeSense (psdrv3) PrimeSense (05/22/2012 3.1.3.1)

This is what “Programs and Features” says. Oddly enough, there are two driver packages, I guess this is a result of my desperate attempts of getting it to run on this machine back then. I’m really getting sick of this, it’s groundhog day over and over.

Now, when I install the exact same things on a different machine, I keep failing and failing. The Kinect cameras don’t show up in the device manager, there only is this XBox NUI Motor entry.

Although it is not mentioned in the article here, I remember having to run the dpinst-amd64.exe in C:/Program Files/PrimeSense/SensorKinect/Driver — if I do this on the new machine, the installation fails (the Wizard says “PrimeSense (psdrv3) PrimeSense (05/22/2012 3.1.3.1) Installation failed”). Doesn’t even say what the problem is.

If anybody could help me out I would be super grateful. I’m really running out of options here. Or maybe anybody has a package for me that is confirmed to work. I need OpenNI Version 1.5, 64 bit on Windows 8.1.

Hey friends! I just wanted to share with you a practical tutorial on how to use your old Kinect 360 Cam as a webcam in Windows 10 for Skype and other Video Conferencing programs. This is actually an older method, but I was shocked to learn it actually worked on Windows 10! I was previously using a method on Windows 7 by Piotr Sowa right here (http://codingbytodesign.net/2013/03/17/kinect-for-pc-and-skype-means-kinectcam/), but it stopped working for me with Windows 10. After much frustration I discovered a method that actually worked with Windows 10 and so I’m sharing and hosting the files with you that I know work on my website before they disappear off the internet. The other reason I want to share this with you is because we have a huge problem in this world that is called “Planned Obsolescence” (See video https://www.youtube.com/watch?v=zdh7_PA8GZU) and that is Corporations build things to break and to be replaced within a short time frame to boost profits. And what happens to all that plastic? Well currently they are dumping it in 3rd world countries at alarming rates. These kind of practices have to stop for all products and we should get updated drivers for everything ever made from Printers to Webcams if we wish to save the Oceans and this planet!

It’s true the problems have a lot to do with the way we see the world. It’s important for everyone to discover what “Soul Vision” means I believe and that’s why I invite everybody to open up and share their own stories as this is one of the methods towards getting everybody connected. I have boldly and bravely laid out my own personal stories on this voyage for all to see right here. Why not take a peak at how this process evolved in me. Here’s a link to my stories:

And here’s the links required for using the Kinect 360 Camera as web cam in Windows 10:

Note right click the links and choose “Save Target As” to somewhere on your computer.

3. Note: Only If you have the problem with the “failed to register” and “missing Dll file dependencies” error message, then download these two files and place them in the same location. (C:) Then try the same command: regsvr32 C:KinectCam.ax (in the Admin Command Prompt).

Note: This method is for Windows 10 64 bit. If you are running a 32 bit version (denoted with x86) of windows I recommend the other version of the SDK file found here:

Note: If everything works, be sure to give a Facebook and Youtube Thumbs Up!! Thanks!

How to access kinect pictures

By toddie123 Follow

How to access kinect pictures

How to access kinect pictures

Hey Instructables community!

In this instructable I will instruct you how to make a DIY 3d scanner using an XBOX-360 Kinect! This instructable is very easy as long as you are patient and follow my instructions in the video. Also, I explain how to correct and fix your image for a nice clean print on a 3D printer such as the UP. The best part, the project is free as long as you have a kinect.

The links for the downloads from the video:
GPU update from Nvidia: http://www.nvidia.com/Download/index.aspx?lang=en-us
Kinect software download from reconstrucme: http://reconstructme.net/projects/reconstructmeqt/
Netfabb cloud STL repair: http://cloud.netfabb.com/

I am entering this contest to help others learn how to easily 3D scan items or people using the Kinect. When I first tried to accomplish this, I spent DAYS trying to figure out how to install the software and run it correctly. So, I created this instructable to easily show someone how to install the software correctly without error. Also, I am 14 years old saving up money for a 3D printer. I have been a maker / hacker since I was little and I have been dreaming of owning a 3D printer for YEARS! Please vote for me to help make my dream come true.

Turn your little screen into a big one with this one little trick.

How to access kinect pictures

Your options for getting content on your Xbox One wirelessly are plentiful. However, if the glutton of apps and options for watching movies and TV aren’t doing it for you — or if you have content that simply can’t be natively displayed on an Xbox One — you’re not out of luck. In fact, it’s pretty easy to get almost anything you want to show on your Xbox One.

Today, we’ll show you how you can completely mirror your smartphone to your Xbox One if you’re an iOS or Android user. The former bunch will be using AirPlay to do it, while the latter will use the Miracast standard if your smartphone supports it (most should). No matter your phone of choice, it’s pretty easy.

What is device mirroring?

Before we begin, here’s a quick explanation of device mirroring in case you aren’t aware. Device mirroring allows you to beam whatever is showing on your smartphone directly to a different device for showing on a different display. And when we say whatever , we mean it – user interface and all.

This happens differently and is called different things depending on which phone you have. iPhone users do so through AirPlay, which typically is only supposed to work on Apple TV. Those with Android phones use a more open standard called Miracast, which is built into many smartphones, TVs, set-top boxes, and multimedia devices. It may sometimes be called Wireless Display or have some other proprietary name, but it’s all based on the same technology.

No matter your creed, the end goal is the same: to get the stuff that’s on your smartphone to show on your TV at a 1-for-1 ratio.

Can you mirror your phone to Xbox One?

Yes! Actually, this feature was originally available from Microsoft as part of the Xbox One preview program. It worked well, but Microsoft never fully launched it to the masses despite it being oft-requested. Thankfully, there exists a powerful alternative. All it takes is an app download.

AirServer for Xbox One

Enter AirServer (or as I like to call it, Air Savior ). The app makes it insanely simple to mirror both iPhone and Android phones to your Xbox One. In fact, as long as you’re using an Android phone with Miracast enabled or an iPhone, you won’t even need to download anything other than the AirServer app on Xbox.

Here’s how to get it:

  1. On your Xbox One, head to the Xbox Store .
  2. Open the search box and type in AirServer .
  3. Download AirServer.
  4. Launch AirServer.

And that’s it! The rest of the magic happens mostly on your smartphone.

How to mirror your Android phone to Xbox One

Here’s where things get a bit tricky. First, you need to figure out whether your phone supports Miracast. You can usually find this information on your phone’s box, in its manual, or at its listing on the website of the manufacturer.

Most modern phones should have this feature baked in, either branded as Miracast or with a unique name used by your phone maker. The process for using the feature may also differ from phone to phone. Here’s a quick rundown of how to do it on phones from some of the most popular Android device makers:

  • Samsung: This feature is called “Smart View” on newer Samsung phones, and you access it by tapping the Smart View button in the quick launch bar of your notifications pane.
  • LG: LG calls it Wireless Display, and it’s available at Settings > Connected devices > Screen sharing .
  • HTC: HTC’s solution is HTC Connect, and you access it by swiping up on the display with 3 fingers.
  • Sony: Sony refers to Miracast by its natural name, and it’s available at Settings > Device connection > Screen mirroring .

Once you’ve figured out how to access the feature, you’ll need to establish the connection between your phone and your Xbox. This should typically be as simple as selecting your Xbox from a list of Miracast-capable devices, with the Xbox One showing up as “XBOXONE” by default.

If all goes well, you should see the user interface from your phone pop up on your TV. Using the phone in portrait mode will show black bars on both sides of the picture, but if you turn the phone over into landscape mode it should fill the screen.

Feel free to show whatever you want from here, including games, pictures, videos, and apps. Do note, however, that some premium video apps – such as Netflix – protect their content using digital rights management, and as such it will not properly show the video playing back on your TV.

How to mirror your iPhone to Xbox One

iPhone owners will find a much more straightforward experience than folks on Android. There’s no hunting down info on whether your phone supports Miracast and how to use it on your particular phone. If you have an iPhone or iPad, you have AirPlay, and that’s how you’re going to mirror your phone to your Xbox One.

The lone prerequisite we discussed before applies here: download AirServer . Now, on your iOS device:

  1. Open control center. On iPhone X, you can access this by swiping down from the upper right corner of your screen. On all other iPhones and iPads with iOS 10 or later, you swipe up from the bottom of the screen.
  2. Tap the AirPlay icon. It should have a sub-label called “Screen Mirroring” .
  3. Select your Xbox One from the list.

Troubleshooting

If all goes well then you won’t have any issues getting this going, but there are a couple of common problems that may spring up in your time with AirServer. Here’s a list of potential issues and how to fix them:

  • If your app crashes , restart it and try again. Many of the early reviews of AirServer have complained about this, but the developers have seemingly smoothened things out over time.
  • If you can’t find your Xbox in the list of devices you can mirror to , make sure the Xbox and your phone are on the same network. This typically shouldn’t be a problem as both Miracast and AirPlay make use of WiFi Direct technology to make it a seamless experience, but there can still be incompatibility issues. Being on the same network should fix them.
  • On iPhone, AirPlay may force video apps to beam content to the Xbox for playback on its built-in video player, meaning you won’t be able to show the video in the context of the app’s UI. Unfortunately, this is a limitation of iOS itself due to the way Apple implemented AirPlay, so this issue can’t be fixed.

Enjoy the big screen!

Hopefully, this has helped you find a new way to enjoy your content, share what you’re viewing, or whatever it is you may find screen mirroring on Xbox One useful for. Be sure to try AirServer on your Xbox One with a free 24-hour trial, and if you find it useful then it’s just $10 to make it a permanent piece of your multimedia-viewing arsenal.