About
I created Ibex as a fun project to get a working virtual reality desktop or workspace for the Oculus Rift (http://oculusvr.com) when it finally comes out. Currently it runs quite quickly on Mac OS, Windows as well as on Linux both on a virtual machine and on a native Linux Desktop running XFCE with no other compositing windowing manager running. Currently I’m getting around 250fps.

Public GIT repository set up at: https://bitbucket.org/druidsbane/ibex/overview

Demo Videos and Articles
Videos: Overview of ibex and Closeup view of ibex videos.
Articles: RoadToVR (1,2), Slashdot, Tech Hive as well as the Mote and Beam blog articles.

Downloads
Windows - Beta 6 (Ibex Win Beta, you will need the 32-bit VC++2012 Redistributable, make sure to install the x86, i.e.: 32-bit version)
Mac - Beta 14 (link)

Launch
Default simple renderer: ./ibex
Fancy Irrlicht renderer with Quake 3 level: ./ibex -i
Simple Ogre3D renderer demo: ./ibex -o
Disable SBS rendering: -m (for mono view not stereo)

Controls
Toggle Control Desktop/Move Around World: CTRL+SHIFT+G (Windows) / CTRL+SHIFT+Y (Linux) / Fn+Shift+F1 (Mac)
Look: Move Mouse
Move Forward: W
Move Backwards: S
Walk Sideways Left (Strafe Left): A/Q
Walk Sideways Right (Strafe Right): D/E
Jump: SPACE (Irrlicht renderer only)
Show FPS and Information Dialog: / (Mac Only)
Choose movies: Show info dialog with ‘/‘ then press 1 or 2 for regular or stereo movies, then navigate using arrow keys and enter to select a movie
Adjust IPD for Rift Stereo: -/+
Change Monitor Shape (Mac Only): Q

Toggle Barrel Lens Distort: B
Toggle Ground Layer: G
Toggle SBS: B followed by P (Mac Only)

If using the iPhone controller app (source included) you need to connect to the correct IP for your computer in the iPhone app. When you hit "Broadcast" the orientation of the phone becomes the base orientation and you will start looking around from there.

Development Diary
5/20/2013 - Fixed up the spherical display and added a new cylindrical display. You can toggle them on the Mac version using the Q key. You can also disable barrel distortion using the B key followed by the P key t o disable side-by-side rendering. RIght now changing the shape of the display has highlighted an issue with the cursor code: namely that because the textures aren’t composited and I render the cursor later, it isn’t warped the same as the desktop and looks weird. That will need fixing too. Other than that it is interesting and easier to read in the Spherical display or the Cylindrical display even though they aren’t quite optimized for viewing and are so large that you have to look quite a bit using your head to see clearly. I will tweak it and let it be a user configurable parameter. Below are some comparison shots. They are hard to see because of the barrel distortion but still highlight the difference in shape and readability. I’ve updated the Mac beta for now to fix a mouse cursor bug as well.





5/19/2013 - Added spherical display to Mac version. Will test on a Rift soon and then release a new beta for the Mac and Windows to see if this is any better. Will try adding a cylindrical version as well.

5/18/2013 - Over the past week I’ve been cleaning up the video playing support on Windows as well as cleaning up the project: removing cruft, merging in changes from the Mac version, and making the build more reliable and configurable. Video playing on Windows using ffmpeg is difficult compared to OSX because the Audio API’s are completely fragmented and the one API that is available from Vista onwards without installing extra software, WASAPI, is a horrible pain to use. After adding support for XAudio2 which is much easier to use I found out that it was Windows 8-only or you’d have to have a special build against an older DirectX SDK and have the users install that. There are already far too many dependencies for Ibex as it is, both for building and running. Audio plays choppily, and the video isn’t as smooth as on the Mac but I’m sure it will get there. I’ve also fixed up the Razer Hydra support so that I’m getting ready to try to do more interesting things with it. You can now use the Hydra on Windows and the Mac, just press the LT then RT buttons on your Hydra and after that you can use the thumb sticks to look around and walk. It is also nice that the Hydra supports hot-plugging so you can connect your Hydra at any time to play around with it. Further pain was caused by an update to the Oculus SDK so that it now no longer tells you which display the Rift is and the DesktopX and DesktopY coordinates for it’s top left corner. Lots of ugly Win32 code was added and I eventually find the display based on its resolution not name. I’ve updated the Mac and Windows beta’s on the site if you want to try out the new functionality. Next up I’m hoping to add a curved display and possibly better Hydra usage. Everything is now updated on bitbucket.

5/11/2013 - Windows Ibex can now play videos. Fixed an issue where I was decrementing an iterator after having deleted it. OSX didn’t complain but fortunately VS2012 did. Audio is still not working nor ready in the Windows version and that’s what I’m working on now. Should be done in the next few days I hope. Sucks that there is no good cross platform sound API.

5/10/2013 - Picked up on the Windows code, refreshed and decided to just do it. #ifdef’ed out the OpenAL code until I find a good alternative for Windows from the 5-8 official solutions that have sprouted up in the past 10 years. Got the menu and file browsing code working and the video player ported over. Fortunately the wonderful site http://ffmpeg.zeranoe.com came to the rescue! Instructions are on bitbucket but you’ll need to download the prebuilt libraries and dev packages to get ibex to build now. The good news is the player should work now. I’ve added all the key codes from glut to navigate the windows and all that remains is to spawn off a video playing thread! Hooray!

5/9/2013 - Start work on porting the video code to Windows. Discovered the sorry state of OpenAL not existing and the lack of POSIX compliance means that directory code needs to be completely rewritten for loading and browsing files. ffmpeg is very hard to find pre-built to link. I’m done for the night.

5/8/2013 - The Mac version of Ibex now has a file chooser for movies. You can only choose to play one at the moment and if you want another you must quit and restart, but that will be fixed in time. It was interesting developing a simple dialog system and file chooser for watching movies. Very rudimentary but it will work on all platforms supported by ibex and is functional. As I add more I’ll make it more configurable, but for now it needs to be very simple. Here are some screenshots for your viewing pleasure.


5/6/2013 - Finally got the video support integrated for the Mac and video and audio playing and syncing though not syncing together. Its been very painful working with the ffmpeg libraries and though the sample programs do work, understanding how they work even with the help of tutorials isn’t particularly easy unfortunately. For example on of my videos can play the video nicely, but if I put in the proper delays for video frames it ends up choking on some of the audio, though everything is generally in sync. Stereo video playing is also supported in interleaved format. There is no UI yet for choosing videos however, everything is hardcoded. An FPS display and informational dialog has been added, just press ‘/‘ when in ibex control mode to bring it up. This is where more information will be added and a file chooser and so on. I’ve looked at a number of OpenGL GUI frameworks like nui3, CEGUI and a few others but none of them are simple drop-in codebases and require lots of dependencies to be compiled on the Mac and Windows, so I’ll hold off on a decision till I can find something simple enough or roll my own.

4/29/2013 - Started integrating support for ffmpeg in Ibex so that we can start playing videos or movies directly in your virtual environment. Virtual movie theaters here we come :)

4/27/2013 - Ibex for Mac has been updated to support the Rift SDK and full head-tracking! You can now run with or without the Rift and it will mirror your primary display to the virtual world! Performance is also back to 60fps on a Mid-2011 MacBook Air.


4/21/2013 - Improved framerate slightly on Windows by about 30fps (to 280fps instead of 250fps) and reduced latency. Merged code with Mac version for better performance.

4/20/2013 - Fixed the Windows version to no longer fail to run with Aero disabled. It should probably work on Windows XP and higher, but certainly Vista and higher. One less thing to worry about! The problem was with the WS_EX_LAYERED setting on the window. If you set it then you need to have SetLayeredWindowAttributes called after SetWindowLong for the window to show up otherwise it is the blankness that you all saw. I’ve actually disabled it for now as not sure which has better performance, with or without, but either way Aero and non-Aero should work now! Beta has been updated to version beta-4.

4/18/2013 - ibex for the Mac finally runs at nearly the 60fps that it did before. Updated binary so you can test it with your Rifts! It will detect them but can’t do head-tracking as the SDK isn’t available for the Mac yet. The shader was updated to cache the lens distortion factors and only update the cache if the parameters change. It is much faster now and hopefully I’ll port this over to the Windows version soon.



4/15/2013 - Reverted latest optimization, misread the documentation due to a browser rendering issue. Unfortunately Mac performance is back to 30fps on my MBA. Next up will have to be caching the distortion so that we can just look up the values whenever the distortion parameters fail rather than recalculate on the fly as that should yield better performance.

4/14/2013 - Released beta 6 of the Mac version of ibex. Detect which display is the Rift on the Mac and run fullscreen on that display so if you have a Rift you can try it out now but use the keyboard (or Hydra) for navigation! Now all that remains is the SDK to work on the Mac for the orientation tracking. Performance is now 30fps instead of the 60fps it was before. I will need to figure out if the new shader is just that much more demanding or if it is something else. Update: bumped performance on my laptop to 35fps, still more work needed.

4/13/2013 - Merged in some of the Windows code to the Mac branch to help unify them and now the Mac simple world ibex renderer is Rift-ready. Some #ifdefs need to be removed and it will ‘just-work’ with the Rift!

4/13/2013 - Updated the ibex binary. Hopefully it will work now for most users. You may need to install the Visual C++ 2012 Runtime though from here. I’ve also updated it to be resolution independent from the current Rift so that it can pick up the new parameters as they show up in newer Rifts without changing the code. Surprisingly I found that the desktop was completely useable comfortably at 1280x800 on the actual virtualized desktop and you can use it to browse the web or get work done. The best part is that as the Rift gets better this will only get sharper and better as well!

4/12/2013 - The link for the Ibex VR Desktop Beta for Windows is up! Download now and let me know how it works for you on your Rift or if you need any special libraries to be installed like the MSVC++ Runtime or something. I don’t think I linked everything statically. (Ibex Win Beta)


4/12/2013 - The Ibex virtual reality desktop is now working on the Rift on Windows!  It took 3 days of work and much appreciated help from the MTBS3D community but it finally works!  I probably should have taken screenshots on the Rift itself but maybe in the next update.  It was an interesting task.  Turns out that rendering in SBS stereo is different than rendering in 3D for a monitor.  Oddly, because everything is focused at infinity, you don’t need to shift the rendered images to adjust for the IPD but rather just adjust the IPD purely in the camera translation.  Future updates should add Ogre3D support and try to improve performance.  I will say one thing about readability: you can’t really read at this resolution unless very close to the virtual display to the point that it is very uncomfortable to read.  Multiple virtual monitors with the DPI turned down might help one to be productive.  Even bumping the resolution to 2560x1600 on the Rift won’t do much for viewing distance.  We might be able to be twice as far in the virtual world which will help for sure but I still think smaller displays will help.  I will post binaries up soon for Windows beta testing.  The source is on bitbucket: https://bitbucket.org/druidsbane/ibex/overview.





3/23/2013 - Finally got the textures to load on ibex Ogre for Mac. Next up Windows.

3/20/2013 - After much pain ibex for Mac now supports the Ogre plugin. I’ve started working on integrating the Bullet physics engine, but got sidetracked getting Ogre working first so there are interesting things to play around with. I’ve also added support for the sixense joystick. You’ll need to have the SDK installed and update Xcode to point to its location. Same thing, Ogre SDK 1.8.1 if you build the IbexMacOgre target. Currently the water isn’t rendering but everything else is. This should be a good segue to getting the same thing for Windows done so I’m ready for the Rift SDK. When starting if using sixense you need to point your controllers at the base and shoot the left then right triggers. After that you can use the right thumbstick for walking. I need to clean up the code a bit to make some things optional but for now it needs the sixense SDK and Bullet library to build. The code is on bitbucket. Also, the desktop texture needs fixing, it is currently rendering the mouse cursor.



2/10/2013 - Made some decent progress moving the desktop capture to a separate thread. Performance is much better. The VR world is running full speed on my desktop (118fps without v-sync) and the captured desktop isn’t all that bad either right now. Will work on more features as time goes on. Everything is open-sourced and available in bitbucket online right now in the IbexWin directory.

2/8/2013 - Painfully but eventually got the Windows version started. It is incomplete at the moment but it will eventually get there. I’m brute-forcing it and unlike the Mac and Linux versions I can’t exclude the Ibex window from being included as part of the screenshot. I’ll update it and multithread it like the Mac version so that the screenshots happen on a separate thread and don’t reduce the framerate of ibex directly. If ibex is to ever need full performance on OSX or Windows one option that I don’t have the time to pursue right now is a custom driver so it can act much like VNC or RemoteDesktop and capture the desktop at the lowest level. At that point I’ll have a texture quickly, not need screenshots and can ignore what needs to be ignored. Right now this isn’t a huge deal because we’ll be using ibex on a second screen anyways. The virtual display driver might ultimately be needed to get larger virtual desktops out there despite my best efforts to avoid it. While my desktop is around 6 years old now, it does have a quad core chip, 8GB of RAM and a GTX480 which is probably still more powerful than most laptop cards out today and has a lot of VRAM. Hopefully performance will still be acceptable using the brute-force method even on less powerful integrated Intel chips and so on. Only time will tell!

For the technically inclined, I’m capturing the desktop using the standard Win32 API and not using DirectX. The latest Direct3D seems to have removed the FrontBuffer command and it is extremely difficult to get a good app set up quickly in DirectX relative to OpenGL. Again, once I clean up the code I will post it on bitbucket. The only thing remaining at the moment is an actual Rift so I can integrate the head-tracking. In the meantime I’ll work on getting the Windows version up to feature parity with the Mac and Linux ones.



1/20/2013 - Mac Source for Ibex has been released on bitbucket. Please have at it :) I will clean it up and merge it further with the original source, but currently it is an IbexMac Xcode project and an IbexMac subdirectory.

1/12/2013 - Sped up mouse motion on Mac to be much smoother. Now when rendering locked to 60 fps and using mouse on my MacBook Air I get silky smooth motion. I had a bug that was causing me to drop mouse delta motions so it was very choppy. Basically whenever a frame was rendering I would drop the motions that took place in that time, so for (renderTime*FPS)/1second I was ignoring motions which surprisingly turned out to be quite significant. I’ve also updated to use a lock so we can sleep the desktop capture thread and not ‘overdraw’ the texture and waste CPU, so now whenever we are done rendering a single frame I signal the capture function to run. Here is the latest update (beta 5).

1/10/2013 - Memory corruption issues and fix seems to be adding switch to context and glFlush() in strategic places might help memory issues. I wonder if this is a driver issue or an issue on my side. NSZombie detection came up with nothing. Here is the latest update (beta 4).

1/8/2013 - Looks like NSCursor.currentSystemCursor actually leaks by caching the cursor image every call! I don’t know how to fix it but I filed a radar and will see what comes back. In any case, that and another hack to hide the cursor even from the background make it slightly nicer since you only get the cursor in Ibex. Again, this won’t be a big deal once the Rift is out as we’ll be using two displays, one for the desktop and one on the Rift so the cursor can show on the main display and we’ll render it fine on the Rift. Also, I’m not sure why its no longer running at 60fps… in any case, here is the latest update.

1/7/2013 - Updated Mac version of Ibex to be locked to vertical sync and it now runs at a smooth 60fps. The trick is that taking screenshots of the desktop for compositing and uploading to a texture takes place on a secondary thread and the data is shared with the main context. That way on a dual core CPU we aren’t slowing down the rendering thread yet we can still get the desktop as fast as possible. For some reason this is slightly choppier than in beta 1 for the desktop, but ultra-smooth otherwise. It remains to be seen how this works on the Rift itself when we enable dual monitors! The download link is here.

1/4/2013 - I finally got the first beta release ready for the Mac. It requires OS X 10.8. I hope this works for most users. It currently works on only a single monitor. You can move around using the keyboard commands above. To switch between desktop control and virtual world control press Fn+Shift+F1. I’ve increased the size of the barrel distortion shader to fill the screen so it will be more readable on the Rift hopefully. You can use the open source iPhone app to simulate a motion sensor if you have an iPhone developer account using the source on bitbucket above. I will try to get a binary out on the App Store once Ibex is more stable and officially released. I hope you enjoy and please feel free to send me feedback. The download link is here.

1/3/2013 - It’s been a while, side-tracked by many other projects. In any case, Ibex for the Mac has been a rather fun diversion which I will try to get a download for up soon enough. I got rid of some of the open-source library dependencies that I had for the Mac, though for Linux they remain. Currently it only does the ‘classic’ mode which I think is cleanest in any case. It took a long while but even with brute-force graphics processing it is running at a very reasonable speed on my MacBook Air. It is surprising that some things just worked with no changes like the iPhone orientation tracker (though I want to upgrade that to use bonjour) and the OpenGL barrel distortion code, while others took a bit more wrangling. I got rid of much of the code that was in the Linux version. There are also some frustrations like not being able to completely hide the cursor. The good news is we can at least have the cursor on the main monitor in which case it will not render on the virtual world and only the virtual cursor will, though when testing on a single monitor the cursor will unfortunately appear.

Other complications arise from not being able to do proper compositing, so you have the cursor issue, the problem that Ibex is an app so I have to prevent switching to other apps when controlling Ibex but allow switching when in desktop mode. It is also much slower than getting a single texture straight from the system yet it is still smooth enough to work on.

It took about two weeks of on-and-off programming to pull off the port but it has huge potential I think with more users. A Windows version should follow at some point I hope.

I’m also interested in adding a widget or plugin API so that running apps can enhance Ibex and add things to the virtual world without being hardcoded into it. Time will tell.


10/23/2012 - Being helped by NVidia to test a crash on startup. Seems that during the mode switch on my monitor from 120Hz to 100Hz it is crashing. It may be fixed in the latest drivers but will have to wait till I can test to find out. Haven’t been helped by anyone at xorg-devel related to my bug with Xrandr where I can’t disable panning on my version, it just fails with some X error. I can change the virtual desktop size but it is useless of it pans.

10/18/2012 - The past couple of days have seen me take a step back to work on getting the virtual desktop to run at an actual larger size than the monitor resolution. I’ve been using Xrandr to get that done but it hasn’t been too successful on my system so far. I made changes to support rendering the higher resolutions however I’m running into issues where the desktop pans and pushes my 3D view off to the side when I got past the physical resolution with my mouse. There needs to be a way to disable that. Once that’s done I can get back to other fun things.

10/16/2012 - Got barrel distort and side-by-side (SBS) rendering working on Ibex for the Ogre 3D plugin.  It was relatively painless, reused shader code with slight modifications, will try to get down to single source for all programs to share that instead of copying and pasting everywhere. The world is beginning to shape up.  Performance dropped from 600fps on my desktop to 350fps, so there is definitely a toll.  I have some ideas on how to speed things up, but not just yet.  I think I might need to tweak the texture settings, and lower to the Rift's resolution, FOV is all wrong on this as well due to how Ogre works, hopefully that can be fixed.  Also, I don't have a way of toggling the barrel distort off yet.  Looking forward to adding the neck rotation model, improving text sharpness, zooming in on texture so no wasted space on edges as can be seen.


10/15/2012 - More playing around. Water effects improved and learned how to create stenciled layers to blend on layer of terrain textures into another and create a path for example.


10/14/2012 - Some breakthroughs in my learning of the Ogre3D engine finally. I might end up trying to make a game with it at some point :) In any case, it can now load models from Blender exported with the Blender2Ogre export scripts and the dotScene file format for Ogre. It was quite hard figuring out how to get materials and textures just right as well as UV mapping. I need to look into pre-baking the textures which should make it cleaner and easier than what I’ve done so far. I’m fairly pleased with the basic results. Fixed the display proportions, got occlusion working for the desktop, added a skydome, the iPhone orientation sensor works and you can fly around the landscape with your mouse and the usual WASD keys. I still need to add terrain collision and other things but it is a great start I hope. Oh yeah, and next step is rendering the two SBS views with the shaders working, that should be interesting.



10/8/2012 - Development hasn’t slowed down, I’ve just been stuck getting to the next level. I’ve failed to get the Irrlicht plugin to work on my NVidia desktop, it only renders white. If anyone has any suggestions I’d love to hear them. In the meantime, I’ve returned to what I thought was a dead end and fixed up the Ogre3D plugin. It now requires the Ogre 1.8.0 package to be installed for it to even build or run and one needs to check the configuration file and source to get it to point to the right paths. Still, it now works when it didn’t before and I have a fully interactive desktop on a spinning cube and a green Ogre in the back! The key thing is that this runs on my desktop as well so it is a rich platform for some powerful effects and loaders from Blender and other sources. Really excited about the possibilities.


10/2/2012 - Shaders and barrel distortion working properly now and respects the toggle key on the Irrlicht plugin! Took a week to get but finally works. Its annoying working with an engine and conventions you didn’t write yourself but at least it helps reduce your workload!



10/1/2012 - After a long while bugging me I finally figured out why the desktop was rendering only a portion to texture when changing the native resolution lower. Turns out glViewport needed to be set so that I could render to a larger texture than what the native resolution is otherwise it would get restricted. Moment of inspiration 1-liner while napping before work is all I have to show for this weekend.

9/27/2012 - Failed at getting the GLSL distortion shaders working on the Irrlicht plugin. I settled for adding a mono view (-m) flag to disable SBS rendering and plugging in the orientation code so the iPhone works as an orientation sensor for the Irrlicht plugin as well.

9/26/2012 - Finally got side-by-side (SBS) rendering for the Irrlicht plugin for ibex. That is now the default when running though I’ll add a flag to run in non-SBS mode as well for testing purposes.


9/25/2012 - Code finally cleaned up and modularized and conditionally compiled/enabled using cake and find scripts and everything… only problem? It seems to hang on start as usual on my NVidia desktop. The regular mode runs fine just the irrlicht mode that hangs… will figure it out soon I hope. Still, a huge step I think.

9/24/2012 - Irrlicht integration finally works with movement and collision detection! Article about Ibex on RoadToVR as well as the Mote and Beam blog! Here is a screenshot of the desktop from a distance. The next steps are code cleanup.


9/23/2012 - Spent the past few days working on getting the Irrlicht engine integrated instead of Ogre3D. I’ve reached a point where I can render a scene and have a virtual desktop appear in it. It has been rather difficult getting to this point but I think that it will get better from here. Moving windows works, moving through the world doesn’t just yet. It is definitely helping me think through my interfaces a bit better. I’m sure this will present some issues for me when it comes to rendering SBS views unfortunately the way that I render to texture, etc… but we’ll see. Hopefully I can get a screenshot up soon.

Update: screenshot using Irrlicht engine as a plugin and rendering the full interactive desktop :) Still not sure how I’ll get SBS rendering done but at least this gives me a good idea of how the video code needs to be abstracted for use by plugins.



9/18/2012 - Finally after much trying I’ve gotten Ogre 3D to interface with my existing window. Here is my first bit of progress, their demo ogre! It isn’t quite a plugin just yet though.


9/17/2012 - Spent a few hours trying to integrate the Irrichlet 3D engine as a plugin to ibex but failed. There are some issues interfacing it with existing windows and OpenGL contexts which is what I want to reuse for our existing work so it can integrate better. Started looking at Ogre 3D but haven’t gotten anywhere tonight.

9/16/2012 - Improved barrel distort to be much more readable and to be asymmetric so you can distort the x or y axes more. Original reference was from (http://github.prideout.net/barrel-distortion/) but my latest formula is based off of (http://paulbourke.net/miscellaneous/lenscorrection/).


9/15/2012 - Added a ground layer and fixed the left/right eye translation so the 3D doesn’t look terrible. Added a trial ground layer and translated everything up by 1.5 meters so the scale looks reasonable. Need to figure out how to make this more interesting.

9/14/2012 - Second pass at barrel distortion, it works :) I’m not sure about the formula and it assumes uniform distortion so may not be 100% correct, we’ll see. Press B to enable when in navigation mode.


9/13/2012 - First pass at barrel distortion in Ibex to prepare for the Rift, looks awesome even though it isn’t quite there obviously


9/12/2012 - Created some YouTube videos demonstrating the current state of Ibex embedded below.

Overview of Ibex from a distance:


Closeup of the desktop:


9/11/2012 - Got the orientation working through the iPhone! I’ve been trying to test out orientation somehow so I can get a feel for what the virtual desktop might feel like and react on the Rift, we’ll see how this goes! Currently it is a simple app hardcoded to broadcast to the laptop VM’s IP as UDP, but I’ll improve it later. Also, it seems that I needed to invert the orientation to get what I expected, problem is the CATransform3DInvert was very flaky so I did the inverse of the motion on the compositor’s listening side.

Thanks to NickK from MTBS forums I fixed the regression where windows weren’t moving, that’s due to the hotspot optimization I made. I now remap windows if they move as well now. I’ve also added the iPhone orientation app to the repository so others can work on it too if they need to. I want to start cleaning up so I can make it more modular and plugin-based… not yet though.


9/10/2012 - Started work on the orientation code finally. Problem is my Wii controllers won’t work on my virtual machine b/c Parallels doesn’t have a bluetooth driver for Linux. So, I decided to write a simple app for the iPhone that simply sends an orientation matrix through UDP to a particular host/port. Not quite done though… sigh.

9/9/2012 - Based on suggestions from NickK and LeeN from the MTBS forums I fixed some simple memory leaks and profiling hotspots. Wanted to work on orientation and other issues but didn’t get much of a chance. Looked up the wikipedia article on Barrel Distortion correction so I could prepare to undo the lens distortion of the Rift. Pretty good read: http://en.wikipedia.org/wiki/Distortion_(optics).

9/7/2012 - Success! I finally managed to capture the mouse cursor image and render it properly. Now you can mouse-over links or windows and it will render correctly. The only thing missing right now is to implement the hotspot for where the actual focus is, currently it is slightly off.


9/6/2012 - Started work on using Xfixes to capture the mouse cursor image and try to render it in OpenGL properly. Failed.

9/5/2012 - Managed to capture more MapNotify/UnmapNotify events for some windows so that at least terminal tab creation/destruction and others don’t lock up. Problem is still menus have stale pixmaps which are the first ones that get mapped first time they are displayed

9/4/2012 - Added option to render desktop Orthographically to texture or to render the old way which is draw the desktop twice to the screen with perspective. This improved the framerate to 250fps on my Linux Desktop and on the virtual machine surprisingly the render-to-texture was much slower and halved performance to 30fps; using the brute force method of drawing to the screen twice I get 60fps in my vm. Also, I’ve fixed the aspect-ratio of the desktop so it is no longer skewed.




9/3/2012 - finally got the skybox working with strafing, mouse-look and walking using: ctrl+shift+y to toggle movement, and the mouse as well as standard ASDW movement keys standard to FPS’. I also finally created an online GIT repository for it and open-sourced it at: https://bitbucket.org/druidsbane/ibex/overview


9/2/2012 - took picture with iPhone where I finally got the skybox to work. FOV is still quite wrong but that should be fixed soon


9/1/2012 - got a monitor model loaded using a .obj file, runs slower but proof of concept of model loading


8/30/2012 - finally got performance up, blender also runs great as do other OpenGL programs on the native NVidia driver