It's a good idea. It would look weird when the doors are open as their frame is in the wall to the side so when they are closed and you view them from the side that has the frames you suddenly have this hole in the wall.
Still a nice idea and good for filling in a 6x wide space.