A new approach for photorealistic rendering of a class of objects at arbitrary illumination is presented. The approach of the authors relies entirely on image based rendering techniques. A scheme is utilized for re-il...A new approach for photorealistic rendering of a class of objects at arbitrary illumination is presented. The approach of the authors relies entirely on image based rendering techniques. A scheme is utilized for re-illumination of objects based on linear combination of low dimensional image representations. The minimum rendering condition of technique of the authors is three sample images under varying illumination of a reference object and a single input image of an interested object. Important properties of this approach are its simplicity, robustness and speediness. Experimental results validate the proposed rendering approach.展开更多
Recently, the popularity of 3D content is on the rise because of its immersive experience to view- ers. While demands for 3D contents and 3D technologies increase, only a few copyright protection methods for 3D conten...Recently, the popularity of 3D content is on the rise because of its immersive experience to view- ers. While demands for 3D contents and 3D technologies increase, only a few copyright protection methods for 3D contents have been proposed. The simplest infringement is the illegal distribution of the single 2D image from 3D content. The leaked image is still valuable as 2D content and the leakage can be occurred in DIBR system. To detect the leaked image, we focus on the hole-filled region which is caused by the hole-filling procedure mandatory in DIBR system. To estimate the hole-filled regions, two different procedures are conducted to extract edges and to estimate 3D warping traces, respectively. After that, the hole-filled regions are estimated and the left-right-eye image discrimination (LR discrimination) is also conducted. Experimental results demonstrate the effectiveness of the proposed method using quantitative measures.展开更多
Painting is done according to the artist’s style.The most representative of the style is the texture and shape of the brush stroke.Computer simulations allow the artist’s painting to be produced by taking this strok...Painting is done according to the artist’s style.The most representative of the style is the texture and shape of the brush stroke.Computer simulations allow the artist’s painting to be produced by taking this stroke and pasting it onto the image.This is called stroke-based rendering.The quality of the result depends on the number or quality of this stroke,since the stroke is taken to create the image.It is not easy to render using a large amount of information,as there is a limit to having a stroke scanned.In this work,we intend to produce rendering results using mass data that produces large amounts of strokes by expanding existing strokes through warping.Through this,we have produced results that have higher quality than conventional studies.Finally,we also compare the correlation between the amount of data and the results.展开更多
For the pre-acquired serial images from camera lengthways motion, a view synthesis algorithm based on epipolar geometry constraint is proposed in this paper. It uses the whole matching and maintaining order characters...For the pre-acquired serial images from camera lengthways motion, a view synthesis algorithm based on epipolar geometry constraint is proposed in this paper. It uses the whole matching and maintaining order characters of the epipolar line, Fourier transform and dynamic programming matching theories, thus truly synthesizing the destination image of current viewpoint. Through the combination of Fourier transform, epipolar geometry constraint and dynamic programming matching, the circumference distortion problem resulting from conventional view synthesis approaches is effectively avoided. The detailed implementation steps of this algorithm are given, and some running instances are presented to illustrate the results.展开更多
森林的实时渲染及光照是视景系统中的一个难题.基于图像的渲染方法(IBR)由于渲染速度与模型复杂度无关,被广泛应用于场景重建.基于光流场(Light Field Rendering)的IBR技术,提出一种迭代投射算法来进行外形重建,实现了具有实时光影特征...森林的实时渲染及光照是视景系统中的一个难题.基于图像的渲染方法(IBR)由于渲染速度与模型复杂度无关,被广泛应用于场景重建.基于光流场(Light Field Rendering)的IBR技术,提出一种迭代投射算法来进行外形重建,实现了具有实时光影特征的森林效果.实验表明该算法结合了传统迭代、投射算法各自的优点,在质量和效率方面取得了平衡.展开更多
A neural statistical approach to the reconstruction of novel viewpoint image us ing general regression neural networks(GRNN) is presented. Different color value will be obtained by watching the same surface point of a...A neural statistical approach to the reconstruction of novel viewpoint image us ing general regression neural networks(GRNN) is presented. Different color value will be obtained by watching the same surface point of an object from different viewpoints due to specular reflection, and the difference is related to the pos ition of viewpoint. The relationship between the position of viewpoint and the c olor of image is non linear, neural network is introduced to make curve fitting , where the inputs of neural network are only a few calibrated images with obvio us specular reflection. By training the neural network, network model is obtaine d. By inputing an arbitrary virtual viewpoint to the model, the image of the vir tual viewpoint can be computed. By using the method presented here, novel viewpo int image with photo realistic property can be obtained, especially images with obvious specular reflection can accurately be generated. The method is an image based rendering method, geometric model of the scene and position of lighting are not needed.展开更多
An extension to texture mapping is given in this paper for improving theefficiency of image-based rendering. For a depth image with an orthogonal displacement at eachpixel, it is decomposed by the displacement into a ...An extension to texture mapping is given in this paper for improving theefficiency of image-based rendering. For a depth image with an orthogonal displacement at eachpixel, it is decomposed by the displacement into a series of layered textures (LTs) with each onehaving the same displacement for all its texels. Meanwhile, some texels of the layered textures areinterpolated for obtaining a continuous 3D approximation of the model represented in the depthimage. Thus, the plane-to-plane texture mapping can be used to map these layered textures to producenovel views and the advantages can be obtained as follows: accelerating the rendering speed,supporting the 3D surface details and view motion parallax, and avoiding the expensive task ofhole-filling in the rendering stage. Experimental results show the new method can producehigh-quality images and run faster than many famous image-based rendering techniques.展开更多
In three-dimensional television (3DTV), an interactive free viewpoint selection application has received more attention so far. This paper presents a novel method that synthesizes a free-viewpoint based on multiple te...In three-dimensional television (3DTV), an interactive free viewpoint selection application has received more attention so far. This paper presents a novel method that synthesizes a free-viewpoint based on multiple textures and depth maps in multi-view camera configuration. This method solves the cracks and holes problem due to sampling rate by performing an inverse warping to retrieve texture images. This step allows a simple and accurate re-sampling of synthetic pixels. To enforce the spatial consistency of color and remove the pixels wrapped incorrectly because of inaccuracy depth maps, we propose some processing steps. The warped depth and warped texture images are used to classify pixels as stable, unstable and disoccluded pixels. The stable pixels are used to create an initial new view by weighted interpolation. To refine the new view, Graph cuts are used to select the best candidates for each unstable pixel. Finally, the remaining disoccluded regions are filled by our inpainting method based on depth information and texture neighboring pixel values. Our experiment on several multi-view data sets is encouraging in both subjective and objective results. Furthermore, our proposal can flexibly use more than two views in multi-view system to create a new view with higher quality.展开更多
文摘A new approach for photorealistic rendering of a class of objects at arbitrary illumination is presented. The approach of the authors relies entirely on image based rendering techniques. A scheme is utilized for re-illumination of objects based on linear combination of low dimensional image representations. The minimum rendering condition of technique of the authors is three sample images under varying illumination of a reference object and a single input image of an interested object. Important properties of this approach are its simplicity, robustness and speediness. Experimental results validate the proposed rendering approach.
文摘Recently, the popularity of 3D content is on the rise because of its immersive experience to view- ers. While demands for 3D contents and 3D technologies increase, only a few copyright protection methods for 3D contents have been proposed. The simplest infringement is the illegal distribution of the single 2D image from 3D content. The leaked image is still valuable as 2D content and the leakage can be occurred in DIBR system. To detect the leaked image, we focus on the hole-filled region which is caused by the hole-filling procedure mandatory in DIBR system. To estimate the hole-filled regions, two different procedures are conducted to extract edges and to estimate 3D warping traces, respectively. After that, the hole-filled regions are estimated and the left-right-eye image discrimination (LR discrimination) is also conducted. Experimental results demonstrate the effectiveness of the proposed method using quantitative measures.
基金This research was supported by the Chung-Ang University Research Scholarship Grants in 2017.
文摘Painting is done according to the artist’s style.The most representative of the style is the texture and shape of the brush stroke.Computer simulations allow the artist’s painting to be produced by taking this stroke and pasting it onto the image.This is called stroke-based rendering.The quality of the result depends on the number or quality of this stroke,since the stroke is taken to create the image.It is not easy to render using a large amount of information,as there is a limit to having a stroke scanned.In this work,we intend to produce rendering results using mass data that produces large amounts of strokes by expanding existing strokes through warping.Through this,we have produced results that have higher quality than conventional studies.Finally,we also compare the correlation between the amount of data and the results.
文摘For the pre-acquired serial images from camera lengthways motion, a view synthesis algorithm based on epipolar geometry constraint is proposed in this paper. It uses the whole matching and maintaining order characters of the epipolar line, Fourier transform and dynamic programming matching theories, thus truly synthesizing the destination image of current viewpoint. Through the combination of Fourier transform, epipolar geometry constraint and dynamic programming matching, the circumference distortion problem resulting from conventional view synthesis approaches is effectively avoided. The detailed implementation steps of this algorithm are given, and some running instances are presented to illustrate the results.
文摘森林的实时渲染及光照是视景系统中的一个难题.基于图像的渲染方法(IBR)由于渲染速度与模型复杂度无关,被广泛应用于场景重建.基于光流场(Light Field Rendering)的IBR技术,提出一种迭代投射算法来进行外形重建,实现了具有实时光影特征的森林效果.实验表明该算法结合了传统迭代、投射算法各自的优点,在质量和效率方面取得了平衡.
文摘A neural statistical approach to the reconstruction of novel viewpoint image us ing general regression neural networks(GRNN) is presented. Different color value will be obtained by watching the same surface point of an object from different viewpoints due to specular reflection, and the difference is related to the pos ition of viewpoint. The relationship between the position of viewpoint and the c olor of image is non linear, neural network is introduced to make curve fitting , where the inputs of neural network are only a few calibrated images with obvio us specular reflection. By training the neural network, network model is obtaine d. By inputing an arbitrary virtual viewpoint to the model, the image of the vir tual viewpoint can be computed. By using the method presented here, novel viewpo int image with photo realistic property can be obtained, especially images with obvious specular reflection can accurately be generated. The method is an image based rendering method, geometric model of the scene and position of lighting are not needed.
文摘An extension to texture mapping is given in this paper for improving theefficiency of image-based rendering. For a depth image with an orthogonal displacement at eachpixel, it is decomposed by the displacement into a series of layered textures (LTs) with each onehaving the same displacement for all its texels. Meanwhile, some texels of the layered textures areinterpolated for obtaining a continuous 3D approximation of the model represented in the depthimage. Thus, the plane-to-plane texture mapping can be used to map these layered textures to producenovel views and the advantages can be obtained as follows: accelerating the rendering speed,supporting the 3D surface details and view motion parallax, and avoiding the expensive task ofhole-filling in the rendering stage. Experimental results show the new method can producehigh-quality images and run faster than many famous image-based rendering techniques.
文摘In three-dimensional television (3DTV), an interactive free viewpoint selection application has received more attention so far. This paper presents a novel method that synthesizes a free-viewpoint based on multiple textures and depth maps in multi-view camera configuration. This method solves the cracks and holes problem due to sampling rate by performing an inverse warping to retrieve texture images. This step allows a simple and accurate re-sampling of synthetic pixels. To enforce the spatial consistency of color and remove the pixels wrapped incorrectly because of inaccuracy depth maps, we propose some processing steps. The warped depth and warped texture images are used to classify pixels as stable, unstable and disoccluded pixels. The stable pixels are used to create an initial new view by weighted interpolation. To refine the new view, Graph cuts are used to select the best candidates for each unstable pixel. Finally, the remaining disoccluded regions are filled by our inpainting method based on depth information and texture neighboring pixel values. Our experiment on several multi-view data sets is encouraging in both subjective and objective results. Furthermore, our proposal can flexibly use more than two views in multi-view system to create a new view with higher quality.
