To combat packet loss and realize robust video transmission over Intemet and wireless networks, a new multiple description （MD） video coding method is proposed. In the method, two descriptions for each video frame i...To combat packet loss and realize robust video transmission over Intemet and wireless networks, a new multiple description （MD） video coding method is proposed. In the method, two descriptions for each video frame is first created by group of blocks （GOB） alternation. Motion information is then duplicated in both the descriptions and a process called low quality macroblock update is designed to redundantly encode textures in each frame using standard bit stream syntax. In this way, the output bit streams are standard compliant and better trade-offs between redundancy and single charmel reconstruction distortion are achieved. The proposed method has much better performance than the well-known MD transform coding （MDTC） method both in terms of redundancy rate distortion, and in the packet loss scenario.展开更多
To make the multiple descriptions codec adaptive to the packet loss rate, which can minimize the final distortion, a novel adaptive multiple descriptions sinusoidal coder （AMDSC） is proposed, which is based on a sin...To make the multiple descriptions codec adaptive to the packet loss rate, which can minimize the final distortion, a novel adaptive multiple descriptions sinusoidal coder （AMDSC） is proposed, which is based on a sinusoidal model and a noise model. Firstly, the sinusoidal parameters are extracted in the sinusoidal model, and ordered in a decrease manner. Odd indexed and even indexed parameters are divided into two descriptions. Secondly, the output vector from the noise model is split vector quantized. And the two sub-vectors are placed into two descriptions too. Finally, the number of the extracted parameters and the redundancy between the two descriptions are adjusted according to the packet loss rate of the network. Analytical and experimental resuits show that the proposed AMDSC outperforms existing MD speech coders by taking network loss characteristics into account. Therefore, it is very suitable for unreliable channels展开更多
We present a simple and efficient scheme that combines multiple descriptions coding with wavelet transform under JPEG2000 image coding architecture. To reduce packet losses, controlled amounts of redundancy are added ...We present a simple and efficient scheme that combines multiple descriptions coding with wavelet transform under JPEG2000 image coding architecture. To reduce packet losses, controlled amounts of redundancy are added to the wavelet transform coefficients to produce multiple descriptions of wavelet coefficients during the compression process to produce multiple descriptions bit-stream of a compressed image. Even if areceiver gets only parts of descriptions (other descriptions being lost), it can still reconstruct image with acceptable quality. Specifically, the scheme uses not only high-performance wavelet transform to improve compression efficiency, but also multiple descriptions technique to enhance the robustness of the compressed image that is transmitted through unreliable network channels.展开更多
Multiple description coding has recently been proposed as a joint source and channel coding to solve the problem of robust image transmission over unreliable network, and it can offer a variety of tradeoff between sig...Multiple description coding has recently been proposed as a joint source and channel coding to solve the problem of robust image transmission over unreliable network, and it can offer a variety of tradeoff between signal redundancy and transmission robustness. In this letter, a novel pre- and post-processing method with flexible redundancy insertion for polyphase downsampling multiple de- scription coding is presented. The proposed method can be implemented as pre- and post-processing to all standards for image and video communications, with obvious advantages. Simulation results show that this approach can reduce the computational complexity while provide a flexible redundancy in- sertion to make the system robust for any packet loss situation over different networks.展开更多
Distributed video coding （DVC） arouses high interests due to its property of low-complexity encoding. This paper proposes a robust multiple description DVC （MDDVC） under the constraint of low-complexity encoding. ...Distributed video coding （DVC） arouses high interests due to its property of low-complexity encoding. This paper proposes a robust multiple description DVC （MDDVC） under the constraint of low-complexity encoding. In MDDVC, zeros are padded to each frame and the resulting big-size video is divided into multiple descriptions. Then, each description is compressed by s hybrid DVC （HDVC） codec and trans- mitted over different channel. When one channel does not work, the lost HDVC description is estimated by the received from other channel, which guarantees the robustness of the system; MDDVC moves the complex motion estimation totally to the decoder so it features low-complexity encoding. In the pre-processing, an optimized zero-padding is also proposed to improve the performance. Experimental results exhibit that the proposed MDDVC scheme achieves better rate-distortion performance and robustness than the referenced especially when packet-loss rate is high.展开更多
To enhance the robustness of video transmission over noisy channels, this paper presents a multiple description video coding algorithm based on chessboard-interpolation. In the algorithm, the input image is decomposed...To enhance the robustness of video transmission over noisy channels, this paper presents a multiple description video coding algorithm based on chessboard-interpolation. In the algorithm, the input image is decomposed according to the chessboard pattern, and then interpolated to produce two approximate images with the same resolution. Consequently, the state-of-the-art DCT+MC (Discrete Cosine Transform + Motion Compensation) video codec is independently applied to the two approximate images to generate two descriptions of the original image. In this framework, a fairely good reconstructed image quality is obtained when two descriptions are received simultaneously, while an acceptable reconstructed image quality could be yielded if only one description is available. Moreover, the mismatch between the encoder and the decoder could be effectively controlled through partial coding of the difference signal between two descriptions. In bidirectional video communications, a drift control scheme is further proposed, in which the error drift could be eliminated after the encoder imitating the error concealment actions of the decoder. Since the inherent correlation among adjacent blocks of DCT+MC video coding is efficiently exploited, this algorithm has a better redundancy-rate-distortion (RRD) performance than other multiple description algorithms. Simulation results show that the proposed algorithm is fairly robust while preserves a high compression rate. A more constant reconstructed image quality is achieved over extremely noisy channels, compared with traditional single description coding. In addition, it is observed that the mismatch and the error drift are effectively controlled.展开更多
A simple, efficient multiple description coding （MDC） algorithm was developed based on weighted signal combinations. The scheme uses the standard video encoder with a pre-processing stage to generate multiple descri...A simple, efficient multiple description coding （MDC） algorithm was developed based on weighted signal combinations. The scheme uses the standard video encoder with a pre-processing stage to generate multiple descriptions. The decoder then uses a post-processing algorithm to combine the descriptions to provide better image quality. A scalable codec in the MDC system allows the system to provide multiple descriptions and scalability at the same time. In addition, since the different scalable descriptions may have different qualities, a simple averaging process is not optimal. An optimal weighted combination of the two descriptions was developed based on the signal to noise ratios. Compared with the simple average combination, the algorithm significantly improved the video quality, especially with large quality differences between the two descriptions, with gains of up to 3.56 dB.展开更多
As one of the focus areas of robust video coding and transmission, multiple description video coding has attracted comprehensive attention. The low coding efficiency of multiple description video coding is always the ...As one of the focus areas of robust video coding and transmission, multiple description video coding has attracted comprehensive attention. The low coding efficiency of multiple description video coding is always the major challenge in this field. In order to improve the performance of multiple description video coding, this paper proposes a scheme based on residuum compensation. In this scheme, each original video frame is encoded with a traditional encoder first to get the first description. Then the error residuum of each coded frame is added up to the corresponding original frame and the resulting compensated frame is encoded by another traditional encoder to generate the second description suc- cessively. This work uses JM10.0 of H.264/AVC as video coding codec to conduct the experiments. The experimental results show that the proposed scheme has good coding performance. Compared to state of art traditional single description encoder, the efficiency can be as high as 90%, he. the redundancy is only 10% to 20%.展开更多
This paper proposes a multiple description (MD) mesh-based motion coding method, which generates two descriptions for mesh-based motion by subsampling the nodes of a right-angled triangular mesh and dividing them into...This paper proposes a multiple description (MD) mesh-based motion coding method, which generates two descriptions for mesh-based motion by subsampling the nodes of a right-angled triangular mesh and dividing them into two groups. Motion vectors associated with the mesh nodes in each group are transmitted over distinct channels. With the nodes in each group, two other regular triangular meshes besides the original one can be constructed, and three different prediction images can be reconstructed according to descriptions available. The proposed MD mesh-based motion coding method is then combined with the pairwise correlating transform (PCT), and a complete MD video coding scheme is proposed. Further measures are taken to reduce the mismatch between the encoder and decoder that occurs when only one description is received and the decoder reconstruction is different from the encoder. The performance of the proposed scheme is evaluated using computer simulations, and the results show, compared to Reibman's MD transform coding (MDTC) method, the proposed scheme achieves better redundancy rate distortion (RRD) performance. In packet loss scenario, the proposed scheme outperforms the MDTC method.展开更多
Multiple description coding （MDC） generates multiple decodable bitstreams for a source to combat informa- tion loss. In this paper, multipath routing problem for two-description coded images is investigated for trad...Multiple description coding （MDC） generates multiple decodable bitstreams for a source to combat informa- tion loss. In this paper, multipath routing problem for two-description coded images is investigated for traditional and coded wireless networks without and with coding capability at intermediate nodes, respectively. Firstly, we formulate an interference-aware MDC multipath routing for traditional networks by employing a time-division link scheduling method to eliminate wireless interference, and ultimately obtain an optimal path selection corresponding to the minimum achievable distortion. Secondly, for coded networks, we evaluate practical wireless network coding （NC） in delivering descriptions of multiple unicast sessions. While NC increases maximum supporting flow rate of MDC descriptions in wireless networks, possible undecodability of NC mixed information is alleviated by MDC. To minimize achievable distortion, a proposed interference-and-coding-aware MDC multipath routing strikes a good balance between minimizing side effect of wireless interference avoidance and maximizing NC opportunity. Simulation results validate the effectiveness of the two proposed schemes.展开更多
The best-effort internet has inherent limitations on the end-to-end performance for interactive multimedia communications. This paper presents a multiple description coding （MDC） and forward error correction （FEC）...The best-effort internet has inherent limitations on the end-to-end performance for interactive multimedia communications. This paper presents a multiple description coding （MDC） and forward error correction （FEC） based multiple path transmission schemes for interactive multimedia （M3FEC）, which improves the end users’ experience by maximizing a rate-distortion （R-D） based optimization problem. The proposed model considers both the network diversity and the application’s stringent requirements, and combines the individual merits of the three promising technologies of multiple path overlay routing, MDC and FEC. Extensive numerical analysis and PlanetLab experiments demonstrate that M3FEC successfully combats packet losses, error propagation, and unpredictable network dynamics. This method also significantly increases distortion for interactive multimedia by over 10 dB than traditional IP-layer single path transmission in poor network environments, and outperforms the performance achieved by using MDC or FEC alone.展开更多
A layered compression algorithm is presented which delivers spatial scalable encoded bit streams for remote video monitoring system. The complexity of the algorithm is modest and is well suited to real time implementa...A layered compression algorithm is presented which delivers spatial scalable encoded bit streams for remote video monitoring system. The complexity of the algorithm is modest and is well suited to real time implementation. Based on the layered compression algorithm, a codec system model is established. High-speed video compression can be realized with parallel data compression in this codec system. For image reconstruction, a prediction method using two nearest pix points is presented.展开更多
Distributing real-time video stream in large scale group communication over Interuet poses several challenging problems due to the complex network dynamics, stringent requirement of delay and loss. This paper proposes...Distributing real-time video stream in large scale group communication over Interuet poses several challenging problems due to the complex network dynamics, stringent requirement of delay and loss. This paper proposes a novel peer-to-peer scheme, named TeamCast, to combat with these issues. Constructing multiple diverse application layer multicast （ALM） trees to transmit multiple independent complementary descriptions produced by multiple description coding （MDC） simultaneously, TeamCast improves error resilient ability in the presence of various levels of packet loss caused by unpredictable congestion of Internet and node failure, as well as enlarges system capacity. The results of extensive simulations indicate that TeamCast achieves low latency, scalability, and fault tolerance for the delivery of live media stream.展开更多
In order to improve the video transmission performance in Multiple-Input Multiple-Output Orthogonal Frequency Division Multiplexing （MIMO-OFDM） system, a new scheme, which integrates Multiple Description Coding （MD...In order to improve the video transmission performance in Multiple-Input Multiple-Output Orthogonal Frequency Division Multiplexing （MIMO-OFDM） system, a new scheme, which integrates Multiple Description Coding （MDC）, Low Density Parity Check （LDPC） coding and hybrid space time coding, is proposed in this letter. In particular, a hybrid space time coding algorithm is combined with LDPC codes to perform Unequal Error Protection （UEP） of MDC encoded video streams. Comparing with the UEP transmission with only LDPC codes, the proposed scheme achieves more than ldB gain in terms of Signal to Noise Ratio （SNR） when the Peak Signal to Noise Ratio （PSNR） of reconstructed video is above 30dB.展开更多
文摘To combat packet loss and realize robust video transmission over Intemet and wireless networks, a new multiple description （MD） video coding method is proposed. In the method, two descriptions for each video frame is first created by group of blocks （GOB） alternation. Motion information is then duplicated in both the descriptions and a process called low quality macroblock update is designed to redundantly encode textures in each frame using standard bit stream syntax. In this way, the output bit streams are standard compliant and better trade-offs between redundancy and single charmel reconstruction distortion are achieved. The proposed method has much better performance than the well-known MD transform coding （MDTC） method both in terms of redundancy rate distortion, and in the packet loss scenario.
文摘To make the multiple descriptions codec adaptive to the packet loss rate, which can minimize the final distortion, a novel adaptive multiple descriptions sinusoidal coder （AMDSC） is proposed, which is based on a sinusoidal model and a noise model. Firstly, the sinusoidal parameters are extracted in the sinusoidal model, and ordered in a decrease manner. Odd indexed and even indexed parameters are divided into two descriptions. Secondly, the output vector from the noise model is split vector quantized. And the two sub-vectors are placed into two descriptions too. Finally, the number of the extracted parameters and the redundancy between the two descriptions are adjusted according to the packet loss rate of the network. Analytical and experimental resuits show that the proposed AMDSC outperforms existing MD speech coders by taking network loss characteristics into account. Therefore, it is very suitable for unreliable channels
文摘We present a simple and efficient scheme that combines multiple descriptions coding with wavelet transform under JPEG2000 image coding architecture. To reduce packet losses, controlled amounts of redundancy are added to the wavelet transform coefficients to produce multiple descriptions of wavelet coefficients during the compression process to produce multiple descriptions bit-stream of a compressed image. Even if areceiver gets only parts of descriptions (other descriptions being lost), it can still reconstruct image with acceptable quality. Specifically, the scheme uses not only high-performance wavelet transform to improve compression efficiency, but also multiple descriptions technique to enhance the robustness of the compressed image that is transmitted through unreliable network channels.
基金Funded by the National Natural Science Foundation of China (No.60671037)Ningbo Industry Foundation (No.2007B10051)+2 种基金Zhejiang Province Key Industry Foundation (No.2006C11200)Scientific Research Fund of Zhejiang Provincial Education Department (No.20070956, No.20070978, No.20061661)Ningbo University Foundation (XK0610031)
文摘Multiple description coding has recently been proposed as a joint source and channel coding to solve the problem of robust image transmission over unreliable network, and it can offer a variety of tradeoff between signal redundancy and transmission robustness. In this letter, a novel pre- and post-processing method with flexible redundancy insertion for polyphase downsampling multiple de- scription coding is presented. The proposed method can be implemented as pre- and post-processing to all standards for image and video communications, with obvious advantages. Simulation results show that this approach can reduce the computational complexity while provide a flexible redundancy in- sertion to make the system robust for any packet loss situation over different networks.
基金Supported in part by the National Natural Science Foundation of China (Grant Nos.60776794 and 90604032)the National Basic Research Program of China (973 program) (Grant No.2006CB303104)+2 种基金the National High-tech Research & Development Program of China (863 program)(Grant No.2007AA01Z175)Program for Changjiang Scholars and Innovative Research Team in University (Grant No.IRT0707)Specialized Research Foundation of BJTU,Youth Science Technology Research Foundation of Shanxi Province (Grant No.2008021020)
文摘Distributed video coding （DVC） arouses high interests due to its property of low-complexity encoding. This paper proposes a robust multiple description DVC （MDDVC） under the constraint of low-complexity encoding. In MDDVC, zeros are padded to each frame and the resulting big-size video is divided into multiple descriptions. Then, each description is compressed by s hybrid DVC （HDVC） codec and trans- mitted over different channel. When one channel does not work, the lost HDVC description is estimated by the received from other channel, which guarantees the robustness of the system; MDDVC moves the complex motion estimation totally to the decoder so it features low-complexity encoding. In the pre-processing, an optimized zero-padding is also proposed to improve the performance. Experimental results exhibit that the proposed MDDVC scheme achieves better rate-distortion performance and robustness than the referenced especially when packet-loss rate is high.
文摘To enhance the robustness of video transmission over noisy channels, this paper presents a multiple description video coding algorithm based on chessboard-interpolation. In the algorithm, the input image is decomposed according to the chessboard pattern, and then interpolated to produce two approximate images with the same resolution. Consequently, the state-of-the-art DCT+MC (Discrete Cosine Transform + Motion Compensation) video codec is independently applied to the two approximate images to generate two descriptions of the original image. In this framework, a fairely good reconstructed image quality is obtained when two descriptions are received simultaneously, while an acceptable reconstructed image quality could be yielded if only one description is available. Moreover, the mismatch between the encoder and the decoder could be effectively controlled through partial coding of the difference signal between two descriptions. In bidirectional video communications, a drift control scheme is further proposed, in which the error drift could be eliminated after the encoder imitating the error concealment actions of the decoder. Since the inherent correlation among adjacent blocks of DCT+MC video coding is efficiently exploited, this algorithm has a better redundancy-rate-distortion (RRD) performance than other multiple description algorithms. Simulation results show that the proposed algorithm is fairly robust while preserves a high compression rate. A more constant reconstructed image quality is achieved over extremely noisy channels, compared with traditional single description coding. In addition, it is observed that the mismatch and the error drift are effectively controlled.
基金the National Natural Science Foundation of China (No. 60572081)
文摘A simple, efficient multiple description coding （MDC） algorithm was developed based on weighted signal combinations. The scheme uses the standard video encoder with a pre-processing stage to generate multiple descriptions. The decoder then uses a post-processing algorithm to combine the descriptions to provide better image quality. A scalable codec in the MDC system allows the system to provide multiple descriptions and scalability at the same time. In addition, since the different scalable descriptions may have different qualities, a simple averaging process is not optimal. An optimal weighted combination of the two descriptions was developed based on the signal to noise ratios. Compared with the simple average combination, the algorithm significantly improved the video quality, especially with large quality differences between the two descriptions, with gains of up to 3.56 dB.
基金Supported by the National Defense Key Laboratory Fund (Grant No. 9140C2001010801)Harbin Engineering University Basic Research Fund(Grant No. HEUFT07072)the National Natural Science Foundation of China (Grant No. 60802060)
文摘As one of the focus areas of robust video coding and transmission, multiple description video coding has attracted comprehensive attention. The low coding efficiency of multiple description video coding is always the major challenge in this field. In order to improve the performance of multiple description video coding, this paper proposes a scheme based on residuum compensation. In this scheme, each original video frame is encoded with a traditional encoder first to get the first description. Then the error residuum of each coded frame is added up to the corresponding original frame and the resulting compensated frame is encoded by another traditional encoder to generate the second description suc- cessively. This work uses JM10.0 of H.264/AVC as video coding codec to conduct the experiments. The experimental results show that the proposed scheme has good coding performance. Compared to state of art traditional single description encoder, the efficiency can be as high as 90%, he. the redundancy is only 10% to 20%.
文摘This paper proposes a multiple description (MD) mesh-based motion coding method, which generates two descriptions for mesh-based motion by subsampling the nodes of a right-angled triangular mesh and dividing them into two groups. Motion vectors associated with the mesh nodes in each group are transmitted over distinct channels. With the nodes in each group, two other regular triangular meshes besides the original one can be constructed, and three different prediction images can be reconstructed according to descriptions available. The proposed MD mesh-based motion coding method is then combined with the pairwise correlating transform (PCT), and a complete MD video coding scheme is proposed. Further measures are taken to reduce the mismatch between the encoder and decoder that occurs when only one description is received and the decoder reconstruction is different from the encoder. The performance of the proposed scheme is evaluated using computer simulations, and the results show, compared to Reibman's MD transform coding (MDTC) method, the proposed scheme achieves better redundancy rate distortion (RRD) performance. In packet loss scenario, the proposed scheme outperforms the MDTC method.
基金partially supported by the Joint Research Fund for Overseas Chinese Scholars and Scholars in Hong Kong and Macao of the National Natural Science Foundation of China under Grant No.61228102
文摘Multiple description coding （MDC） generates multiple decodable bitstreams for a source to combat informa- tion loss. In this paper, multipath routing problem for two-description coded images is investigated for traditional and coded wireless networks without and with coding capability at intermediate nodes, respectively. Firstly, we formulate an interference-aware MDC multipath routing for traditional networks by employing a time-division link scheduling method to eliminate wireless interference, and ultimately obtain an optimal path selection corresponding to the minimum achievable distortion. Secondly, for coded networks, we evaluate practical wireless network coding （NC） in delivering descriptions of multiple unicast sessions. While NC increases maximum supporting flow rate of MDC descriptions in wireless networks, possible undecodability of NC mixed information is alleviated by MDC. To minimize achievable distortion, a proposed interference-and-coding-aware MDC multipath routing strikes a good balance between minimizing side effect of wireless interference avoidance and maximizing NC opportunity. Simulation results validate the effectiveness of the two proposed schemes.
基金Supported by the National Natural Science Foundation of China(No.90718040)NEC Laboratories China (No.LC-2008-055)
文摘The best-effort internet has inherent limitations on the end-to-end performance for interactive multimedia communications. This paper presents a multiple description coding （MDC） and forward error correction （FEC） based multiple path transmission schemes for interactive multimedia （M3FEC）, which improves the end users’ experience by maximizing a rate-distortion （R-D） based optimization problem. The proposed model considers both the network diversity and the application’s stringent requirements, and combines the individual merits of the three promising technologies of multiple path overlay routing, MDC and FEC. Extensive numerical analysis and PlanetLab experiments demonstrate that M3FEC successfully combats packet losses, error propagation, and unpredictable network dynamics. This method also significantly increases distortion for interactive multimedia by over 10 dB than traditional IP-layer single path transmission in poor network environments, and outperforms the performance achieved by using MDC or FEC alone.
文摘A layered compression algorithm is presented which delivers spatial scalable encoded bit streams for remote video monitoring system. The complexity of the algorithm is modest and is well suited to real time implementation. Based on the layered compression algorithm, a codec system model is established. High-speed video compression can be realized with parallel data compression in this codec system. For image reconstruction, a prediction method using two nearest pix points is presented.
基金Major State Basic Research Development Program of China(973 Program,No.2005CB321903)
文摘Distributing real-time video stream in large scale group communication over Interuet poses several challenging problems due to the complex network dynamics, stringent requirement of delay and loss. This paper proposes a novel peer-to-peer scheme, named TeamCast, to combat with these issues. Constructing multiple diverse application layer multicast （ALM） trees to transmit multiple independent complementary descriptions produced by multiple description coding （MDC） simultaneously, TeamCast improves error resilient ability in the presence of various levels of packet loss caused by unpredictable congestion of Internet and node failure, as well as enlarges system capacity. The results of extensive simulations indicate that TeamCast achieves low latency, scalability, and fault tolerance for the delivery of live media stream.
基金the National Natural Science Foundation of China (No. 60328103).
文摘In order to improve the video transmission performance in Multiple-Input Multiple-Output Orthogonal Frequency Division Multiplexing （MIMO-OFDM） system, a new scheme, which integrates Multiple Description Coding （MDC）, Low Density Parity Check （LDPC） coding and hybrid space time coding, is proposed in this letter. In particular, a hybrid space time coding algorithm is combined with LDPC codes to perform Unequal Error Protection （UEP） of MDC encoded video streams. Comparing with the UEP transmission with only LDPC codes, the proposed scheme achieves more than ldB gain in terms of Signal to Noise Ratio （SNR） when the Peak Signal to Noise Ratio （PSNR） of reconstructed video is above 30dB.
