ICISP 2016

1. Single-Loop Software Architecture for JPEG 2000
David Barina Ondrej Klima Pavel Zemcik
ICISP 2016

2. JPEG 2000 coordinate system
LL LL LL LL LL LL
LL
LL
LL
LL
LL
LL
LL
LL
LL
LL
LL
LL
LL
LL
LL
LL
LL
LL
LH LH LH LH LH LH
LH LH LH LH LH LH
LH LH LH LH LH LH
LH LH LH LH LH LH
LH LH LH LH LH LH
HH HH HH HH HH
HH HH HH HH HH
HH HH HH HH HH
HH HH HH HH HH
HH HH HH HH HH
HL HL HL HL HL
HL HL HL HL HL
HL HL HL HL HL
HL HL HL HL HL
(tbx0, tby0)
(tbx1, tby1)
(tbx0, tby0)
(tbx1, tby1)
(tbx0, tby0)
(tbx1, tby1)
(tbx0, tby0)
(tbx1, tby1)
(tcx0, tcy0)
(tcx1, tcy1)
LL
HH
HL
LH
LL
HH
HL
LH
LL
HH
HL
LH
LL
HH
HL
LH
LL
HH
HL
LH
LL
HH
HL
LH
LL
HH
HL
LH
LL
HH
HL
LH
LL
HH
HL
LH
LL
HH
HL
LH
LL
HH
HL
LH
LL
HH
HL
LH
LL
HH
HL
LH
LL
HH
HL
LH
LL
HH
HL
LH
LL
HH
HL
LH
LL
HH
HL
LH
LL
LH
LL
HH
HL
LH
LL
LH
LL
HH
HL
LH
LL
LH
LL
HH
HL
LH
LL
LH
HHLH HHLH HHLH HHLH HHLH LH
2 / 13

3. CDF 9/7 wavelet
α
β
γ
δ
input
output
steps
even samples
odd samples
3 / 13

4. Lifting scheme and 1-D core
α
β
γ
δ
4 / 13

5. Vectorized 2-D core
5 / 13

6. Code-block scan order
core
code-block
2 × 2cbx
2 × 2cby
6 / 13

7. Two consecutive LL bands in virtual memory
LLn
LLn+1
HL LH HH
7 / 13

8. Horizontal strips
LL0
HL
LH HH
LL
transform EBCOT
8 / 13

9. Processing time and memory consumption
standard resolution input [MiB] memory [MiB] time [ns/pel]
Full HD 1920 × 1080 7.9 4.6 2.78
DCI 4K 4096 × 2160 33.8 7.2 2.40
8K UHD 7680 × 4320 126.6 11.9 2.11
65K tile 216
× 216
16384.0 84.6 1.82
106
tile 106
× 106
3814697.3 1244.9 1.69
9 / 13

10. Software overview
library data type algorithm
our solution 32-bit FP strip-based, scales interleaved
OpenJPEG 32-bit FX naive approach
JasPer 32-bit FX naive approach
FFmpeg 32-bit FX naive approach
Kakadu 32-bit line-based, scales interleaved
10 / 13

11. Transform stage 4K
library threads SIMD memory [MiB] time [ns/pel]
our solution yes yes 7.7 2.56
OpenJPEG no no 34.7 101.55
JasPer no no 34.5 67.54
FFmpeg no no 34.5 84.54
Kakadu yes yes (12.3) (27.13)
11 / 13

12. Performance
0.0
20.0
40.0
60.0
80.0
100.0
120.0
140.0
100.0k 1.0M 10.0M 100.0M 1.0G
time[ns]
resolution [pel]
proposed
OpenJPEG
JasPer
FFmpeg
12 / 13

13. Summary
solution: a processing unit
continuously consumes an input and produces an output
visits every image sample only once (cache friendly)
is aware of image coordinates (can handle the borders)
configuration (state) can be saved/restored
can be run in any direction
can be SIMD vectorized
can run in parallel (on independent parts of the image)
13 / 13