Kernel (image processing)

Related on Lably

Through Digital image processing, Matrix (mathematics) and Convolution

Lab · Class 10–12Handwriting Recognizer Lab · Class 10–12Pixel Art Explorer Lab · Class 12Matrices Lab · Class 12Determinants

Details

The general expression of a convolution is

$g_{x, y} = ω * f_{x, y} = \sum_{i = - a}^{a} \sum_{j = - b}^{b} ω_{i, j} f_{x - i, y - j},$

where $g (x, y)$ is the filtered image, $f (x, y)$ is the original image, $ω$ is the filter kernel. Every element of the filter kernel is considered by $- a \leq i \leq a$ and $- b \leq j \leq b$ .

Depending on the element values, a kernel can cause a wide range of effects:

The above are just a few examples of effects achievable by convolving kernels and images.

Origin

The origin is the position of the kernel which is above (conceptually) the current output pixel. This could be outside of the actual kernel, though usually it corresponds to one of the kernel elements. For a symmetric kernel, the origin is usually the center element.

One more chapter is free with a Lably account.

Convolution

Convolution is the process of adding each element of the image to its local neighbors, weighted by the kernel. This is related to a form of mathematical convolution. The matrix operation being performed—convolution—is not traditional matrix multiplication, despite being similarly denoted by *.

For example, if we have two three-by-three matrices, the first a kernel, and the second an image piece, convolution is the process of flipping both the rows and columns of the kernel and multiplying locally similar entries and summing. The element at coordinates [2, 2] (that is, the central element) of the resulting image would be a weighted combination of all the entries of the image matrix, with weights given by the kernel:

$([\begin{matrix} a & b & c \\ d & e & f \\ g & h & i \end{matrix}] * [\begin{matrix} 1 & 2 & 3 \\ 4 & 5 & 6 \\ 7 & 8 & 9 \end{matrix}]) [2, 2] =$ $(i \cdot 1) + (h \cdot 2) + (g \cdot 3) + (f \cdot 4) + (e \cdot 5) + (d \cdot 6) + (c \cdot 7) + (b \cdot 8) + (a \cdot 9) .$

The other entries would be similarly weighted, where we position the center of the kernel on each of the boundary points of the image, and compute a weighted sum.

The values of a given pixel in the output image are calculated by multiplying each kernel value by the corresponding input image pixel values. This can be described algorithmically with the following pseudo-code:

<b id="mwlQ">for each</b> <i id="mwlg">image row</i> <b id="mwlw">in</b> <i id="mwmA">input image</i>: <b id="mwmQ">for each</b> <i id="mwmg">pixel</i> <b id="mwmw">in</b> <i id="mwnA">image row</i>: <b id="mwnQ">set</b> <i id="mwng">accumulator</i> to zero <b id="mwnw">for each</b> <i id="mwoA">kernel row</i> <b id="mwoQ">in</b> <i id="mwog">kernel</i>: <b id="mwow">for each</b> <i id="mwpA">element</i> <b id="mwpQ">in</b> <i id="mwpg">kernel row</i>: <b id="mwpw">if</b> <i id="mwqA">element position</i> corresponding* to <i id="mwqQ">pixel position</i> <b id="mwqg">then</b> <b id="mwqw">multiply</b> <i id="mwrA">element value</i> corresponding* to <i id="mwrQ">pixel value</i> <b id="mwrg">add</b> <i id="mwrw">result</i> to <i id="mwsA">accumulator</i> <b id="mwsQ">endif</b> <b id="mwsg">set</b> <i id="mwsw">output image pixel</i> to <i id="mwtA">accumulator</i>

*corresponding input image pixels are found relative to the kernel's origin.

If the kernel is symmetric then place the center (origin) of the kernel on the current pixel. The kernel will overlap the neighboring pixels around the origin. Each kernel element should be multiplied with the pixel value it overlaps with and all of the obtained values should be summed. This resultant sum will be the new value for the current pixel currently overlapped with the center of the kernel.

If the kernel is not symmetric, it has to be flipped both around its horizontal and vertical axis before calculating the convolution as above.

The general form for matrix convolution is

$[\begin{matrix} x_{11} & x_{12} & \dots & x_{1 n} \\ x_{21} & x_{22} & \dots & x_{2 n} \\ ⋮ & ⋮ & ⋱ & ⋮ \\ x_{m 1} & x_{m 2} & \dots & x_{m n} \end{matrix}] * [\begin{matrix} y_{11} & y_{12} & \dots & y_{1 n} \\ y_{21} & y_{22} & \dots & y_{2 n} \\ ⋮ & ⋮ & ⋱ & ⋮ \\ y_{m 1} & y_{m 2} & \dots & y_{m n} \end{matrix}] = \sum_{i = 0}^{m - 1} \sum_{j = 0}^{n - 1} x_{(m - i) (n - j)} y_{(1 + i) (1 + j)}$

Edge handling

Kernel convolution usually requires values from pixels outside of the image boundaries. There are a variety of methods for handling image edges.

Extend: The nearest border pixels are conceptually extended as far as necessary to provide values for the convolution. Corner pixels are extended in 90° wedges. Other edge pixels are extended in lines.
Wrap: The image is conceptually wrapped (or tiled) and values are taken from the opposite edge or corner.
Mirror: The image is conceptually mirrored at the edges. For example, attempting to read a pixel 3 units outside an edge reads one 3 units inside the edge instead.
Crop / Avoid overlap: Any pixel in the output image which would require values from beyond the edge is skipped. This method can result in the output image being slightly smaller, with the edges having been cropped. Move kernel so that values from outside of image is never required. Machine learning mainly uses this approach. Example: Kernel size 10x10, image size 32x32, result image is 23x23.
Kernel Crop: Any pixel in the kernel that extends past the input image isn't used and the normalizing is adjusted to compensate.
Constant: Use constant value for pixels outside of image. Usually black or sometimes gray is used. Generally this depends on application.

Normalization

Normalization is defined as the division of each element in the kernel by the sum of all kernel elements, so that the sum of the elements of a normalized kernel is unity. This will ensure the average pixel in the modified image is as bright as the average pixel in the original image.

Optimization

Fast convolution algorithms include:

separable convolution

Separable convolution

2D convolution with an M × N kernel requires M × N multiplications for each sample (pixel). If the kernel is separable, then the computation can be reduced to M + N multiplications. Using separable convolutions can significantly decrease the computation by doing 1D convolution twice instead of one 2D convolution.

Implementation

Here a concrete convolution implementation done with the GLSL shading language :

<span id="mw7g"></span><span class="c1" id="mw7w">// author : csblo</span> <span class="c1" id="mw8A">// Work made just by consulting :</span> <span class="c1" id="mw8Q">// https://en.wikipedia.org/wiki/Kernel_(image_processing)</span> <span class="c1" id="mw8g">// Define kernels</span> <span class="cp" id="mw8w">#define identity mat3(0, 0, 0, 0, 1, 0, 0, 0, 0)</span> <span class="cp" id="mw9A">#define edge0 mat3(1, 0, -1, 0, 0, 0, -1, 0, 1)</span> <span class="cp" id="mw9Q">#define edge1 mat3(0, 1, 0, 1, -4, 1, 0, 1, 0)</span> <span class="cp" id="mw9g">#define edge2 mat3(-1, -1, -1, -1, 8, -1, -1, -1, -1)</span> <span class="cp" id="mw9w">#define sharpen mat3(0, -1, 0, -1, 5, -1, 0, -1, 0)</span> <span class="cp" id="mw-A">#define box_blur mat3(1, 1, 1, 1, 1, 1, 1, 1, 1) * 0.1111</span> <span class="cp" id="mw-Q">#define gaussian_blur mat3(1, 2, 1, 2, 4, 2, 1, 2, 1) * 0.0625</span> <span class="cp" id="mw-g">#define emboss mat3(-2, -1, 0, -1, 1, 1, 0, 1, 2)</span> <span class="c1" id="mw-w">// Find coordinate of matrix element from index</span> <span class="kt" id="mw_A">vec2</span><span class="w" id="mw_Q"> </span><span class="n" id="mw_g">kpos</span><span class="p" id="mw_w">(</span><span class="kt" id="mwAQA">int</span><span class="w" id="mwAQE"> </span><span class="n" id="mwAQI">index</span><span class="p" id="mwAQM">)</span> <span class="p" id="mwAQQ">{</span> <span class="w" id="mwAQU"> </span><span class="k" id="mwAQY">return</span><span class="w" id="mwAQc"> </span><span class="kt" id="mwAQg">vec2</span><span class="p" id="mwAQk">[</span><span class="mi" id="mwAQo">9</span><span class="p" id="mwAQs">]</span><span class="w" id="mwAQw"> </span><span class="p" id="mwAQ0">(</span> <span class="w" id="mwAQ4"> </span><span class="kt" id="mwAQ8">vec2</span><span class="p" id="mwARA">(</span><span class="o" id="mwARE">-</span><span class="mi" id="mwARI">1</span><span class="p" id="mwARM">,</span><span class="w" id="mwARQ"> </span><span class="o" id="mwARU">-</span><span class="mi" id="mwARY">1</span><span class="p" id="mwARc">),</span><span class="w" id="mwARg"> </span><span class="kt" id="mwARk">vec2</span><span class="p" id="mwARo">(</span><span class="mo" id="mwARs">0</span><span class="p" id="mwARw">,</span><span class="w" id="mwAR0"> </span><span class="o" id="mwAR4">-</span><span class="mi" id="mwAR8">1</span><span class="p" id="mwASA">),</span><span class="w" id="mwASE"> </span><span class="kt" id="mwASI">vec2</span><span class="p" id="mwASM">(</span><span class="mi" id="mwASQ">1</span><span class="p" id="mwASU">,</span><span class="w" id="mwASY"> </span><span class="o" id="mwASc">-</span><span class="mi" id="mwASg">1</span><span class="p" id="mwASk">),</span> <span class="w" id="mwASo"> </span><span class="kt" id="mwASs">vec2</span><span class="p" id="mwASw">(</span><span class="o" id="mwAS0">-</span><span class="mi" id="mwAS4">1</span><span class="p" id="mwAS8">,</span><span class="w" id="mwATA"> </span><span class="mo" id="mwATE">0</span><span class="p" id="mwATI">),</span><span class="w" id="mwATM"> </span><span class="kt" id="mwATQ">vec2</span><span class="p" id="mwATU">(</span><span class="mo" id="mwATY">0</span><span class="p" id="mwATc">,</span><span class="w" id="mwATg"> </span><span class="mo" id="mwATk">0</span><span class="p" id="mwATo">),</span><span class="w" id="mwATs"> </span><span class="kt" id="mwATw">vec2</span><span class="p" id="mwAT0">(</span><span class="mi" id="mwAT4">1</span><span class="p" id="mwAT8">,</span><span class="w" id="mwAUA"> </span><span class="mo" id="mwAUE">0</span><span class="p" id="mwAUI">),</span><span class="w" id="mwAUM"> </span> <span class="w" id="mwAUQ"> </span><span class="kt" id="mwAUU">vec2</span><span class="p" id="mwAUY">(</span><span class="o" id="mwAUc">-</span><span class="mi" id="mwAUg">1</span><span class="p" id="mwAUk">,</span><span class="w" id="mwAUo"> </span><span class="mi" id="mwAUs">1</span><span class="p" id="mwAUw">),</span><span class="w" id="mwAU0"> </span><span class="kt" id="mwAU4">vec2</span><span class="p" id="mwAU8">(</span><span class="mo" id="mwAVA">0</span><span class="p" id="mwAVE">,</span><span class="w" id="mwAVI"> </span><span class="mi" id="mwAVM">1</span><span class="p" id="mwAVQ">),</span><span class="w" id="mwAVU"> </span><span class="kt" id="mwAVY">vec2</span><span class="p" id="mwAVc">(</span><span class="mi" id="mwAVg">1</span><span class="p" id="mwAVk">,</span><span class="w" id="mwAVo"> </span><span class="mi" id="mwAVs">1</span><span class="p" id="mwAVw">)</span> <span class="w" id="mwAV0"> </span><span class="p" id="mwAV4">)[</span><span class="n" id="mwAV8">index</span><span class="p" id="mwAWA">]</span><span class="w" id="mwAWE"> </span><span class="o" id="mwAWI">/</span><span class="w" id="mwAWM"> </span><span class="n" id="mwAWQ">iResolution</span><span class="p" id="mwAWU">.</span><span class="n" id="mwAWY">xy</span><span class="p" id="mwAWc">;</span> <span class="p" id="mwAWg">}</span> <span class="c1" id="mwAWk">// Extract region of dimension 3x3 from sampler centered in uv</span> <span class="c1" id="mwAWo">// sampler : texture sampler</span> <span class="c1" id="mwAWs">// uv : current coordinates on sampler</span> <span class="c1" id="mwAWw">// return : an array of mat3, each index corresponding with a color channel</span> <span class="kt" id="mwAW0">mat3</span><span class="p" id="mwAW4">[</span><span class="mi" id="mwAW8">3</span><span class="p" id="mwAXA">]</span><span class="w" id="mwAXE"> </span><span class="n" id="mwAXI">region3x3</span><span class="p" id="mwAXM">(</span><span class="kt" id="mwAXQ">sampler2D</span><span class="w" id="mwAXU"> </span><span class="n" id="mwAXY">sampler</span><span class="p" id="mwAXc">,</span><span class="w" id="mwAXg"> </span><span class="kt" id="mwAXk">vec2</span><span class="w" id="mwAXo"> </span><span class="n" id="mwAXs">uv</span><span class="p" id="mwAXw">)</span> <span class="p" id="mwAX0">{</span> <span class="w" id="mwAX4"> </span><span class="c1" id="mwAX8">// Create each pixels for region</span> <span class="w" id="mwAYA"> </span><span class="kt" id="mwAYE">vec4</span><span class="p" id="mwAYI">[</span><span class="mi" id="mwAYM">9</span><span class="p" id="mwAYQ">]</span><span class="w" id="mwAYU"> </span><span class="n" id="mwAYY">region</span><span class="p" id="mwAYc">;</span> <span class="w" id="mwAYg"> </span> <span class="w" id="mwAYk"> </span><span class="k" id="mwAYo">for</span><span class="w" id="mwAYs"> </span><span class="p" id="mwAYw">(</span><span class="kt" id="mwAY0">int</span><span class="w" id="mwAY4"> </span><span class="n" id="mwAY8">i</span><span class="w" id="mwAZA"> </span><span class="o" id="mwAZE">=</span><span class="w" id="mwAZI"> </span><span class="mo" id="mwAZM">0</span><span class="p" id="mwAZQ">;</span><span class="w" id="mwAZU"> </span><span class="n" id="mwAZY">i</span><span class="w" id="mwAZc"> </span><span class="o" id="mwAZg"><</span><span class="w" id="mwAZk"> </span><span class="mi" id="mwAZo">9</span><span class="p" id="mwAZs">;</span><span class="w" id="mwAZw"> </span><span class="n" id="mwAZ0">i</span><span class="o" id="mwAZ4">++</span><span class="p" id="mwAZ8">)</span> <span class="w" id="mwAaA"> </span><span class="n" id="mwAaE">region</span><span class="p" id="mwAaI">[</span><span class="n" id="mwAaM">i</span><span class="p" id="mwAaQ">]</span><span class="w" id="mwAaU"> </span><span class="o" id="mwAaY">=</span><span class="w" id="mwAac"> </span><span class="n" id="mwAag">texture</span><span class="p" id="mwAak">(</span><span class="n" id="mwAao">sampler</span><span class="p" id="mwAas">,</span><span class="w" id="mwAaw"> </span><span class="n" id="mwAa0">uv</span><span class="w" id="mwAa4"> </span><span class="o" id="mwAa8">+</span><span class="w" id="mwAbA"> </span><span class="n" id="mwAbE">kpos</span><span class="p" id="mwAbI">(</span><span class="n" id="mwAbM">i</span><span class="p" id="mwAbQ">));</span> <span class="w" id="mwAbU"> </span><span class="c1" id="mwAbY">// Create 3x3 region with 3 color channels (red, green, blue)</span> <span class="w" id="mwAbc"> </span><span class="kt" id="mwAbg">mat3</span><span class="p" id="mwAbk">[</span><span class="mi" id="mwAbo">3</span><span class="p" id="mwAbs">]</span><span class="w" id="mwAbw"> </span><span class="n" id="mwAb0">mRegion</span><span class="p" id="mwAb4">;</span> <span class="w" id="mwAb8"> </span> <span class="w" id="mwAcA"> </span><span class="k" id="mwAcE">for</span><span class="w" id="mwAcI"> </span><span class="p" id="mwAcM">(</span><span class="kt" id="mwAcQ">int</span><span class="w" id="mwAcU"> </span><span class="n" id="mwAcY">i</span><span class="w" id="mwAcc"> </span><span class="o" id="mwAcg">=</span><span class="w" id="mwAck"> </span><span class="mo" id="mwAco">0</span><span class="p" id="mwAcs">;</span><span class="w" id="mwAcw"> </span><span class="n" id="mwAc0">i</span><span class="w" id="mwAc4"> </span><span class="o" id="mwAc8"><</span><span class="w" id="mwAdA"> </span><span class="mi" id="mwAdE">3</span><span class="p" id="mwAdI">;</span><span class="w" id="mwAdM"> </span><span class="n" id="mwAdQ">i</span><span class="o" id="mwAdU">++</span><span class="p" id="mwAdY">)</span> <span class="w" id="mwAdc"> </span><span class="n" id="mwAdg">mRegion</span><span class="p" id="mwAdk">[</span><span class="n" id="mwAdo">i</span><span class="p" id="mwAds">]</span><span class="w" id="mwAdw"> </span><span class="o" id="mwAd0">=</span><span class="w" id="mwAd4"> </span><span class="kt" id="mwAd8">mat3</span><span class="p" id="mwAeA">(</span> <span class="w" id="mwAeE"> </span><span class="n" id="mwAeI">region</span><span class="p" id="mwAeM">[</span><span class="mo" id="mwAeQ">0</span><span class="p" id="mwAeU">][</span><span class="n" id="mwAeY">i</span><span class="p" id="mwAec">],</span><span class="w" id="mwAeg"> </span><span class="n" id="mwAek">region</span><span class="p" id="mwAeo">[</span><span class="mi" id="mwAes">1</span><span class="p" id="mwAew">][</span><span class="n" id="mwAe0">i</span><span class="p" id="mwAe4">],</span><span class="w" id="mwAe8"> </span><span class="n" id="mwAfA">region</span><span class="p" id="mwAfE">[</span><span class="mi" id="mwAfI">2</span><span class="p" id="mwAfM">][</span><span class="n" id="mwAfQ">i</span><span class="p" id="mwAfU">],</span> <span class="w" id="mwAfY"> </span><span class="n" id="mwAfc">region</span><span class="p" id="mwAfg">[</span><span class="mi" id="mwAfk">3</span><span class="p" id="mwAfo">][</span><span class="n" id="mwAfs">i</span><span class="p" id="mwAfw">],</span><span class="w" id="mwAf0"> </span><span class="n" id="mwAf4">region</span><span class="p" id="mwAf8">[</span><span class="mi" id="mwAgA">4</span><span class="p" id="mwAgE">][</span><span class="n" id="mwAgI">i</span><span class="p" id="mwAgM">],</span><span class="w" id="mwAgQ"> </span><span class="n" id="mwAgU">region</span><span class="p" id="mwAgY">[</span><span class="mi" id="mwAgc">5</span><span class="p" id="mwAgg">][</span><span class="n" id="mwAgk">i</span><span class="p" id="mwAgo">],</span> <span class="w" id="mwAgs"> </span><span class="n" id="mwAgw">region</span><span class="p" id="mwAg0">[</span><span class="mi" id="mwAg4">6</span><span class="p" id="mwAg8">][</span><span class="n" id="mwAhA">i</span><span class="p" id="mwAhE">],</span><span class="w" id="mwAhI"> </span><span class="n" id="mwAhM">region</span><span class="p" id="mwAhQ">[</span><span class="mi" id="mwAhU">7</span><span class="p" id="mwAhY">][</span><span class="n" id="mwAhc">i</span><span class="p" id="mwAhg">],</span><span class="w" id="mwAhk"> </span><span class="n" id="mwAho">region</span><span class="p" id="mwAhs">[</span><span class="mi" id="mwAhw">8</span><span class="p" id="mwAh0">][</span><span class="n" id="mwAh4">i</span><span class="p" id="mwAh8">]</span> <span class="w" id="mwAiA"> </span><span class="p" id="mwAiE">);</span> <span class="w" id="mwAiI"> </span> <span class="w" id="mwAiM"> </span><span class="k" id="mwAiQ">return</span><span class="w" id="mwAiU"> </span><span class="n" id="mwAiY">mRegion</span><span class="p" id="mwAic">;</span> <span class="p" id="mwAig">}</span> <span class="c1" id="mwAik">// Convolve a texture with kernel</span> <span class="c1" id="mwAio">// kernel : kernel used for convolution</span> <span class="c1" id="mwAis">// sampler : texture sampler</span> <span class="c1" id="mwAiw">// uv : current coordinates on sampler</span> <span class="kt" id="mwAi0">vec3</span><span class="w" id="mwAi4"> </span><span class="n" id="mwAi8">convolution</span><span class="p" id="mwAjA">(</span><span class="kt" id="mwAjE">mat3</span><span class="w" id="mwAjI"> </span><span class="n" id="mwAjM">kernel</span><span class="p" id="mwAjQ">,</span><span class="w" id="mwAjU"> </span><span class="kt" id="mwAjY">sampler2D</span><span class="w" id="mwAjc"> </span><span class="n" id="mwAjg">sampler</span><span class="p" id="mwAjk">,</span><span class="w" id="mwAjo"> </span><span class="kt" id="mwAjs">vec2</span><span class="w" id="mwAjw"> </span><span class="n" id="mwAj0">uv</span><span class="p" id="mwAj4">)</span> <span class="p" id="mwAj8">{</span> <span class="w" id="mwAkA"> </span><span class="kt" id="mwAkE">vec3</span><span class="w" id="mwAkI"> </span><span class="n" id="mwAkM">fragment</span><span class="p" id="mwAkQ">;</span> <span class="w" id="mwAkU"> </span> <span class="w" id="mwAkY"> </span><span class="c1" id="mwAkc">// Extract a 3x3 region centered in uv</span> <span class="w" id="mwAkg"> </span><span class="kt" id="mwAkk">mat3</span><span class="p" id="mwAko">[</span><span class="mi" id="mwAks">3</span><span class="p" id="mwAkw">]</span><span class="w" id="mwAk0"> </span><span class="n" id="mwAk4">region</span><span class="w" id="mwAk8"> </span><span class="o" id="mwAlA">=</span><span class="w" id="mwAlE"> </span><span class="n" id="mwAlI">region3x3</span><span class="p" id="mwAlM">(</span><span class="n" id="mwAlQ">sampler</span><span class="p" id="mwAlU">,</span><span class="w" id="mwAlY"> </span><span class="n" id="mwAlc">uv</span><span class="p" id="mwAlg">);</span> <span class="w" id="mwAlk"> </span> <span class="w" id="mwAlo"> </span><span class="c1" id="mwAls">// for each color channel of region</span> <span class="w" id="mwAlw"> </span><span class="k" id="mwAl0">for</span><span class="w" id="mwAl4"> </span><span class="p" id="mwAl8">(</span><span class="kt" id="mwAmA">int</span><span class="w" id="mwAmE"> </span><span class="n" id="mwAmI">i</span><span class="w" id="mwAmM"> </span><span class="o" id="mwAmQ">=</span><span class="w" id="mwAmU"> </span><span class="mo" id="mwAmY">0</span><span class="p" id="mwAmc">;</span><span class="w" id="mwAmg"> </span><span class="n" id="mwAmk">i</span><span class="w" id="mwAmo"> </span><span class="o" id="mwAms"><</span><span class="w" id="mwAmw"> </span><span class="mi" id="mwAm0">3</span><span class="p" id="mwAm4">;</span><span class="w" id="mwAm8"> </span><span class="n" id="mwAnA">i</span><span class="o" id="mwAnE">++</span><span class="p" id="mwAnI">)</span> <span class="w" id="mwAnM"> </span><span class="p" id="mwAnQ">{</span> <span class="w" id="mwAnU"> </span><span class="c1" id="mwAnY">// get region channel</span> <span class="w" id="mwAnc"> </span><span class="kt" id="mwAng">mat3</span><span class="w" id="mwAnk"> </span><span class="n" id="mwAno">rc</span><span class="w" id="mwAns"> </span><span class="o" id="mwAnw">=</span><span class="w" id="mwAn0"> </span><span class="n" id="mwAn4">region</span><span class="p" id="mwAn8">[</span><span class="n" id="mwAoA">i</span><span class="p" id="mwAoE">];</span> <span class="w" id="mwAoI"> </span><span class="c1" id="mwAoM">// component wise multiplication of kernel by region channel</span> <span class="w" id="mwAoQ"> </span><span class="kt" id="mwAoU">mat3</span><span class="w" id="mwAoY"> </span><span class="n" id="mwAoc">c</span><span class="w" id="mwAog"> </span><span class="o" id="mwAok">=</span><span class="w" id="mwAoo"> </span><span class="n" id="mwAos">matrixCompMult</span><span class="p" id="mwAow">(</span><span class="n" id="mwAo0">kernel</span><span class="p" id="mwAo4">,</span><span class="w" id="mwAo8"> </span><span class="n" id="mwApA">rc</span><span class="p" id="mwApE">);</span> <span class="w" id="mwApI"> </span><span class="c1" id="mwApM">// add each component of matrix</span> <span class="w" id="mwApQ"> </span><span class="kt" id="mwApU">float</span><span class="w" id="mwApY"> </span><span class="n" id="mwApc">r</span><span class="w" id="mwApg"> </span><span class="o" id="mwApk">=</span><span class="w" id="mwApo"> </span><span class="n" id="mwAps">c</span><span class="p" id="mwApw">[</span><span class="mo" id="mwAp0">0</span><span class="p" id="mwAp4">][</span><span class="mo" id="mwAp8">0</span><span class="p" id="mwAqA">]</span><span class="w" id="mwAqE"> </span><span class="o" id="mwAqI">+</span><span class="w" id="mwAqM"> </span><span class="n" id="mwAqQ">c</span><span class="p" id="mwAqU">[</span><span class="mi" id="mwAqY">1</span><span class="p" id="mwAqc">][</span><span class="mo" id="mwAqg">0</span><span class="p" id="mwAqk">]</span><span class="w" id="mwAqo"> </span><span class="o" id="mwAqs">+</span><span class="w" id="mwAqw"> </span><span class="n" id="mwAq0">c</span><span class="p" id="mwAq4">[</span><span class="mi" id="mwAq8">2</span><span class="p" id="mwArA">][</span><span class="mo" id="mwArE">0</span><span class="p" id="mwArI">]</span> <span class="w" id="mwArM"> </span><span class="o" id="mwArQ">+</span><span class="w" id="mwArU"> </span><span class="n" id="mwArY">c</span><span class="p" id="mwArc">[</span><span class="mo" id="mwArg">0</span><span class="p" id="mwArk">][</span><span class="mi" id="mwAro">1</span><span class="p" id="mwArs">]</span><span class="w" id="mwArw"> </span><span class="o" id="mwAr0">+</span><span class="w" id="mwAr4"> </span><span class="n" id="mwAr8">c</span><span class="p" id="mwAsA">[</span><span class="mi" id="mwAsE">1</span><span class="p" id="mwAsI">][</span><span class="mi" id="mwAsM">1</span><span class="p" id="mwAsQ">]</span><span class="w" id="mwAsU"> </span><span class="o" id="mwAsY">+</span><span class="w" id="mwAsc"> </span><span class="n" id="mwAsg">c</span><span class="p" id="mwAsk">[</span><span class="mi" id="mwAso">2</span><span class="p" id="mwAss">][</span><span class="mi" id="mwAsw">1</span><span class="p" id="mwAs0">]</span> <span class="w" id="mwAs4"> </span><span class="o" id="mwAs8">+</span><span class="w" id="mwAtA"> </span><span class="n" id="mwAtE">c</span><span class="p" id="mwAtI">[</span><span class="mo" id="mwAtM">0</span><span class="p" id="mwAtQ">][</span><span class="mi" id="mwAtU">2</span><span class="p" id="mwAtY">]</span><span class="w" id="mwAtc"> </span><span class="o" id="mwAtg">+</span><span class="w" id="mwAtk"> </span><span class="n" id="mwAto">c</span><span class="p" id="mwAts">[</span><span class="mi" id="mwAtw">1</span><span class="p" id="mwAt0">][</span><span class="mi" id="mwAt4">2</span><span class="p" id="mwAt8">]</span><span class="w" id="mwAuA"> </span><span class="o" id="mwAuE">+</span><span class="w" id="mwAuI"> </span><span class="n" id="mwAuM">c</span><span class="p" id="mwAuQ">[</span><span class="mi" id="mwAuU">2</span><span class="p" id="mwAuY">][</span><span class="mi" id="mwAuc">2</span><span class="p" id="mwAug">];</span> <span class="w" id="mwAuk"> </span> <span class="w" id="mwAuo"> </span><span class="c1" id="mwAus">// for fragment at channel i, set result</span> <span class="w" id="mwAuw"> </span><span class="n" id="mwAu0">fragment</span><span class="p" id="mwAu4">[</span><span class="n" id="mwAu8">i</span><span class="p" id="mwAvA">]</span><span class="w" id="mwAvE"> </span><span class="o" id="mwAvI">=</span><span class="w" id="mwAvM"> </span><span class="n" id="mwAvQ">r</span><span class="p" id="mwAvU">;</span> <span class="w" id="mwAvY"> </span><span class="p" id="mwAvc">}</span> <span class="w" id="mwAvg"> </span> <span class="w" id="mwAvk"> </span><span class="k" id="mwAvo">return</span><span class="w" id="mwAvs"> </span><span class="n" id="mwAvw">fragment</span><span class="p" id="mwAv0">;</span><span class="w" id="mwAv4"> </span> <span class="p" id="mwAv8">}</span> <span class="kt" id="mwAwA">void</span><span class="w" id="mwAwE"> </span><span class="n" id="mwAwI">mainImage</span><span class="p" id="mwAwM">(</span><span class="k" id="mwAwQ">out</span><span class="w" id="mwAwU"> </span><span class="kt" id="mwAwY">vec4</span><span class="w" id="mwAwc"> </span><span class="n" id="mwAwg">fragColor</span><span class="p" id="mwAwk">,</span><span class="w" id="mwAwo"> </span><span class="k" id="mwAws">in</span><span class="w" id="mwAww"> </span><span class="kt" id="mwAw0">vec2</span><span class="w" id="mwAw4"> </span><span class="n" id="mwAw8">fragCoord</span><span class="p" id="mwAxA">)</span> <span class="p" id="mwAxE">{</span> <span class="w" id="mwAxI"> </span><span class="c1" id="mwAxM">// Normalized pixel coordinates (from 0 to 1)</span> <span class="w" id="mwAxQ"> </span><span class="kt" id="mwAxU">vec2</span><span class="w" id="mwAxY"> </span><span class="n" id="mwAxc">uv</span><span class="w" id="mwAxg"> </span><span class="o" id="mwAxk">=</span><span class="w" id="mwAxo"> </span><span class="n" id="mwAxs">fragCoord</span><span class="w" id="mwAxw"> </span><span class="o" id="mwAx0">/</span><span class="w" id="mwAx4"> </span><span class="n" id="mwAx8">iResolution</span><span class="p" id="mwAyA">.</span><span class="n" id="mwAyE">xy</span><span class="p" id="mwAyI">;</span> <span class="w" id="mwAyM"> </span><span class="c1" id="mwAyQ">// Convolve kernel with texture</span> <span class="w" id="mwAyU"> </span><span class="kt" id="mwAyY">vec3</span><span class="w" id="mwAyc"> </span><span class="n" id="mwAyg">col</span><span class="w" id="mwAyk"> </span><span class="o" id="mwAyo">=</span><span class="w" id="mwAys"> </span><span class="n" id="mwAyw">convolution</span><span class="p" id="mwAy0">(</span><span class="n" id="mwAy4">emboss</span><span class="p" id="mwAy8">,</span><span class="w" id="mwAzA"> </span><span class="n" id="mwAzE">iChannel0</span><span class="p" id="mwAzI">,</span><span class="w" id="mwAzM"> </span><span class="n" id="mwAzQ">uv</span><span class="p" id="mwAzU">);</span> <span class="w" id="mwAzY"> </span> <span class="w" id="mwAzc"> </span><span class="c1" id="mwAzg">// Output to screen</span> <span class="w" id="mwAzk"> </span><span class="n" id="mwAzo">fragColor</span><span class="w" id="mwAzs"> </span><span class="o" id="mwAzw">=</span><span class="w" id="mwAz0"> </span><span class="kt" id="mwAz4">vec4</span><span class="p" id="mwAz8">(</span><span class="n" id="mwA0A">col</span><span class="p" id="mwA0E">,</span><span class="w" id="mwA0I"> </span><span class="mf" id="mwA0M">1.0</span><span class="p" id="mwA0Q">);</span> <span class="p" id="mwA0U">}</span>

More in Computing and communication

ISBNUnique numeric book identifier since 1970 X (social network)American social networking service Wayback MachineDigital archive by the Internet Archive Python (programming language)General-purpose programming language MacOSOperating system for Apple computers UnicodeCharacter encoding standard