numbarrow.core.is_null

Overview

Arrow uses a packed validity bitmap to track which elements in an array are non-null. Each bit corresponds to one element: bit=1 means valid, bit=0 means null. Bits are packed LSB-first into uint8 bytes.

This module provides a single Numba @njit compiled function that reads the bitmap and returns whether a given element index is null.

Module

Null detection for Apache Arrow validity bitmaps.

Arrow uses a packed bitmap to track which elements in an array are valid (non-null). Each bit corresponds to one element: bit=1 means valid, bit=0 means null. Bits are packed LSB-first into uint8 bytes — element i lives at byte i // 8, bit position i % 8 within that byte.

numbarrow.core.is_null.is_null(index_: int, bitmap: ndarray) → bool[source]

Check whether element index_ is null according to bitmap.

Arrow validity bitmaps store one bit per element, packed LSB-first into uint8 bytes. A set bit (1) means valid; a cleared bit (0) means null.

Parameters:

index – zero-based element index
bitmap – uint8 array containing the packed validity bitmap

Returns:

True if the element is null (bit is 0), False if valid (bit is 1)