168

Experiment arms finer than location error

measurement

Assigning experiment arms at a cell grain finer than the delivery channel's location error radius misplaces households across arms. With shared error the misassignment is non-differential (attenuates lift toward null, a power cost); when arms differ in IP-resolvability — multi-family share, carrier NAT, fixed-wireless penetration — the error becomes differential and biases the estimate, not just weakens it.

Detection

Arm-unit equal-area radius smaller than the channel's location error radius; arm-level covariate imbalance on multi-family share or fixed-wireless penetration.

Mitigation

Read the full article: IP Lookup To H3

Affected conversions