In this paper, we investigate the arithmetic properties of $\ell$-regular overpartition pairs. Let $\overline{B}_{\ell}(n)$ denote the number of $\ell$-regular overpartition pairs of $n$. We will prove the number of Ramanujan-like congruences and infinite families of congruences modulo 3, 8, 16, 36, 48, 96 for $\overline{B}_3(n)$ and modulo 3, 16, 64, 96 for $\overline{B}_4(n)$. For example, we find that for all nonnegative integers $\alpha$ and $n$, $\overline{B}_{3}(3^{\alpha}(3n+2))\equiv 0\pmod{3}$, $\overline{B}_{3}(3^{\alpha}(6n+4))\equiv 0\pmod{3}$, and $\overline{B}_{4}(8n+7)\equiv 0\pmod{64}$.