For each punctured curve over a finite field, we construct local systems which do not come from a family of abelian varieties. We do so by proving a criterion which must be satisfied by local systems which do come from abelian varieties, inspired by an analogous Hodge theoretic criterion in characteristic zero. Our tools include $F$-isocrystals and some $p$-adic Hodge theory.
