Developmental regulatory genes have both activating (H3K4me3) and repressive (H3K27me3) histone modifications in embryonic stem cells (ESCs). This bivalent configuration is thought to maintain lineage commitment programs in a poised state. However, establishing physiological relevance has been complicated by the high number of cells required for chromatin immunoprecipitation (ChIP). We developed a low-cell-number chromatin immunoprecipitation (low-cell ChIP) protocol to investigate the chromatin of mouse primordial germ cells (PGCs). Genome-wide analysis of embryonic day 11.5 (E11.5) PGCs revealed H3K4me3/H3K27me3 bivalent domains highly enriched at developmental regulatory genes in a manner remarkably similar to ESCs. Developmental regulators remain bivalent and transcriptionally silent through the initiation of sexual differentiation at E13.5. We also identified >2,500 "orphan" bivalent domains that are distal to known genes and expressed in a tissue-specific manner but silent in PGCs. Our results demonstrate the existence of bivalent domains in the germline and raise the possibility that the somatic program is continuously maintained as bivalent, potentially imparting transgenerational epigenetic inheritance.