Infertility affects around 7\% of the male population and can be due to severe spermatogenic failure (SPGF), resulting in no or very few sperm in the ejaculate. We initially identified a homozygous frameshift variant in FKBP6 in a man with extreme oligozoospermia. Subsequently, we screened a total of 2,699 men with SPGF and detected rare bi-allelic loss-of-function variants in FKBP6 in five additional persons. All six individuals had no or extremely few sperm in the ejaculate, which were not suitable for medically assisted reproduction. Evaluation of testicular tissue revealed an arrest at the stage of round spermatids. Lack of FKBP6 expression in the testis was confirmed by RT-qPCR and immunofluorescence staining. In mice, Fkbp6 is essential for spermatogenesis and has been described as being involved in piRNA biogenesis and formation of the synaptonemal complex (SC). We did not detect FKBP6 as part of the SC in normal human spermatocytes, but small RNA sequencing revealed that loss of FKBP6 severely impacted piRNA levels, supporting a role for FKBP6 in piRNA biogenesis in humans. In contrast to findings in piRNA-pathway mouse models, we did not detect an increase in LINE-1 expression in men with pathogenic FKBP6 variants. Based on our findings, FKBP6 reaches a "strong" level of evidence for being associated with male infertility according to the ClinGen criteria, making it directly applicable for clinical diagnostics. This will improve patient care by providing a causal diagnosis and will help to predict chances for successful surgical sperm retrieval.