It is a crime to knowingly and willfully make any materially false, fictitious, or fraudulent statement or representation in any matter within the jurisdiction of the executive, legislative or judicial branch of the United States. So, yes, it is a crime to lie to the federal government, even when you're not under oath.