The Controversy of Fanny Alger: Joseph Smith's First Adulterous Affair
Share
The Controversy of Fanny Alger: Joseph Smith's First Adulterous Affair

Fanny Alger's relationship with Joseph Smith is one of the earliest and most controversial episodes in the history of the Mormon Church. Often referred to as Joseph Smith's first polygamous wife, when in reality it was simply the first documented extramarital affair and to make matters worse, it was with an underage girl.
This extramarital adulterous relationship stands out not only because of its secrecy and timing but also because of its clear lack of legality or spiritual legitimacy. Critics argue that this was not a marriage but rather an affair hidden behind the thin veil of religious justification. The details of this relationship, including testimonies from key figures like Oliver Cowdery, and the subsequent events in Fanny's life, suggest that this was indeed a "dirty, nasty, filthy affair," as Cowdery described it.
Fanny Alger: A 16-Year-Old in the Smith Household
In the early 1830s, Fanny Alger, a 16-year-old girl, was taken into the Smith household in Kirtland, Ohio, to work as a housekeeper. At this time, Joseph Smith was still married to Emma Hale Smith, his first and only legal wife. Emma treated Fanny as an adopted daughter, fostering a close relationship with her. However, behind the scenes, rumors began to spread about the nature of Fanny's relationship with Joseph. It wasn't long before Emma herself discovered the affair.
The secrecy surrounding Joseph and Fanny’s relationship broke when Emma allegedly caught them in the barn. William McLellin, in a letter to Joseph Smith III, described how Emma "looked through a crack and saw the transaction" between Joseph and Fanny. Though the details of this “transaction” are not explicitly spelled out, the term used, along with the emotional fallout, leaves little to the imagination.
Oliver Cowdery’s Condemnation: A “Dirty, Nasty, Filthy Affair”
Oliver Cowdery, one of Joseph Smith’s closest associates and a key figure in the founding of the LDS Church, was appalled by the relationship. In a letter to his brother, Warren A. Cowdery, dated January 21, 1838, Oliver wrote about the "dirty, nasty, filthy affair" between Joseph and Fanny. Cowdery’s testimony is particularly damning, as he knew both Joseph and Fanny well. His description leaves little doubt about his disgust over Joseph’s actions and suggests that this was not a spiritual union but an adulterous affair.
Cowdery's criticism did not go unpunished. Just a few months after he voiced his concerns about Joseph's behavior, the church held a disciplinary council, where Cowdery was excommunicated. One of the charges against him was for "seeking to destroy the character of President Joseph Smith Jr. by falsely insinuating that he was guilty of adultery". The irony here is that Oliver was excommunicated for telling the truth about an affair that church leaders desperately wanted to cover up.
No Sealing Doctrine: A Flimsy Excuse for an Illegitimate Relationship
Joseph Smith did not claim to have received the sealing power (the authority to perform eternal marriages) until 1836, three years after his relationship with Fanny began. This raises significant questions about the legitimacy of the union. If Joseph had not yet received the authority to marry multiple women, how could this relationship with Fanny have been considered anything more than an affair?
Further complicating the narrative is the fact that:
Fanny was never sealed to Joseph during her lifetime
The sealing occurred posthumously in 1899, long after both Joseph and Fanny had died. This delay in sealing further highlights the absence of any legitimate spiritual framework for their relationship.
Fanny’s Departure and Marriage to Solomon Custer
In 1836, just a few months after Emma discovered the affair, Fanny left the Smith household. Her departure was likely the result of both the scandal and Emma’s outrage. A few months after her departure, Fanny married Solomon Custer, a non-Mormon. This quick remarriage casts doubt on the idea that Fanny saw her relationship with Joseph as anything more than a regrettable chapter of her life.
If Fanny had viewed her time with Joseph as a genuine marriage, why would she have left him so readily and married another man just months later? This marriage to Custer, a man outside of the LDS faith, suggests that Fanny did not consider herself bound to Joseph, spiritually or otherwise. It is important to note that Fanny was only 16 or 17 years old during her involvement with Joseph, making the situation even more disturbing given the significant age difference and the power dynamics at play.
Conclusion: An Affair Disguised as Polygamy
The relationship between Joseph Smith and Fanny Alger was not a spiritual union or a divinely ordained marriage. Rather, it was an affair conducted in secrecy and shrouded in religious justification. The testimonies of Oliver Cowdery and others who witnessed the fallout from this relationship provide compelling evidence that this was nothing more than an extramarital affair, one that led to heartbreak, scandal, and excommunication for those who dared to speak the truth.
Joseph's later claims of receiving the sealing power cannot retroactively justify his relationship with Fanny. The absence of any formal marriage, the posthumous sealing, and Fanny’s quick remarriage to Solomon Custer all point to a conclusion that this was, as Cowdery so aptly put it, a "dirty, nasty, filthy affair."
References:
McLellin, William. "Letter to Joseph Smith III." (1872).
Cowdery, Oliver. "Letter to Warren A. Cowdery, January 21, 1838." Huntington Library, San Marino, California.
Joseph Smith Papers: Journals.
Doctrine and Covenants, Section 132 (regarding sealing).
Joseph Smith Papers Project.