Little Zion church was organized May 1, 1884, by Elder A. Pearce, Eld. H. E. Todd, Eld. M. B. Covington and H. A. Griggs. There were 35 members in the organization. Eld. H. E. Todd was the first pastor, and Jeff Taylor the first clerk.

The first church building was replaced by a frame building in 1908. This building was burned in 1946, but was soon replaced by a very nice building, and was dedicated the first Sunday in May, 1948. Little Zion church has had many great revivals and additions under the leadership of many faithful pastors. These pastors have been:

• Rev. H. E. Todd
• Rev. J. F. Bumpus
• Rev. Josephus Lee
• Rev. A. B. Stone
• Rev. W. A. Miller
• Rev. W. W. Stone
• Rev. C. R. Kinnin
• Rev. J. M. Burden
• Rev. L. L. Todd
• Rev. Charles Polley
• Rev. W. W. Oakley
• Rev. James Overby
• Rev. W. T. Childers,
• Rev. W. M. Frisby
• Rev. Nealy Pearcy
• Rev. B. A. Carroll
• Rev. O. B. Clark
• Rev. Alvin Childers
• Rev. Chester Laymon

The following ministers have been members of this church: Rev. Charles Polley, Rev. L. A. Stone, Rev. O. B. Clark, and at present the Rev. M. L. Clark is a member.

The church clerks have been the following:

• W. D. Edens
• Mark Clark
• L. V. Stone
• Lena Bumpus
• Charles Polley
• H. N. Clark
• Ernys Clark
• Edna Taylor
• Cora Polley
• Hazel Owens
• Elvie Taylor
• Pearl Polley
• Aretha Gibson
• Rudye Dossett
• Mabel Polley

The church has entertain Union Association in 1888, and in 1909; also the Ministers and deacons Meetings, and the Sunday School and Christian Endeavor Convention several times.