James Wilson Miller, 2nd son of Samuel and Jeanetta [née Wilson] Miller, was born in the bounds of Rockbridge County, Virginia. His parents were both from early pioneer family of the region. At the age of seventeen, James' family emigrated west; first to Clinton County, Indiana and then two years later to Scotland County, Missouri.

In 1860, James moved back to Indiana. Here he met and married Miss Mary Agnes Lackey on February 6th 1862. Mary Agnes was the daughter of John and Mary Weir [née Walker] Lackey; whose family were also originally from Rockbridge County, Virginia.

James and Mary Agnes would have the following eleven children:
Samuel Gillen
Clara Belle
Mary Jarretta
Margaret Theresa
John Lackey
Nannie
Ermina Elizabeth
Martha Elizabeth
James William
Francis Chalmers
Winona Agnes

In 1878, James Miller moved his family to the area around Memphis in Scotland County, Missouri. Here they lived until 1896, when they moved to Harrison in Boone County, Arkansas.

The Miller's were Presbyterians, the faith of their parents and generations before. Their son, Samuel Gillen, became a well-known Presbyterian minister.

James Wilson Miller departed this life on the 13th of November 1929 in Harrison, Arkansas at the age of 91 years old.