He was born Andrew Jackson Caldwell in Bucyrus Ohio March 24, 1841 to John and Martha Caldwell. He had brothers John killed at Missionary Ridge, and Martin Van Buren Caldwell who died in a US army hospital of smallpox. Father, John was killed in 1852 In the Santa Inez Mts in California. He had earlier taken an expidition to Calif. with John C. Fremont.