Elrod was born on September 27, 1905, in Turner County, Georgia. He enlisted in the Marine Corps in December 1927, and was appointed a Marine second lieutenant in February 1931. He attended the University of Georgia and Yale University prior to his entry into the Marine Corps.
Elrod enlisted in the Marine Corps when he was less than 20 years old