Pundt was born in South Carolina and worked as an engineer on merchant ships before receiving a commission as a 3rd Assistant Engineer in the C.S. Navy in 1861. He served on the CSS Sumter, before joining the CSS Alabama. He was captured in the engagement with the USS Kearsarge, but was paroled. He then returned to the United States and continued to work in the merchant marine.