Country music star Randy Travis is out of the hospital three weeks after he was admitted with congestive heart failure and later suffered a stroke, which required emergency surgery and left him in critical condition.

A statement Wednesday from Travis' publicist Kirt Webster says that Travis has been moved to a physical therapy center for further treatment for the stroke he suffered July 10.

The 54-year-old singer developed the heart failure due to a viral illness. The stroke prompted surgeons to operate to relieve pressure on his brain.

Travis' fiancee Mary Davis gave thanks for the prayers and support the singer received from fans and friends for his recovery. "Thanks to all the fans and friends for your continued prayers and support as Randy continues on the road to recovery,” Davis says.

Updates on Travis' condition and how it changes will be available on his official website.

We continue to send our thoughts and prayers, and wish Randy Travis all the best during this difficult time.