The domestically developed Hsiung-feng III (Brave Wind) missile, with a range of 300 kilometres (around 200 miles), flew about 75 kilometres before plunging into waters off Penghu, a Taiwanese-administered island group in the Taiwan Strait.
The navy said it was not immediately clear how the missile had come to be launched, but suggested it could have been due to human error.
China sends missiles to contested South China Sea island: Taiwan
"Our initial investigation found that the operation was not done in accordance with normal procedure," Vice Admiral Mei Chia-shu told reporters, adding that an investigation was under way.
The missile was fired during a drill at around 8:10 am (0010 GMT) from a 500-tonne missile ship docked at a naval base in the southern city of Tsoying and flew in the direction of China.
Helicopters and navy ships were sent to search for the missile, Mei said, adding that the military had reported the gaffe to the island's top security body, the National Security Conference.
Taiwan's Mainland Affairs Council, which handles China policy, declined to say whether the incident had been reported to Beijing.
US Navy officer charged with spying, possibly for China, Taiwan
Ties between Taipei and Beijing have deteriorated noticeably since President Tsai Ing-wen of the China-sceptic Democratic Progressive Party (DPP) was elected in January.
China still insists that self-ruling Taiwan is part of its territory, even though the two sides split in 1949 after a civil war, and has not ruled out using force to bring about reunification.
COMMENTS
Comments are moderated and generally will be posted if they are on-topic and not abusive.
For more information, please see our Comments FAQ