THe town was originally named Noremac. The name was changed to Madison on July 1, 1919. The town was named for James Madison, the former US president. The Post Office opened on February 1, 1911. The current population is 10.