Rural Teacher Housing Act of 2003

Rural Teacher Housing Act of 2004 - Requires the Secretary of Agriculture to provide funds to the Alaska Housing Finance Corporation to make grants or loans to a school district located within a qualified community for: (1) construction of new housing units within the community, and the purchase and rehabilitation of existing structures to be used as such; (2) rehabilitation or leasing of housing units within a qualified community and the purchase or lease of real property on which such housing units will be constructed, purchased, or rehabilitated; (3) repayment of a loan used for such purposes or any other activities normally associated with them; and (4) funding of any remaining costs not financed by loans or other sources of funding.

Defines qualified community as a home rule or general law city incorporated under the laws of Alaska, or an unincorporated community situated outside the city limits, which: (1) has a population of 6,500 or fewer individuals; (2) is situated within or near a Native Village that includes the Metlakatla Indian Community of the Annette Islands Reserve, as determined by the Corporation; and (3) is not connected by road (except the Alaska Marine Highway System or a road through Canada) or railroad to the municipality of Anchorage, Alaska.

Requires occupants of such housing units, with certain exceptions, to be teachers, administrators, other school staff, and members of their households.

Authorizes appropriations to the Department of Agriculture to carry out this Act from FY 2006 through 2015.