Yes, you can use it for any number. For 'one' you would say 'single'. I think the same word is used in American English, except they spell it without the E. We certainly use it here, sometimes with both spellings.
You can use 'floor' - but that is usually more for taller buildings, rather than houses.