Can I set up an Australian company with just foreign directors?
No. At least ONE director has to be resident in Australia. Refer S.201A of the Corporations Act 2001.
Also, a company is not required to have a secretary, but it if it does, then that secretary (or at least one of them if there is more than one secretary) must ordinarily be a resident of Australia. Refer S.204A.