I think private schools are ok if they:

• Have to teach at least the same curriculum as public schools, which has to be audited on their cost
• The amount of public funding they may be eligible to is limited by the amount of their gross revenue
• They have to be secular, i.e. no (not even quasi-) mandatory religious classes, events etc.