You can begin homeschooling your child anytime during the year. You just need to submit an affidavit to your school district. They must accept your affidavit and provide you a certificate of exemption, no matter what time of year it is.