Acetification is irreversible, so if that's what is really going on, it's best to just open it up and make some really good cider vinegar. But sometimes your palate gets fooled by other things and you think it's vinegary when it's not. As Pickled Pepper suggested, it could be just the sourness (tartness) of the acidic juice after all the sugar has fermented out. (Apple juice is 100% fermentable sugars, unlike beer wort.) If it doesn't smell like vinegar, maybe it's not.
Champagne yeast is notorious for hot solventy flavor and harshness when young; in my experience, ciders made with champagne yeast need months of aging.
The bacteria that make vinegar require oxygen. I make tons of cider from unpasteurized juice (pressed from unsanitized apples), in a facility with vinegar barrels right next to the cider fermenters, and don't get any vinegar as long as I keep the air out of the cider vessels. Sanitation isn't really that important in cidermaking. Keeping air out of the cider is much more important.