Get even closer so it can't air drop ya, then switch to AP for once and smash into that flimsy armor?
Not that you should even be chasing the CV in the first place.
All carriers had there fire resistance modifier nuked in a patch awhile back, just spray HE into the upper levels and even USN DD can easily light multiple fires and since the secondaries on carrier are almost all open mounts it also quickly destroys many of the guns. AP depends on the ship matchup and the range, but the HE solution always works.
Though it's not like the secondaries on a CV do anything regardless, not even the craziest of memelords would put a secondary build on a CV and even if you did the actual broadside weight isn't usually very good anyway since they tend to have limited arcs and only mediocre tube counts.
There are games besides WoWS (albeit they are very aged and broken games) where if you get too close then the secondaries actually pose a threat to you. The highest tier German CV in NF2 basically plays like an Ise Kai Ni would. Akagi's firepower in that game is also nothing to sneeze at and could threaten a DD that missed their torps.
I won't use planes.I will bring you down by bombardment.