I remember receiving a game in the early 70's for Christmas that came in a pretty big box (about 18"-24" square). There was a pole that had a tether-ball with about a foot of cord and a ball that was smaller than a pool ball. The center of the base there was a plastic 'holder' that contained a 3x3 matrix of blocks. Each block had an 'X' or an 'O' (like in tic-tac-toe). You would swing the tether ball and attempt to knock a block from the center- thus getting the spot for your 'X' or 'O'. Maybe Vincent Price was pictured on the cover of the box- not sure. Anyone else remember this game?
Sounds like a Table Skittles with a tac-tac-toe theme added on for scoring instead of more traditional scoring options.
The Skittles games come in a variety of configurations, some with 9 pins arranged in a 3x3 grid, so it wouldn't be a stretch to try to replace the knocked pins (or whatever) with a marker for tic-tac-toe.
Sample of one version with a 3x3 arrangement: