You're just limited by excursion. As you play lower frequencies, you need to move more and more air to create the same SPL. Not only that but your speakers also have a natural frequency range where it's loud and tapers off at extreme frequencies. For a normal 6.5" woofer, output generally rolls off above 2-3kHz and below 100Hz. Playing past these ranges will normally require some level of EQ boost to maintain a flat response. Below 80Hz, cabin gain helps some and can negate a bit of the loss. However, at some point, you will simply run out of excursion. Xmax is your clean movement range where the cone's movement is relatively linear and accurate. You have a further Xmech range where the movement is limited by the suspension/motor. This is the unclean range and is normally followed by distortion and bottoming out of the woofer. You can't get beyond physics.
So where should you cross? Well, it depends on your hardware, however, a good starting point for a common 6.5" woofer is 80Hz. From there you just play around with different points and see what sounds best. You might end up at 100Hz or 125Hz or down to 60Hz or lower. It depends on how your woofer and sub blend together, how much EQing you are willing to use, as well as how loud you listen to music.