I have seen people walk across the border in the past and clear. Not sure how tough a time you'd be given though. As El Conchinto says, there's little public transportation once you cross.