Across the Delaware, near Point Pleasant, PA, there is Tohikan Creek State Park. I think it is in November they release water from Tohikan Lake and... for several days the usually placid Creek becomes a major-major white water kayaking magnet. Don't know if any kayak rentals are possible at the village of Point Pleasant but it's worth a beautiful drive over there to find out.
PS: Kayaks not cheap - my people in the know tell me impulse buyers who sour on the sport often make their kayaks available at bargain rates on Craigs List.
"A billion here, a billion there...add it all up and before you know it you're talking real money." Everett Dirkson