Do I have to make a reservation for airport limo service?

It is a good idea but no. If you do they will hold a board up with your name on it as your flight is being released. And if you don't you can call a limo service to pick you up there but that may not work if no jfk limo service long island are available and you would have to wait so I would suggest making a reservation.