Yes, a celery stick can be a natural teether for babies: Pain relief: Celery contains eugenol, which can numb the tongue and relieve teething pain. Pressure relief: The cold and chewy texture of frozen celery can soothe sore gums and relieve pressure. Introduces vegetables: Chewing on celery can help babies get used to the taste of vegetables.